Skip to main content
SpringerLink
Log in

Design and implementation on matching between music and color

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Color music has attracted great interest in real applications. However, the mismatching problem between music and color has not been resolved. This paper proposes a novel mechanism to map the corresponding relation between music and color, which is embedded into a device with a micro-processor to play music color flashing. The proposed mechanism deduces perfect fifth relation among the wavelengths of lights and determines 12 colors corresponding to musical notes of Twelve-tone equal temperament is determined. Specifically, when a piece of music is playing, the audio signal is sampled and transformed by Fast Fourier Transform (FFT). The method can judge color corresponding to a note and research the mixed light effect of RGB LED driven by PWM outputs. Extended experiments show that the effect of music playing with matching colors flashing in real time is reached, and the color of the mixed lights can automatically match with arbitrary music being played. The paper can reveal relationships between music and color from the perspective of frequency spectrum, and promote the development of the color music, which has broad applications.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

References

  1. Abood SI (2020) Fast fourier transform (fft). In: Digital signal processing. CRC Press, pp 129–142

  2. Collopy F (2017) Visual music color control system. US Patent 9,786,067

  3. Deng XM, Liu QW, Yang DS, Zhang YF, Fu KJ (2013) A design of automatic bus station reporter based on vs1003 and sd card. In: Advanced materials research, vol 671. Trans Tech Publ, pp 2847–2850

  4. Gaskill N (2017) The articulate eye: Color-music, the color sense, and the language of abstraction. Configurations 25(4):475–505

    Article  Google Scholar 

  5. Gunther L (2012) The physics of music and color. Springer

  6. Hong Z, Chunwei T, Gaoya L, Hongbin W (2013) Implementation of a wireless controlled device with rgb driving based on fft. Int J Multimedia Ubiquitous Eng 8(6):151–158

    Article  Google Scholar 

  7. Hong Z, Ruirui Z, Chunwei T (2015) Design and implementation of the music player based on interface chip ch378. In: 2015 Seventh International Conference on Advanced Communication and Networking (ACN). IEEE, pp 40–43

  8. Hong Z, Xiaoshuang G, Obadi M, Ruirui Z, Jinrui T, Chunwei T, Zhiqiang H (2016) Research and implementation of rgb-led mixed light matching along with music playing. Int J Grid Distribut Comput 9(4):111–120

    Article  Google Scholar 

  9. Hu ZQ, Zhang H, Zhao RR, Wang HB (2015) Application of usb interface chip ch378 in music player design. Journal of Harbin University of Science and Technology (5)21

  10. Ingale R (2014) Harmonic analysis using fft and stft. Int J Signal Process Image Process Pattern Recognit 7(4):345–362

    MathSciNet  Google Scholar 

  11. Jiang RM (2007) An area-efficient fft architecture for ofdm digital video broadcasting. IEEE Trans Consum Electron 53(4):1322–1326

    Article  Google Scholar 

  12. Jin L, Du QL (2014) The systematic study of music spectrum display based on fft. In: Advanced Materials Research, vol 945. Trans Tech Publ, pp 1764–1767

  13. Lima ESC (2020) Music notation-to-color synesthesia and early stages of music education: A grounded theory study. Ph.D. thesis, Andrews University

  14. Mateski S, Anastasovski Z (2012) Digital sound recorder with arm microcontroller and sd card. In: 2012 20th Telecommunications Forum (TELFOR). IEEE, pp 1741–1743

  15. Mirri S, Prandi C, Roccetti M, Salomoni P (2017) Walking under a different sky: Urban colored routes for creative engagement and pleasure. Int J Hum-Comput Int 33(12):1010–1021

    Article  Google Scholar 

  16. Nakamura M, Miyashita H (2012) Findings in cognitive science and psychology for designing cognitive tools. Comput Softw 29(1):118–129

    Google Scholar 

  17. Oikawa M, Shimobaba T, Yoda T, Nakayama H, Shiraki A, Masuda N, Ito T (2011) Time-division color electroholography using one-chip rgb led and synchronizing controller. Opt Express 19(13):12008–12013

    Article  Google Scholar 

  18. Palmer SE, Langlois TA, Schloss KB (2016) Music-to-color associations of single-line piano melodies in non-synesthetes. Multisensory Research 29 (1-3):157–193

    Article  Google Scholar 

  19. Palmer SE, Schloss KB, Xu Z, Prado-León LR (2013) Music–color associations are mediated by emotion. Proc Natl Acad Sci 110(22):8836–8841

    Article  Google Scholar 

  20. Poast M (2000) Color music: Visual color notation for musical expression. Leonardo 33(3):215–221

    Article  Google Scholar 

  21. Rashid M, Abu-Bakar S, Mokji M (2013) Human emotion recognition from videos using spatio-temporal and audio features. Vis Comput 29 (12):1269–1275

    Article  Google Scholar 

  22. Schubert E (2007) The influence of emotion, locus of emotion and familiarity upon preference in music. Psychol Music 35(3):499–515

    Article  Google Scholar 

  23. Simner J, Mulvenna C, Sagiv N, Tsakanikos E, Witherby SA, Fraser C, Scott K, Ward J (2006) Synaesthesia: The prevalence of atypical cross-modal experiences. Perception 35(8):1024–1033

    Article  Google Scholar 

  24. Son CG, Yi JH, Gwag JS, Kwon JH, Park GJ (2011) Improvement of color and luminance uniformity of the edge-lit backlight using the rgb leds. J Opt Soc Korea 15(3):272–277

    Article  Google Scholar 

  25. Sun DZ (2014) Design and implementation of mp3 player based on fpga. In: Applied Mechanics and Materials, vol 443. Trans Tech Publ, pp 746–749

  26. Tempelaars S (2014) Signal processing, speech and music. Routledge

  27. Tian C, Xu Y, Li Z, Zuo W, Fei L, Liu H (2020) Attention-guided cnn for image denoising. Neural Netw 124:117–129

    Article  Google Scholar 

  28. Tian C, Xu Y, Zuo W (2020) Image denoising using deep cnn with batch renormalization. Neural Netw 121:461–473

    Article  Google Scholar 

  29. Tian C, Zhang Q, Sun G, Song Z, Li S (2018) Fft consolidated sparse and collaborative representation for image classification. Arab J Sci Eng 43(2):741–758

    Article  Google Scholar 

  30. Tsang T, Schloss KB (2010) Associations between color and music are mediated by emotion and influenced by tempo. The Yale Review of Undergraduate Research in Psychology, vol 82

  31. Vitez T (2018) The influence of music and color on consumer behavior in shopping malls. Ph.D. thesis, Sveučilište Sjever, Sveučilište Sjever

  32. Whiteford KL, Schloss KB, Helwig NE, Palmer SE (2018) Color, music, and emotion: Bach to the blues. i-Perception 9(6):2041669518808535

    Article  Google Scholar 

  33. Yang H, Li Y, Zhang K (2019) Interactive influences of color attributes on color perception bias. Vis Comput: 1–13

  34. Yang W, Hou J, Liu Y, Bao L, Guo L (2013) Design of fft processor based on fpga. Hebei J Ind Sci Technol, vol 2

  35. Yi-chao F, Hong Z, Gao-ya L, Zhi-qiang H, Rui-mi Z (2014) Research and implementation of rgb-led mixed light matching along with music playing. Journal of Harbin University of Science & Technology 19(6)

  36. Yun Y (2013) Audio analysis & creating reverberation plug-ins in digital audio engineering. Int J Multimed Ubiquitous Eng 8(6):201–208

    Article  Google Scholar 

  37. Zhang Dl, Liu H, Song YK, Du GM (2014) Design and implementation of 1-d and 2-d mixed architecture fft processor in heterogeneous multi-core soc based on fpga. Int J Control Autom 7(6):177–188

    Article  Google Scholar 

  38. Zhang H, Lin G (2013) Design and implementation of mixed light effect based on the audio signal frequency spectrum analysis. In: Ifost, vol 2. IEEE, pp 64–68

  39. ZHANG H, WANG H, LIN G (2014) Design and implementation of a device with rgb driving based on fft. ICIC Express Letters Part B, Applications: Int J Res Surv 5(4):1027–1032

    Google Scholar 

  40. Zhou W, Yuan C (2016) Model of image color difference and partial based on rgb color distribution measuring. Int J Grid Distrib Comput 9(8):231–240

    Article  Google Scholar 

  41. Zhu K, Li Y, Zeng W (2016) A study of the correlation between music and color based on neuromarketing. Ind Eng J 19(1):102

    Google Scholar 

  42. Zoranović AL, Stojanović GM, Malbaša VD (2010) Development of an mp3 player using an mp3 hardware decoder. Int J Electr Eng Educ 47(3):329–342

    Article  Google Scholar 

Download references

Acknowledgements

This work is supported in part by the National Nature Science Foundation of China Gant No. 61702117.

Author information

Authors and Affiliations

  1. School of Computer Science and Technology, Harbin University of Science and Technology, Harbin, 150080, Heilongjiang, China

    Hong Zhang

  2. School of Software, Northwestern Polytechnical University, Xi’an, 710072, Shaanxi, China

    Chunwei Tian

  3. School of Biomedical Informatics, the University of Texas Houston Science Center at Houston, Houston, TX, 77030, USA

    Lei You

  4. Industrial Training Center, Guangdong Polytechnic Normal University, Guangzhou, 510665, Guangdong, China

    Zhengming Li

  5. School of Natural and Computational Sciences, Massey University, Auckland, New Zealand

    Ming Zong

  6. School of Electronic and Computer Engineering, Peking University Shenzhen Graduate School, Shenzhen, 518055, Guangdong, China

    Kan Huang

Authors
  1. Hong Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Chunwei Tian
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Lei You
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Zhengming Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Ming Zong
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Kan Huang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Chunwei Tian.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhang, H., Tian, C., You, L. et al. Design and implementation on matching between music and color. Multimed Tools Appl 80, 32091–32109 (2021). https://doi.org/10.1007/s11042-021-11162-x

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-021-11162-x

Keywords

Search

Navigation