Abstract
Color music has attracted great interest in real applications. However, the mismatching problem between music and color has not been resolved. This paper proposes a novel mechanism to map the corresponding relation between music and color, which is embedded into a device with a micro-processor to play music color flashing. The proposed mechanism deduces perfect fifth relation among the wavelengths of lights and determines 12 colors corresponding to musical notes of Twelve-tone equal temperament is determined. Specifically, when a piece of music is playing, the audio signal is sampled and transformed by Fast Fourier Transform (FFT). The method can judge color corresponding to a note and research the mixed light effect of RGB LED driven by PWM outputs. Extended experiments show that the effect of music playing with matching colors flashing in real time is reached, and the color of the mixed lights can automatically match with arbitrary music being played. The paper can reveal relationships between music and color from the perspective of frequency spectrum, and promote the development of the color music, which has broad applications.













Similar content being viewed by others
References
Abood SI (2020) Fast fourier transform (fft). In: Digital signal processing. CRC Press, pp 129–142
Collopy F (2017) Visual music color control system. US Patent 9,786,067
Deng XM, Liu QW, Yang DS, Zhang YF, Fu KJ (2013) A design of automatic bus station reporter based on vs1003 and sd card. In: Advanced materials research, vol 671. Trans Tech Publ, pp 2847–2850
Gaskill N (2017) The articulate eye: Color-music, the color sense, and the language of abstraction. Configurations 25(4):475–505
Gunther L (2012) The physics of music and color. Springer
Hong Z, Chunwei T, Gaoya L, Hongbin W (2013) Implementation of a wireless controlled device with rgb driving based on fft. Int J Multimedia Ubiquitous Eng 8(6):151–158
Hong Z, Ruirui Z, Chunwei T (2015) Design and implementation of the music player based on interface chip ch378. In: 2015 Seventh International Conference on Advanced Communication and Networking (ACN). IEEE, pp 40–43
Hong Z, Xiaoshuang G, Obadi M, Ruirui Z, Jinrui T, Chunwei T, Zhiqiang H (2016) Research and implementation of rgb-led mixed light matching along with music playing. Int J Grid Distribut Comput 9(4):111–120
Hu ZQ, Zhang H, Zhao RR, Wang HB (2015) Application of usb interface chip ch378 in music player design. Journal of Harbin University of Science and Technology (5)21
Ingale R (2014) Harmonic analysis using fft and stft. Int J Signal Process Image Process Pattern Recognit 7(4):345–362
Jiang RM (2007) An area-efficient fft architecture for ofdm digital video broadcasting. IEEE Trans Consum Electron 53(4):1322–1326
Jin L, Du QL (2014) The systematic study of music spectrum display based on fft. In: Advanced Materials Research, vol 945. Trans Tech Publ, pp 1764–1767
Lima ESC (2020) Music notation-to-color synesthesia and early stages of music education: A grounded theory study. Ph.D. thesis, Andrews University
Mateski S, Anastasovski Z (2012) Digital sound recorder with arm microcontroller and sd card. In: 2012 20th Telecommunications Forum (TELFOR). IEEE, pp 1741–1743
Mirri S, Prandi C, Roccetti M, Salomoni P (2017) Walking under a different sky: Urban colored routes for creative engagement and pleasure. Int J Hum-Comput Int 33(12):1010–1021
Nakamura M, Miyashita H (2012) Findings in cognitive science and psychology for designing cognitive tools. Comput Softw 29(1):118–129
Oikawa M, Shimobaba T, Yoda T, Nakayama H, Shiraki A, Masuda N, Ito T (2011) Time-division color electroholography using one-chip rgb led and synchronizing controller. Opt Express 19(13):12008–12013
Palmer SE, Langlois TA, Schloss KB (2016) Music-to-color associations of single-line piano melodies in non-synesthetes. Multisensory Research 29 (1-3):157–193
Palmer SE, Schloss KB, Xu Z, Prado-León LR (2013) Music–color associations are mediated by emotion. Proc Natl Acad Sci 110(22):8836–8841
Poast M (2000) Color music: Visual color notation for musical expression. Leonardo 33(3):215–221
Rashid M, Abu-Bakar S, Mokji M (2013) Human emotion recognition from videos using spatio-temporal and audio features. Vis Comput 29 (12):1269–1275
Schubert E (2007) The influence of emotion, locus of emotion and familiarity upon preference in music. Psychol Music 35(3):499–515
Simner J, Mulvenna C, Sagiv N, Tsakanikos E, Witherby SA, Fraser C, Scott K, Ward J (2006) Synaesthesia: The prevalence of atypical cross-modal experiences. Perception 35(8):1024–1033
Son CG, Yi JH, Gwag JS, Kwon JH, Park GJ (2011) Improvement of color and luminance uniformity of the edge-lit backlight using the rgb leds. J Opt Soc Korea 15(3):272–277
Sun DZ (2014) Design and implementation of mp3 player based on fpga. In: Applied Mechanics and Materials, vol 443. Trans Tech Publ, pp 746–749
Tempelaars S (2014) Signal processing, speech and music. Routledge
Tian C, Xu Y, Li Z, Zuo W, Fei L, Liu H (2020) Attention-guided cnn for image denoising. Neural Netw 124:117–129
Tian C, Xu Y, Zuo W (2020) Image denoising using deep cnn with batch renormalization. Neural Netw 121:461–473
Tian C, Zhang Q, Sun G, Song Z, Li S (2018) Fft consolidated sparse and collaborative representation for image classification. Arab J Sci Eng 43(2):741–758
Tsang T, Schloss KB (2010) Associations between color and music are mediated by emotion and influenced by tempo. The Yale Review of Undergraduate Research in Psychology, vol 82
Vitez T (2018) The influence of music and color on consumer behavior in shopping malls. Ph.D. thesis, Sveučilište Sjever, Sveučilište Sjever
Whiteford KL, Schloss KB, Helwig NE, Palmer SE (2018) Color, music, and emotion: Bach to the blues. i-Perception 9(6):2041669518808535
Yang H, Li Y, Zhang K (2019) Interactive influences of color attributes on color perception bias. Vis Comput: 1–13
Yang W, Hou J, Liu Y, Bao L, Guo L (2013) Design of fft processor based on fpga. Hebei J Ind Sci Technol, vol 2
Yi-chao F, Hong Z, Gao-ya L, Zhi-qiang H, Rui-mi Z (2014) Research and implementation of rgb-led mixed light matching along with music playing. Journal of Harbin University of Science & Technology 19(6)
Yun Y (2013) Audio analysis & creating reverberation plug-ins in digital audio engineering. Int J Multimed Ubiquitous Eng 8(6):201–208
Zhang Dl, Liu H, Song YK, Du GM (2014) Design and implementation of 1-d and 2-d mixed architecture fft processor in heterogeneous multi-core soc based on fpga. Int J Control Autom 7(6):177–188
Zhang H, Lin G (2013) Design and implementation of mixed light effect based on the audio signal frequency spectrum analysis. In: Ifost, vol 2. IEEE, pp 64–68
ZHANG H, WANG H, LIN G (2014) Design and implementation of a device with rgb driving based on fft. ICIC Express Letters Part B, Applications: Int J Res Surv 5(4):1027–1032
Zhou W, Yuan C (2016) Model of image color difference and partial based on rgb color distribution measuring. Int J Grid Distrib Comput 9(8):231–240
Zhu K, Li Y, Zeng W (2016) A study of the correlation between music and color based on neuromarketing. Ind Eng J 19(1):102
Zoranović AL, Stojanović GM, Malbaša VD (2010) Development of an mp3 player using an mp3 hardware decoder. Int J Electr Eng Educ 47(3):329–342
Acknowledgements
This work is supported in part by the National Nature Science Foundation of China Gant No. 61702117.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Zhang, H., Tian, C., You, L. et al. Design and implementation on matching between music and color. Multimed Tools Appl 80, 32091–32109 (2021). https://doi.org/10.1007/s11042-021-11162-x
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-021-11162-x