Abstract
Synesthesia is a neurological phenomenon in which stimulation of one sensory or cognitive pathway leads to automatic, involuntary experiences in a second sensory or cognitive pathway. Many synesthetes used their capabilities as inspiration for their works. Drawing on this phenomenon, this paper presents a model able to create chord progressions using colors as the synesthetic input. In particular, the model extracts sound from colors to create chord progressions by applying an artificial immune system (AIS). The quality of each chord is mapped in the Tonal Interval Space, a geometrical space in which mathematical measures are related to musical properties. The result is an assistive tool that has been evaluated in terms of musical standards and usefulness for the users.
Similar content being viewed by others
References
Ben-Tal, O., Berger, J., Cook, B., Daniels, M., Scavone, G.: Sonart: The sonification application research toolbox. In: Proceedings of the 2002 International Conference on Auditory Display. Kyoto, Japan (2002)
Berman, G.: Synesthesia and the arts. Leonardo 32(1), 15–22 (1999)
Bernardes, G., Cocharro, D., Guedes, C., Davies, M. E.: Conchord: an application for generating musical harmony by navigating in a perceptually motivated tonal interval space. In Proceedings of the 11th International Symposium on Computer Music Modeling and Retrieval (CMMR), pp. 71–86 (2015)
Bernardes, G., Cocharro, D., Caetano, M., Guedes, C., Davies, M.E.: A multi-level tonal interval space for modelling pitch relatedness and musical consonance. J. New Music Res. 45(4), 281–294 (2016)
Cytowic, R.E.: Synesthesia: A Union of the Senses. MIT press, Cambridge (2002)
Cytowic, R.E., Eagleman, D.M.: Wednesday is Indigo Blue: Discovering the Brain of Synesthesia. MIT Press, Cambridge (2011)
Day, S.: Some demographic and socio-cultural aspects of synesthesia. In: Synesthesia: Perspectives from Cognitive Neuroscience. Oxford University Press, New York, NY (2005)
De Castro, L.N., Timmis, J.: Artificial Immune Systems: A New Computational Intelligence Approach. Springer, Berlin (2002)
Delgado, M., Fajardo, W., Molina-Solana, M.: Inmamusys: intelligent multiagent music system. Expert Syst. Appl. 36(3), 4574–4580 (2009)
Ebcioğlu, K.: An expert system for harmonizing chorales in the style of js bach. J. Logic Program. 8(1), 145–185 (1990)
Fujita, H., Cimr, D.: Computer aided detection for fibrillations and flutters using deep convolutional neural network. Inf. Sci. 486, 231–239 (2019)
Fujita, H., Gaeta, A., Loia, V., Orciuoli, F.: Resilience analysis of critical infrastructures: a cognitive approach based on granular computing. IEEE Trans. Cybernet. 49(5), 1835–1848 (2018)
Fukumoto, M.: Creation of music chord progression suited for user’s feelings based on interactive genetic algorithm. In: 3rd International Conference on Advanced Applied Informatics (IIAIAAI), pp. 757–762 (2014)
Glasser, S.: Synesthesia and prodigiousness: the case of Olivier Messiaen. In: Glasser, S. (ed.) Musical Prodigies: Interpretations from Psychology, Education, Musicology, and Ethnomusicology, p. 453. Oxford University Press, Oxford (2016)
Gotmare, A., Bhattacharjee, S.S., Patidar, R., George, N.V.: Swarm and evolutionary computing algorithms for system identification and filter design: a comprehensive review. Swarm Evol. Comput. 32, 68–84 (2017). https://doi.org/10.1016/j.swevo.2016.06.007
Itoh, K., Sakata, H., Kwee, I.L., Nakada, T.: Musical pitch classes have rainbow hues in pitch class-color synesthesia. Sci. Rep. 7(1), 1–9 (2017)
Jo, K., Nagano, N.: Monalisa: see the sound, hear the image. In: Proceedings of the 8th International Conference new interface for musical expression. NIME, vol. 8, pp. 315–318 (2008)
Klügel, N., Lindström, A., Groh, G.: A genetic algorithm approach to collaborative music creation on a multi-touch table. In: 40th International computer music conference, ICMC 2014, joint with the 11th sound and music computing conference, SMC 2014, pp. 286–292 (2014)
Kruger, A.: Median-cut color quantization. Dr Dobb’s J. Softw. Tools Prof. Program. 19(10), 46–55 (1994)
Krumhansl, C.L., Cuddy, L.L.: A theory of tonal hierarchies in music. In: Music Perception, pp. 51–87. Springer, New York, NY (2010)
Maxwell, N.F.: Visualizing sound: effects of pitch height and tonality on luminance matching. Inquiries J. 5(10), 2 (2013)
Millet, J.: Audition colorée. Ph.D. thesis, Imp. Hamelin frères (1892)
Miranda, E. R. (2007). Cellular automata music: from sound synthesis to musical forms. In: Evolutionary computer music (pp. 170–193). Springer, London
Moroni, A., Manzolli, J., Von Zuben, F., Gudwin, R.: Vox populi: an interactive evolutionary system for algorithmic music composition. Leonardo Music J. 21, 19–23 (2006)
Navarro-Cáceres, M., Caetano, M., Bernardes, G., de Castro, L.N.: Chordais: An assistive system for the generation of chord progressions with an artificial immune system. Swarm Evol. Comput. J. 50, 100543 (2019)
Pachet, F., Roy, P.: Non-conformant harmonization: the real book in the style of take 6. In: Proceedings of ICCC 2014 (International Conference on Computational Creativity) (2014)
Riemann, H.: Vereinfachte Harmonielehre. Augener, London (1893)
Sanz, J.C.: In: Blume, H. (ed.) Lenguaje Del Color: Sinestesia cromática en poesía y arte visual. Spain (2009)
Tung, W.F., Yuan, S.T., Wu, Y.C., Hung, P.: Collaborative service system design for music content creation. Inf. Syst. Front. 16(2), 291–302 (2014)
Xiao, Q., Dai, J., Luo, J., Fujita, H.: Multi-view manifold regularized learning-based method for prioritizing candidate disease mirnas. Knowl. Based Syst. 175, 118–129 (2019)
Ying, F.T., Tao, Y., Wang, G.Y., Wang, Q.: Visiblesound: perceiving environmental sound with 4d form. Adv. Mater. Res. 718, 1777–1781 (2013)
Zhang, C., Bi, J., Xu, S., Ramentol, E., Fan, G., Qiao, B., Fujita, H.: Multi-imbalance: an open-source software for multi-class imbalance learning. Knowl. Based Syst. 174, 137–143 (2019)
Acknowledgements
This work was partially funded by the University of Salamanca and the Society of Spanish Researchers in the United Kingdom (SRUK/CERU) under the Mobility Program SRUK/CERU “On the Move”.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Navarro-Cáceres, M., Castellanos-Garzón, J.A. & Bajo, J. An Intelligent System to Generate Chord Progressions from Colors with an Artificial Immune System. New Gener. Comput. 38, 531–549 (2020). https://doi.org/10.1007/s00354-020-00100-4
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00354-020-00100-4