Skip to main content
Log in

An Intelligent System to Generate Chord Progressions from Colors with an Artificial Immune System

  • Published:
New Generation Computing Aims and scope Submit manuscript

Abstract

Synesthesia is a neurological phenomenon in which stimulation of one sensory or cognitive pathway leads to automatic, involuntary experiences in a second sensory or cognitive pathway. Many synesthetes used their capabilities as inspiration for their works. Drawing on this phenomenon, this paper presents a model able to create chord progressions using colors as the synesthetic input. In particular, the model extracts sound from colors to create chord progressions by applying an artificial immune system (AIS). The quality of each chord is mapped in the Tonal Interval Space, a geometrical space in which mathematical measures are related to musical properties. The result is an assistive tool that has been evaluated in terms of musical standards and usefulness for the users.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

References

  1. Ben-Tal, O., Berger, J., Cook, B., Daniels, M., Scavone, G.: Sonart: The sonification application research toolbox. In: Proceedings of the 2002 International Conference on Auditory Display. Kyoto, Japan (2002)

  2. Berman, G.: Synesthesia and the arts. Leonardo 32(1), 15–22 (1999)

    Article  Google Scholar 

  3. Bernardes, G., Cocharro, D., Guedes, C.,  Davies, M. E.: Conchord: an application for generating musical harmony by navigating in a perceptually motivated tonal interval space. In Proceedings of the 11th International Symposium on Computer Music Modeling and Retrieval (CMMR), pp. 71–86 (2015)

  4. Bernardes, G., Cocharro, D., Caetano, M., Guedes, C., Davies, M.E.: A multi-level tonal interval space for modelling pitch relatedness and musical consonance. J. New Music Res. 45(4), 281–294 (2016)

    Article  Google Scholar 

  5. Cytowic, R.E.: Synesthesia: A Union of the Senses. MIT press, Cambridge (2002)

    Book  Google Scholar 

  6. Cytowic, R.E., Eagleman, D.M.: Wednesday is Indigo Blue: Discovering the Brain of Synesthesia. MIT Press, Cambridge (2011)

    Google Scholar 

  7. Day, S.: Some demographic and socio-cultural aspects of synesthesia. In: Synesthesia: Perspectives from Cognitive Neuroscience. Oxford University Press, New York, NY (2005)

    Google Scholar 

  8. De Castro, L.N., Timmis, J.: Artificial Immune Systems: A New Computational Intelligence Approach. Springer, Berlin (2002)

    MATH  Google Scholar 

  9. Delgado, M., Fajardo, W., Molina-Solana, M.: Inmamusys: intelligent multiagent music system. Expert Syst. Appl. 36(3), 4574–4580 (2009)

    Article  Google Scholar 

  10. Ebcioğlu, K.: An expert system for harmonizing chorales in the style of js bach. J. Logic Program. 8(1), 145–185 (1990)

    Article  MathSciNet  Google Scholar 

  11. Fujita, H., Cimr, D.: Computer aided detection for fibrillations and flutters using deep convolutional neural network. Inf. Sci. 486, 231–239 (2019)

    Article  Google Scholar 

  12. Fujita, H., Gaeta, A., Loia, V., Orciuoli, F.: Resilience analysis of critical infrastructures: a cognitive approach based on granular computing. IEEE Trans. Cybernet. 49(5), 1835–1848 (2018)

    Article  Google Scholar 

  13. Fukumoto, M.: Creation of music chord progression suited for user’s feelings based on interactive genetic algorithm. In: 3rd International Conference on Advanced Applied Informatics (IIAIAAI), pp. 757–762 (2014)

  14. Glasser, S.: Synesthesia and prodigiousness: the case of Olivier Messiaen. In: Glasser, S. (ed.) Musical Prodigies: Interpretations from Psychology, Education, Musicology, and Ethnomusicology, p. 453. Oxford University Press, Oxford (2016)

    Chapter  Google Scholar 

  15. Gotmare, A., Bhattacharjee, S.S., Patidar, R., George, N.V.: Swarm and evolutionary computing algorithms for system identification and filter design: a comprehensive review. Swarm Evol. Comput. 32, 68–84 (2017). https://doi.org/10.1016/j.swevo.2016.06.007

    Article  Google Scholar 

  16. Itoh, K., Sakata, H., Kwee, I.L., Nakada, T.: Musical pitch classes have rainbow hues in pitch class-color synesthesia. Sci. Rep. 7(1), 1–9 (2017)

    Article  Google Scholar 

  17. Jo, K., Nagano, N.: Monalisa: see the sound, hear the image. In: Proceedings of the 8th International Conference new interface for musical expression. NIME, vol. 8, pp. 315–318 (2008)

  18. Klügel, N., Lindström, A., Groh, G.: A genetic algorithm approach to collaborative music creation on a multi-touch table. In: 40th International computer music conference, ICMC 2014, joint with the 11th sound and music computing conference, SMC 2014, pp. 286–292 (2014)

  19. Kruger, A.: Median-cut color quantization. Dr Dobb’s J. Softw. Tools Prof. Program. 19(10), 46–55 (1994)

    Google Scholar 

  20. Krumhansl, C.L., Cuddy, L.L.: A theory of tonal hierarchies in music. In: Music Perception, pp. 51–87. Springer, New York, NY (2010)

    Google Scholar 

  21. Maxwell, N.F.: Visualizing sound: effects of pitch height and tonality on luminance matching. Inquiries J. 5(10), 2 (2013)

    Google Scholar 

  22. Millet, J.: Audition colorée. Ph.D. thesis, Imp. Hamelin frères (1892)

  23. Miranda, E. R. (2007). Cellular automata music: from sound synthesis to musical forms. In: Evolutionary computer music (pp. 170–193). Springer, London

    Chapter  Google Scholar 

  24. Moroni, A., Manzolli, J., Von Zuben, F., Gudwin, R.: Vox populi: an interactive evolutionary system for algorithmic music composition. Leonardo Music J. 21, 19–23 (2006)

    Google Scholar 

  25. Navarro-Cáceres, M., Caetano, M., Bernardes, G., de Castro, L.N.: Chordais: An assistive system for the generation of chord progressions with an artificial immune system. Swarm Evol. Comput. J. 50, 100543 (2019)

    Article  Google Scholar 

  26. Pachet, F., Roy, P.: Non-conformant harmonization: the real book in the style of take 6. In: Proceedings of ICCC 2014 (International Conference on Computational Creativity) (2014)

  27. Riemann, H.: Vereinfachte Harmonielehre. Augener, London (1893)

    Google Scholar 

  28. Sanz, J.C.: In: Blume, H. (ed.) Lenguaje Del Color: Sinestesia cromática en poesía y arte visual. Spain (2009)

  29. Tung, W.F., Yuan, S.T., Wu, Y.C., Hung, P.: Collaborative service system design for music content creation. Inf. Syst. Front. 16(2), 291–302 (2014)

    Article  Google Scholar 

  30. Xiao, Q., Dai, J., Luo, J., Fujita, H.: Multi-view manifold regularized learning-based method for prioritizing candidate disease mirnas. Knowl. Based Syst. 175, 118–129 (2019)

    Article  Google Scholar 

  31. Ying, F.T., Tao, Y., Wang, G.Y., Wang, Q.: Visiblesound: perceiving environmental sound with 4d form. Adv. Mater. Res. 718, 1777–1781 (2013)

    Article  Google Scholar 

  32. Zhang, C., Bi, J., Xu, S., Ramentol, E., Fan, G., Qiao, B., Fujita, H.: Multi-imbalance: an open-source software for multi-class imbalance learning. Knowl. Based Syst. 174, 137–143 (2019)

    Article  Google Scholar 

Download references

Acknowledgements

This work was partially funded by the University of Salamanca and the Society of Spanish Researchers in the United Kingdom (SRUK/CERU) under the Mobility Program SRUK/CERU “On the Move”.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to María Navarro-Cáceres.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Navarro-Cáceres, M., Castellanos-Garzón, J.A. & Bajo, J. An Intelligent System to Generate Chord Progressions from Colors with an Artificial Immune System. New Gener. Comput. 38, 531–549 (2020). https://doi.org/10.1007/s00354-020-00100-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00354-020-00100-4

Keywords

Navigation