Abstract
Synaesthesia is a neurological phenomenon in which stimulation of one sense triggers an involuntary experience in a secondary sense. This paper draws on this phenomenon to generate a system that creates music using colors as a synaesthete input. The system optimizes a function based on the Tonal Interval Space by applying the Particle Swarm Optimization algorithm to automatically generate a tonal melody. The final result is a musical line that is evaluated in terms of musical quality.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Agmon, E.: Functional harmony revisited: a prototype-theoretic approach. Music Theor. Spectr. 17(2), 196–214 (1995)
Bernardes, G., Cocharro, D., Caetano, M., Guedes, C., Davies, M.E.: A multi-level tonal interval space for modelling pitch relatedness and musical consonance. J. New Music Res. 45(4), 281–294 (2016)
Bernardes, G., Cocharro, D., Guedes, C., Davies, M.E.: Conchord: an application for generating musical harmony by navigating in a perceptually motivated tonal interval space. In: Proceedings of the 11th International Symposium on Computer Music Modeling and Retrieval (CMMR), pp. 71–86 (2015)
Casado-Vara, R., Corchado, J.M.: Blockchain for democratic voting: How blockchain could cast off voter fraud. Orient. J. Comp. Sci. Technol. 11(1) (2018)
Chamoso, P., Prieta Pintado, F.d.l.: Swarm-based smart city platform: A traffic application (2015)
Eigenfeldt, A., Thorogood, M., Bizzocchi, J., Pasquier, P.: Mediascape: towards a video, music, and sound metacreation. J. Sci. Technol. Arts 6(1), 61–73 (2014)
Faia, R., Pinto, T., Abrishambaf, O., Fernandes, F., Vale, Z., Corchado, J.M.: Case based reasoning with expert system and swarm intelligence to determine energy reduction in buildings energy management. Energ. Build. 155, 269–281 (2017)
Horn, B., Smith, G., Masri, R., Stone, J.: Visual information vases: towards a framework for transmedia creative inspiration. In: Proceedings of the Sixth International Conference on Computational Creativity, p. 182 (2015)
Jo, K., Nagano, N.: Monalisa: see the sound, hear the image. In: Proceedings of the 8th International Conference New Interface for Musical Expression, NIME, vol. 8, pp. 315–318 (2008)
Kennedy, J.: Particle swarm optimization. In: Encyclopedia of Machine Learning, pp. 760–766. Springer (2010)
Kruger, A.: Median-cut color quantization. Dr Dobb’s J. Softw. Tools Prof. Programmer 19(10), 46–55 (1994)
Krumhansl, C.L., Cuddy, L.L.: A theory of tonal hierarchies in music. In: Music perception, pp. 51–87. Springer (2010)
Navarro, M., Caetano, M., Bernardes, G., de Castro, L.N., Corchado, J.M.: Automatic generation of chord progressions with an artificial immune system. In: Evolutionary and Biologically Inspired Music, Sound, Art and Design, pp. 175–186. Springer (2015)
Poli, R.: An analysis of publications on particle swarm optimization applications. Department of Computer Science, University of Essex, Essex, UK (2007)
Ranjan, A., Gabora, L., OConnor, B.: The cross-domain re-interpretation of artistic ideas. In: Proceedings 35th Annual Meeting of the Cognitive Science Society, pp. 3251–3256 (2013)
Sanz, J.C.: Lenguaje Del Color: Sinestesia cromática en poesía y arte visual. H. Blume (2009)
Scirea, M., Nelson, M., Cheong, Y.G., Bae, B.C.: Mood expression in real-time computer generated music using pure data (2014)
Sysoev, I., Chitloor, R.D., Rajaram, A., Summerlin, R.S., Davis, N., Walker, B.N.: Middie mercury: an ambient music generator for relaxation. In: Proceedings of the 8th Audio Mostly Conference, p. 20. ACM (2013)
Unemi, T., Matsui, Y., Bisig, D.: Identity sa 1.6: an artistic software that produces a deformed audiovisual reflection based on a visually interactive swarm. In: Proceedings of the 2008 International Conference on Advances in Computer Entertainment Technology, pp. 297–300. ACM (2008)
Wu, X., Li, Z.N.: A study of image-based music composition. In: 2008 IEEE International Conference on Multimedia and Expo, pp. 1345–1348. IEEE (2008)
Acknowledgments
This work was supported by the Spanish Ministry, Ministerio de Economía y Competitividad and FEDER funds. Project. SURF: Intelligent System for integrated and sustainable management of urban fleets TIN2015-65515-C4-3-R.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer International Publishing AG, part of Springer Nature
About this paper
Cite this paper
Navarro-Cáceres, M., Martín-Gómez, L., Sittón-Candanedo, I., Rodríguez-González, S., Pérez-Lancho, B. (2019). Modeling a Synaesthete System to Generate a Tonal Melody from a Color Distribution. In: Graña, M., et al. International Joint Conference SOCO’18-CISIS’18-ICEUTE’18. SOCO’18-CISIS’18-ICEUTE’18 2018. Advances in Intelligent Systems and Computing, vol 771. Springer, Cham. https://doi.org/10.1007/978-3-319-94120-2_22
Download citation
DOI: https://doi.org/10.1007/978-3-319-94120-2_22
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-94119-6
Online ISBN: 978-3-319-94120-2
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)