Abstract
The automatic generation of music is an emerging field of research that has attracted wide attention in Computer Science. However, most works are centered in classical music. This work develops ETHNO-MUSIC, an intelligent system that generates melodies based on popular music. ETHNO-MUSIC generates melodies with Markov models, which learns from a corpus of Spanish popular music. Then, given the importance of the lyrics in this context, ETHNO-MUSIC was integrated with Tra-La-Lyrics, an existing system that generates lyrics following a melody, which has been specifically adapted to suit this purpose. Several experiments were carried out to evaluate the quality of the results, based on human opinions towards generated pieces of music and lyrics. Overall, results are positive. Briefly, they reflect that, on the one hand, the melodies transmit a feeling of Spanish popular music, and on the other hand, the text of the lyrics is related to the topics analyzed, and the rhythm follows the melodic aspects of the music.
Similar content being viewed by others
Notes
Using, e.g., a UNIX binary such as midi2abc.
References
Abe C, Ito A (2012) A Japanese lyrics writing support system for amateur songwriters. In: Proceedings of 4th Asia-Pacific signal and information processing association annual summit and conference, Hollywood, CA, USA, APSIPA 2012
Ackerman M, Loker D (2017) Algorithmic songwriting with ALYSIA. In: Computational intelligence in music, sound, art and design - 6th international conference, EvoMUSART 2017, Amsterdam, The Netherlands, April 19-21, 2017, Proceedings, pp 1–16, https://doi.org/10.1007/978-3-319-55750-2_1
Ajoodha R, Klein R, Jakovljevic M (2015) Using statistical models and evolutionary algorithms in algorithmic music composition, 3rd edn. Encyclopedia of Information Science and Technology. IGI Global, Pennsylvania, pp 6050–6062
Anton TL, Trausan-Matu S (2018) Byzantine music composition using markov models. In: 15th international conference on human computer interaction, RoCHI 2018, Cluj-Napoca, Romania, September 3–4, 2018. Matrix Rom, pp 71–75
Bao H, Huang S, Wei F, Cui L, Wu Y, Tan C, Piao S, Zhou M (2019) Neural melody composition from lyrics. CCF international conference on natural language processing and chinese computing, Springer, LNCS 11838:499–511
Barbieri G, Pachet F, Roy P, Esposti MD (2012) Markov constraints for generating lyrics with style. In: Proceedings of 20th European conference on artificial intelligence, IOS Press, Montpellier, France, ECAI 2012, pp 115–120
Berenson M, Levine D, Szabat KA, Krehbiel TC (2012) Basic business statistics: concepts and applications. Pearson higher education AU
Cambouropoulos E (2001) The local boundary detection model (lbdm) and its application in the study of expressive timing. In: Proceedings of the 2001 international computer music conference, ICMC 2001, Havana, Cuba, September 17–22, 2001. Michigan Publishing
Collins T, Laney R, Willis A, Garthwaite PH (2016) Developing and evaluating computational models of musical style. Artif Intell Eng Des Anal Manuf 30(1):16–43
Colton S, Wiggins GA (2012) Computational creativity: The final frontier? Front Artif Intell Appl 242:21–26. https://doi.org/10.3233/978-1-61499-098-7-21
Colton S, Halskov J, Ventura D, Gouldstone I, Cook M, Perez-Ferrer B (2015) The Painting Fool sees! new projects with the automated painter. In: Proceedings of the 6th international conference on computational creativity, pp 189–196
Concepción E, Gervás P, Méndez G (2018) Afanasyev: a collaborative architectural model for automatic story generation. In: Proceedings of the 5th AISB symposium on computational creativity, University of Liverpool, UK
Delgado M, Fajardo W, Molina-Solana M (2009) Inmamusys: intelligent multiagent music system. Exp Syst Appl 36(3):4574–4580
Gonçalo Oliveira H (2015) Tra-la-lyrics 2.0: automatic generation of song lyrics on a semantic domain. J Artif Gen Intell 6(1):87–110 (Special Issue: Computational creativity, concept invention, and general intelligence)
Gonçalo Oliveira H (2017) A survey on intelligent poetry generation: languages, features, techniques, reutilisation and evaluation. In: Proceedings of 10th international conference on natural language generation, ACL Press, Santiago de Compostela, Spain, INLG 2017, pp 11–20, http://www.aclweb.org/anthology/W17-3502
Gonçalo Oliveira HR, Cardoso FA, Pereira FC (2007) Tra-la-Lyrics: an approach to generate text based on rhythm. In: Proceedings of the 4th international joint workshop on computational creativity, IJWCC 2007, London, UK, pp 47–55
Gonçalo Oliveira H, Hervás R, Díaz A, Gervás P (2017) Multilingual extension and evaluation of a poetry generator. Nat Lang Eng 23(6):929–967. https://doi.org/10.1017/S1351324917000171
Gonçalo Oliveira H, Mendes T, Boavida A, Nakamura A, Ackerman M (2019) Co-PoeTryMe: interactive poetry generation. Cogn Syst Res 54:199–216. https://doi.org/10.1016/j.cogsys.2018.11.012
Gonzalez-Agirre A, Laparra E, Rigau G (2012) Multilingual Central Repository version 3.0. In: Proceedings of the 8th international conference on language resources and evaluation, ELRA, pp 2525–9
Herremans D, Sörensen K (2013) Composing fifth species counterpoint music with a variable neighborhood search algorithm. Exp Syst Appl 40(16):6427–6437
Jhamtani H, Mehta SV, Carbonell J, Berg-Kirkpatrick T (2019) Learning rhyming constraints using structured adversaries. In: Proceedings of the 2019 conference on empirical methods in natural language processing and the 9th international joint conference on natural language processing (EMNLP-IJCNLP), association for computational linguistics, Hong Kong, China, pp 6027–6033, https://doi.org/10.18653/v1/D19-1621, https://www.aclweb.org/anthology/D19-1621
Jungleib S (1996) General Midi. AR Editions, Inc, Middleton
Kuo PH, Li THS, Ho YF, Lin CJ (2015) Development of an automatic emotional music accompaniment system by fuzzy logic and adaptive partition evolutionary genetic algorithm. IEEE Access 3:815–824
Lamb C, Brown DG, Clarke CL (2017) A taxonomy of generative poetry techniques. J Math Arts 11(3):159–179. https://doi.org/10.1080/17513472.2017.1373561
León C, Gervás P (2014) Creativity in story generation from the ground up: nondeterministic simulation driven by narrative. In: 5th international conference on computational creativity, ICCC
Lerdahl F, Jackendoff R (1983) A generative theory of tonal music. The MIT Press, Cambridge
López-Ortega O, López-Popa SI (2012) Fractals, fuzzy logic and expert systems to assist in the construction of musical pieces. Exp Syst Appl 39(15):11911–11923
Machado P, Cardoso A (2002) All the truth about NEvAr. Appl Intell 16(2):101–119
Manzano M (1990) El folklore musical en españa, hoy. Boletín Informativo de la Fundación Juan March 204:3–18
Manzano Alonso M (2001) Cancionero popular de burgos. Diputacion de Burgos
Monteith K, Martinez TR, Ventura D (2012) Automatic generation of melodic accompaniments for lyrics. In: Proceedings of the 3rd international conference on computational creativity, Dublin, Ireland, May 30 - June 1, 2012., ICCC 2012, pp 87–94
Ontanón S, Arcos JL, Puyol-Gruart J, Carasusán E, Giribet D, de la Cruz D, Brito I, del Toro CL (2012) Gena: a case-based approach to the generation of audio-visual narratives. In: International conference on case-based reasoning, Springer, pp 297–311
Pachet F, Roy P (2011) Markov constraints: steerable generation of Markov sequences. Constraints 16(2):148–172
Papadopoulos A, Roy P, Pachet F (2016) Assisted lead sheet composition using flowComposer. In: International conference on principles and practice of constraint programming, Springer, pp 769–785
Pearce MT, Wiggins GA (2007) Evaluating cognitive models of musical composition. In: Proceedings of the 4th international joint workshop on computational creativity, Goldsmiths, University of London, pp 73–80
Pearce M, Meredith D, Wiggins G (2002) Motivations and methodologies for automation of the compositional process. Musicae Scientiae 6(2):119–147
Pérez y Pérez R (2015) A computer-based model for collaborative narrative generation. Cogn Syst Res 36:30–48
Project GM (2018) Google magenta project. https://magenta.tensorflow.org/, Accessed 30 Nov 2018
Ramakrishnan A A, Devi SL (2010) An alternate approach towards meaningful lyric generation in tamil. In: Proceedings of NAACL HLT 2010 2nd workshop on computational approaches to linguistic creativity, ACL Press, Los Angeles, CA, USA, CALC ’10, pp 31–39, http://dl.acm.org/citation.cfm?id=1860649.1860654
Schindler K (1991) Música y poesía popular de España y Portugal. Centro de Cultura Tradicional
Scirea M, Togelius J, Eklund P, Risi S (2016) Metacompose: a compositional evolutionary music composer. In: International conference on evolutionary and biologically inspired music and art, Springer, pp 202–217
Serrà J, Arcos JL (2016) Particle swarm optimization for time series motif discovery. Knowl Based Syst 92:127–137
Singh D, Ackerman M, y Pérez RP (2017) A ballad of the mexicas: automated lyrical narrative writing. In: Proceedings of the 8th international conference on computational creativity, ICCC 2017, pp 229–236
Son SH, Lee HY, Nam GH, Kang SS (2019) Korean song-lyrics generation by deep learning. In: Proceedings of the 2019 4th international conference on intelligent information technology, ACM, New York, NY, USA, ICIIT ’19, pp 96–100, https://doi.org/10.1145/3321454.3321470,
Speer R, Chin J, Havasi C (2017) Conceptnet 5.5: An open multilingual graph of general knowledge. In: Proceedings of 31st AAAI conference on artificial intelligence, San Francisco, California, USA, pp 4444–4451
Toivanen JM, Toivonen H, Valitutti A (2013) Automatical composition of lyrical songs. In: Proceedings of 4th international conference on computational creativity, The University of Sydney, Sydney, Australia, ICCC 2013, pp 87–91, http://www.computationalcreativity.net/iccc2013/download/iccc2013-toivanen-toivonen-valitutti.pdf
Watanabe K, Matsubayashi Y, Inui K, Nakano T, Fukayama S, Goto M (2017) LyriSys: an interactive support system for writing lyrics based on topic transition. In: Proceedings of the 22nd international conference on intelligent user interfaces, ACM, New York, NY, USA, IUI ’17, pp 559–563, https://doi.org/10.1145/3025171.3025194
Watanabe K, Matsubayashi Y, Fukayama S, Goto M, Inui K, Nakano T (2018) A melody-conditioned lyrics language model. In: Proceedings of the 2018 conference of the North American chapter of the association for computational Linguistics: human language technologies, Volume 1 (Long Papers), ACL Press, pp 163–172, https://doi.org/10.18653/v1/N18-1015, http://aclweb.org/anthology/N18-1015
Whorley RP, Conklin D (2016) Music generation from statistical models of harmony. J New Music Res 45(2):160–183
Whorley RP, Wiggins GA, Rhodes C, Pearce MT (2013) Multiple viewpoint systems: time complexity and the construction of domains for complex musical viewpoints in the harmonization problem. J New Music Res 42(3):237–266
Williams D, Hodge V, Gega L, Murphy D, Cowling P, Drachen A (2019) Ai and automatic music generation for mindfulness. In: Audio engineering society conference: 2019 AES international conference on immersive and interactive audio, audio engineering society
Zhu H, Liu Q, Yuan NJ, Qin C, Li J, Zhang K, Zhou G, Wei F, Xu Y, Chen E (2018) Xiaoice band: A melody and arrangement generation framework for pop music. In: Proceedings of the 24th ACM SIGKDD international conference on knowledge discovery & data mining, ACM, pp 2837–2846
Znidarsic M, Cardoso A, Gervás P, Martins P, Hervás R, Alves AO, Gonçalo Oliveira H, Xiao P, Linkola S, Toivonen H, Kranjc J, Lavrac N (2016) Computational creativity infrastructure for online software composition: a conceptual blending use case. In: Proceedings of the 7th international conference on computational creativity, ICCC 2016, pp 371–379
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Navarro-Cáceres, M., Oliveira, H.G., Martins, P. et al. Integration of a music generator and a song lyrics generator to create Spanish popular songs. J Ambient Intell Human Comput 11, 4421–4437 (2020). https://doi.org/10.1007/s12652-020-01822-5
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12652-020-01822-5