skip to main content
10.1145/3123266.3123967acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
abstract

Who Composes the Music?: Musicality Evaluation for Algorithmic Composition via Electroencephalography

Published:19 October 2017Publication History

ABSTRACT

It is very challenging to evaluate the creative work of artificial intelligence, such as algorithmic composition. Due to the nature of creativity, most existing criteria of music analysis, for example, similarity of the data, cannot be used directly to measure the quality of a new piece of music composed by computer. Subjective evaluation based on questionnaire lacks quantitative evaluation with solid evidence. To address these difficulties, this paper proposes a novel computational model combined with a novel psychological paradigm. Utilizing brain imaging techniques, the proposed evaluation method can provide reliable musicality score for machine-composed music.

References

  1. Eckart O Altenmüller. 2001. How many music centers are in the brain? Annals of the New York Academy of Sciences Vol. 930, 1 (2001), 273--280.Google ScholarGoogle ScholarCross RefCross Ref
  2. Eckart O Altenmüller, Kristian Schürmann, Vanessa K Lim, and Dietrich Parlitz. 2002. Hits to the left, flops to the right: different emotions during listening to music are reflected in cortical lateralisation patterns. Neuropsychologia, Vol. 40, 13 (2002), 2242--2256.Google ScholarGoogle ScholarCross RefCross Ref
  3. Paulo Estév ao Andrade and Joydeep Bhattacharya. 2003. Brain tuned to music. Journal of the Royal Society of Medicine Vol. 96, 6 (2003), 284--287.Google ScholarGoogle ScholarCross RefCross Ref
  4. Marc Bangert and Eckart O Altenmüller. 2003. Mapping perception to action in piano practice: a longitudinal DC-EEG study. BMC neuroscience, Vol. 4, 1 (2003), 26.Google ScholarGoogle Scholar
  5. Thomas G Bever and Robert J Chiarello. 1974. Cerebral dominance in musicians and nonmusicians. Science, Vol. 185, 4150 (1974), 537--539.Google ScholarGoogle Scholar
  6. Joydeep Bhattacharya and Hellmuth Petsche. 2001. Universality in the brain while listening to music. Proceedings of the Royal Society of London B: Biological Sciences, Vol. 268, 1484 (2001), 2423--2433.Google ScholarGoogle ScholarCross RefCross Ref
  7. Joydeep Bhattacharya, Hellmuth Petsche, and Ernesto Pereda. 2001. Long-range synchrony in the γ band: role in music perception. Journal of Neuroscience Vol. 21, 16 (2001) 6329--6337.Google ScholarGoogle ScholarCross RefCross Ref
  8. Zhijie Bian, Qiuli Li, Lei Wang, Chengbiao Lu, Shimin Yin, and Xiaoli Li. 2014. Relative power and coherence of EEG series are related to amnestic mild cognitive impairment in diabetes. Frontiers in aging neuroscience Vol. 6 (2014), 11.Google ScholarGoogle Scholar
  9. Hang Chu, Raquel Urtasun, and Sanja Fidler. 2017. Song From PI: A Musically Plausible Network for Pop Music Generation workshop on International Conference on Learning Representations, 2017. ICLR workshop 2017.Google ScholarGoogle Scholar
  10. Darrell Conklin. 2016. Chord sequence generation with semiotic patterns. Journal of Mathematics and Music Vol. 10, 2 (2016), 92--106.Google ScholarGoogle ScholarCross RefCross Ref
  11. David Cope. 1987. Experiments in Musical Intelligence. http://artsites.ucsc.edu/faculty/cope/experiments.htm. (1987).Google ScholarGoogle Scholar
  12. David Cope. 1992. Computer modeling of musical intelligence in EMI. Computer Music Journal Vol. 16, 2 (1992), 69--83.Google ScholarGoogle ScholarCross RefCross Ref
  13. Cheryl L Dickter and Paul D Kieffaber. 2013. EEG methods for the psychological sciences. Sage.Google ScholarGoogle Scholar
  14. Isabelle Guyon and André Elisseeff. 2003. An introduction to variable and feature selection. Journal of Machine Learning Research Vol. 3, Mar (2003), 1157--1182. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Norbert Jauvsovec and Katarina Habe. 2003. The "Mozart effect": an electroencephalographic analysis employing the methods of induced event-related desynchronization/synchronization and event-related coherence. Brain Topography, Vol. 16, 2 (2003), 73--84.Google ScholarGoogle ScholarCross RefCross Ref
  16. Stefan Lattner, Maarten Grachten, and Gerhard Widmer. 2016. Imposing higher-level Structure in Polyphonic Music Generation using Convolutional Restricted Boltzmann Machines and Constraints. arXiv preprint arXiv:1612.04742 (2016).Google ScholarGoogle Scholar
  17. Mu Li and Bao-Liang Lu. 2009. Emotion classification based on gamma-band EEG. In Engineering in Medicine and Biology Society, 2009. EMBC 2009. Annual International Conference of the IEEE. IEEE, 1223--1226.Google ScholarGoogle Scholar
  18. Yuan-Pin Lin, Chi-Hong Wang, Tzyy-Ping Jung, Tien-Lin Wu, Shyh-Kang Jeng, Jeng-Ren Duann, and Jyh-Horng Chen. 2010. EEG-based emotion recognition in music listening. IEEE Transactions on Biomedical Engineering, Vol. 57, 7 (2010), 1798--1806.Google ScholarGoogle ScholarCross RefCross Ref
  19. Sidi Liu, Jinglei Lv, Yimin Hou, Ting Shoemaker, Qinglin Dong, Kaiming Li, and Tianming Liu. 2016. What Makes a Good Movie Trailer?: Interpretation from Simultaneous EEG and Eyetracker Recording Proceedings of the 24th ACM international conference on Multimedia. ACM, 82--86. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Yang Liu, Yan Liu, Yu Zhao, and Kien A Hua. 2015. What strikes the strings of your heart?--Feature mining for music emotion analysis. IEEE Transactions on Affective Computing Vol. 6, 3 (2015), 247--260.Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. George A Miller. 1995. WordNet: a lexical database for English. Commun. ACM Vol. 38, 11 (1995), 39--41. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Eva Mohedano, Graham Healy, Kevin McGuinness, Xavier Giró-i Nieto, Noel E O'Connor, and Alan F Smeaton. 2014. Object segmentation in images using eeg signals. Proceedings of the 22nd ACM international conference on Multimedia. ACM, 417--426. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Seong-Eun Moon and Jong-Seok Lee. 2015. EEG Connectivity Analysis in Perception of Tone-mapped High Dynamic Range Videos Proceedings of the 23rd ACM international conference on Multimedia. ACM, 987--990. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Yuma Sasaka, Takahiro Ogawa, and Miki Haseyama. 2016. Multimodal Interest Level Estimation via Variational Bayesian Mixture of Robust CCA Proceedings of the 24th ACM international conference on Multimedia. ACM, 387--391. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Erwin-Josef Speckmann. 1993. Introduction of the neurophysiological basis of the EEG and DC potentials. Electroencephalography: Basic principles, clinical applications, and related fields (1993), 15--26.Google ScholarGoogle Scholar
  26. Sebastian Stober, Daniel J Cameron, and Jessica A Grahn. 2014. Using Convolutional Neural Networks to Recognize Rhythm Stimuli from Electroencephalography Recordings. In Advances in neural information processing systems. 1449--1457. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Sébastien Tremblay, William J MacKen, and Dylan M Jones. 2001. The impact of broadband noise on serial memory: Changes in band-pass frequency increase disruption. Memory, Vol. 9, 4--6 (2001), 323--331.Google ScholarGoogle ScholarCross RefCross Ref
  28. Andries Van Der Merwe and Walter Schulze. 2011. Music generation with Markov models. IEEE MultiMedia, Vol. 18, 3 (2011), 78--85. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Elliot Waite, Douglas Eck, Adam Roberts, and Dan Abolafia. 2016. Project Magenta. https://magenta.tensorflow.org/. (2016).Google ScholarGoogle Scholar
  30. John R Zhang, Jason Sherwin, Jacek Dmochowski, Paul Sajda, and John R Kender. 2014. Correlating Speaker Gestures in Political Debates with Audience Engagement Measured via EEG Proceedings of the 22nd ACM international conference on Multimedia. ACM, 387--396. Google ScholarGoogle ScholarDigital LibraryDigital Library
  1. Who Composes the Music?: Musicality Evaluation for Algorithmic Composition via Electroencephalography

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Conferences
        MM '17: Proceedings of the 25th ACM international conference on Multimedia
        October 2017
        2028 pages
        ISBN:9781450349062
        DOI:10.1145/3123266

        Copyright © 2017 Owner/Author

        Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 19 October 2017

        Check for updates

        Qualifiers

        • abstract

        Acceptance Rates

        MM '17 Paper Acceptance Rate189of684submissions,28%Overall Acceptance Rate995of4,171submissions,24%

        Upcoming Conference

        MM '24
        MM '24: The 32nd ACM International Conference on Multimedia
        October 28 - November 1, 2024
        Melbourne , VIC , Australia
      • Article Metrics

        • Downloads (Last 12 months)10
        • Downloads (Last 6 weeks)2

        Other Metrics

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader