skip to main content
10.1145/3170427.3177771acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
abstract

REVIVE: An Audio-visual Performance with Musical and Visual AI Agents

Published:20 April 2018Publication History

ABSTRACT

REVIVE explores the affordances of live interaction between the artificial musical agent MASOM, human electronic musicians, and visual generation agents. The Musical Agent based on Self-Organizing Maps (MASOM) has memorized sound objects and learned how to temporally structure them by listening to large corpora of human-made music. MASOM is then able to improvise live interacting with the other (human) performers by imitating the style of what it reminds it of. For each musician, a corresponding visual agent puts its sound and musical decision into images thus allowing the audience to see who does what. This reveals the musical gestures that are so often lost in electronic music performance. For CHI, MASOM plays with two live performers for a 20 minute audiovisual REVIVE experience.

References

  1. Arne Eigenfeldt and Philippe Pasquier. 2010. Real-Time Timbral Organisation: Selecting samples based upon similarity. Organised Sound 15, 02 (Aug. 2010), 159--166. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Teuvo Kohonen. 1982. Self-organized formation of topologically correct feature maps. Biological cybernetics 43, 1 (1982), 59--69. http: //link.springer.com/article/10.1007/BF00337288Google ScholarGoogle Scholar
  3. Teuvo Kohonen. 1998. The self-organizing map. Neurocomputing 21, 1--3 (1998), 1--6.Google ScholarGoogle ScholarCross RefCross Ref
  4. Philippe Pasquier, Arne Eigenfeldt, Oliver Bown, and Shlomo Dubnov. 2017. An Introduction to Musical Metacreation. Computers in Entertainment 14, 2 (Jan. 2017), 1--14. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Ash Tanasiychuk. 2016. A Conversation with Artificial Intelligence | VANDOCUMENT. (2016). http://vandocument.com/2016/11/ a-conversation-with-artificial-intelligence/Google ScholarGoogle Scholar
  6. Kıvanç Tatar and Philippe Pasquier. 2017a. MASOM: A Musical Agent Architecture based on Self Organizing Maps, Affective Computing, and Variable Markov Models. In Proceedings of the 5th International Workshop on Musical Metacreation (MUME 2017). Atlanta, Georgia, USA.Google ScholarGoogle Scholar
  7. Kıvanç Tatar and Philippe Pasquier. 2017b. MASOM: Musical Agent based on Self-Organizing Maps. (2017). http://metacreation.net/masom/Google ScholarGoogle Scholar

Index Terms

  1. REVIVE: An Audio-visual Performance with Musical and Visual AI Agents

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Conferences
        CHI EA '18: Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems
        April 2018
        3155 pages
        ISBN:9781450356213
        DOI:10.1145/3170427

        Copyright © 2018 Owner/Author

        Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 20 April 2018

        Check for updates

        Qualifiers

        • abstract

        Acceptance Rates

        CHI EA '18 Paper Acceptance Rate1,208of3,955submissions,31%Overall Acceptance Rate6,164of23,696submissions,26%

        Upcoming Conference

        CHI '24
        CHI Conference on Human Factors in Computing Systems
        May 11 - 16, 2024
        Honolulu , HI , USA

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader