Masataka Goto
ABSTRACT
Automatic music-understanding technologies (automatic analysis of music signals) make possible the creation of intelligent music interfaces that enrich music experiences and open up new ways of listening to music. In the past, it was common to listen to music in a somewhat passive manner; in the future, people will be able to enjoy music in a more active manner by using music technologies. Listening to music through active interactions is called active music listening. In this keynote speech I first introduce active music listening interfaces demonstrating how end users can benefit from music-understanding technologies based on signal processing and/or machine learning. By analyzing the music structure (chorus sections), for example, the SmartMusicKIOSK interface enables people to access their favorite part of a song directly (skipping other parts) while viewing a visual representation of the song's structure. I then introduce our recent challenge of deploying such research-level music interfaces as web services open to the public. Those services augment people's understanding of music, enable music-synchronized control of computer-graphics animation and robots, and provide various bird's-eye views on a large music collection. In the future, further advances in music-understanding technologies and music interfaces based on them will make interaction between people and music even more active and enriching.
- Masataka Goto: Active Music Listening Interfaces Based on Signal Processing, Proceedings of the 2007 IEEE International Conference on Acoustics, Speech, and Signal Processing (IEEE ICASSP 2007), pp.IV-1441--1444, April 2007.Google Scholar
Cross Ref
- Masataka Goto: A Real-time Music-scene-description System: Predominant-F0 Estimation for Detecting Melody and Bass Lines in Real-world Audio Signals, Speech Communication (ISCA Journal), Vol.43, No.4, pp.311--329, September 2004.Google ScholarCross Ref
- Masataka Goto: A Chorus-Section Detection Method for Musical Audio Signals and Its Application to a Music Listening Station, IEEE Transactions on Audio, Speech, and Language Processing, Vol.14, No.5, pp.1783--1794, September 2006. Google ScholarDigital Library
- Masataka Goto, Kazuyoshi Yoshii, Hiromasa Fujihara, Matthias Mauch, and Tomoyasu Nakano: Songle: A Web Service for Active Music Listening Improved by User Contributions, Proceedings of the 12th International Society for Music Information Retrieval Conference (ISMIR 2011), pp.311--316, October 2011.Google Scholar
- Masataka Goto, Kazuyoshi Yoshii, and Tomoyasu Nakano: Songle Widget: Making Animation and Physical Devices Synchronized with Music Videos on the Web, Proceedings of the IEEE International Symposium on Multimedia (IEEE ISM 2015), pp.85--88, December 2015.Google ScholarCross Ref
- Masahiro Hamasaki, Masataka Goto, and Tomoyasu Nakano: Songrium: A Music Browsing Assistance Service with Interactive Visualization and Exploration of a Web of Music, Proceedings of the 23rd International World Wide Web Conference (WWW 2014), pp.523--528, April 2014. Google ScholarDigital Library
- Masataka Goto: Frontiers of Music Information Research Based on Signal Processing, Proceedings of the 12th IEEE International Conference on Signal Processing (IEEE ICSP 2014), pp.7--14, October 2014.Google ScholarCross Ref
Index Terms
- Intelligent Music Interfaces
Recommendations
Intelligent music interfaces for listening and creation
IUI '19 Companion: Companion Proceedings of the 24th International Conference on Intelligent User InterfacesDigital music technology plays a central role in all areas of the music ecosystem. For both, music consumers and music producers, intelligent user interfaces are a means to improve access to sound and music. The second workshop on Intelligent Music ...
MOMOS-MT: mobile monophonic system for music transcription: sheet music generation on mobile devices
SAC '17: Proceedings of the Symposium on Applied ComputingMusic holds a significant cultural role in social identity and in the encouragement of socialization. Technology, by the destruction of physical and cultural distance, has lead to many changes in musical themes and the complete loss of forms. Yet, it ...
A chorus section detection method for musical audio signals and its application to a music listening station
This paper describes a method for obtaining a list of repeated chorus ("hook") sections in compact-disc recordings of popular music. The detection of chorus sections is essential for the computational modeling of music understanding and is useful in ...
Comments