ABSTRACT
The paper presents our approach for human-machine interaction with an anthropomorphic mechanical percussionist that can listen to live players, analyze perceptual musical aspects in real-time, and use the product of this analysis to play along in a collaborative manner. Our robot, named Haile, is designed to combine the benefits of computational power, perceptual modeling, and algorithmic music with the richness, visual interactivity, and expression of acoustic playing. We believe that when interacting with live players, Haile can facilitate a musical experience that is not possible by any other means, inspiring users to collaborate with it in novel and expressive manners. Haile can, therefore, serve a test-bed for novel forms of musical human-machine interaction, bringing perceptual aspects of computer music into the physical world both visually and acoustically.
- Cope, D. Experiments in Music Intelligence. A-R Editions, Madison, WI, 1996.Google Scholar
- Cycling74 - Max/MSP http://www.cycling74.com Accessed 2005.Google Scholar
- Dannenberg, R. An On-line Algorithm for Real-Time Accompaniment. Proceedings of the 1984 International Computer Music Conference. Paris, France.Google Scholar
- Desain, P. and Honing, H.J. Rhythmic stability as explanation of category size. Proceedings of the 2002 of the International Conference on Music Perception and Cognition Sydney CD-Rom.Google Scholar
- Foote, J. and Uchihashi, S. The Beat Spectrum: a new approach to rhythmic analysis. Proceedings of the 2001 International Conference on Multimedia and Expo.Google Scholar
- Jordà, S. Afasia: The Ultimate Homeric One-man multimedia- band. Proceedings of the 2002 Conference on New Interfaces for Musical Expression, Dublin, Ireland, (2002). Google ScholarDigital Library
- Lewis, G. Too Many Notes: Computers, Complexity and Culture in Voyager," Leonardo Music Journal 10 (2000) 33--39.Google ScholarCross Ref
- Makingthings - Teleo system http://www.makingthings.comGoogle Scholar
- Pachet, F. The continuator: Musical interaction with style. Proceedings International Computer Music Conference, (2002) Goteborg, Sweden.Google Scholar
- Paulus, J. and Kalpuri, A. Measuring the Similarity of Rhythmic Patterns. Proceedings of the 2002 International Conference on Music Information Retrieval. Paris, France.Google Scholar
- Puckette, M. Real-time Audio Analysis Tools for Pd and MSP. Proceedings of the 1998 International Computer Music Conference. Cologne, Germany.Google Scholar
- Rae, G. W. Robotic Instruments. http://logosfoundation.org/instrum_gwr/automatons.htmlGoogle Scholar
- Rowe, R. Machine Musicianship. MIT press, 2004. Google ScholarDigital Library
- Scheirer, E. 1998. Tempo and beat analysis of acoustic musical signals. Journal of the Acoustical Society of America, 103:1 588--601.Google Scholar
- Singer, E., Feddersen, J., Redmon, C. and Bowen B. LEMUR's Musical Robots. Proceedings of the Conference on New Interfaces for Musical Expression, Hamamatsu, Japan, (2004), pp.181--184. Google ScholarDigital Library
- Sony QRIO conductor Robot. http://www.sony.net/sonyInfo/QRIO/works/20040325e.htmlGoogle Scholar
- Takanishi, A. Development of Anthropomorphic Flutist Robot WF-3RIV. Proceedings of International Computer Music Conference, Ann Arbor, Michigan, (1998) 328--331.Google Scholar
- Tanguiane, A. Artificial Perception and Music Recognition. New York Springer-Verlag. 1993. Google ScholarDigital Library
- Toyota Trumpet Robot. http://www.toyota.co.jp/ en/special/robotGoogle Scholar
- Weinberg G., Orth M., and Russo P. ""The Embroidered Musical Ball: A Squeezable Instrument for Expressive Performance," Proceeding of Computer Human Interaction Conference. (CHI 2000) The Hague. Google ScholarDigital Library
- Weinberg, G. Interconnected Musical Networks - Toward a Theoretical Framework. Computer Music Journal 29, 2 Cambridge MA: MIT Press (2005) 23--39. Google ScholarDigital Library
- Weinberg G., Driscoll S., Parry M. Musical Interactions with a Perceptual Robotic Percussionist. Proceedings of IEEE International Workshop on Robot and Human Interactive Communication. Nashville, TN (2005).Google ScholarCross Ref
- Winkler, T. 2001. Composing Interactive Music: Techniques and Ideas Using Max. Cambridge, MA MIT Press. Google ScholarDigital Library
Index Terms
Robot-human interaction with an anthropomorphic percussionist
Recommendations
Shimon: an interactive improvisational robotic marimba player
CHI EA '10: CHI '10 Extended Abstracts on Human Factors in Computing SystemsShimon is an autonomous marimba-playing robot designed to create interactions with human players that lead to novel musical outcomes. The robot combines music perception, interaction, and improvisation with the capacity to produce melodic and harmonic ...
Musical-based interaction system for the Waseda Flutist Robot
Since 1990, at Waseda University the development on the Anthropomorphic Flutist Robot has been focused on mechanically reproducing the physiology of the organs involved during the flute playing (i.e. lungs, lips, etc.) and implementing basic cognitive ...
The interactive robotic percussionist: new developments in form, mechanics, perception and interaction design
HRI '07: Proceedings of the ACM/IEEE international conference on Human-robot interactionWe present new developments in the improvisational robotic percussionist project, aimed at improving human-robot interaction through design, mechanics, and perceptual modeling. Our robot, named Haile, listens to live human players, analyzes perceptual ...
Comments