Abstract
Music conducting is the art of directing musical ensembles with hand gestures to personalize and diversify a musical piece. The ability to successfully perform a musical piece demands intense training and coordination from the conductor, but preparing a practice session is an expensive and time-consuming task. Accordingly, there is a need for alternatives to provide adequate training to conductors at all skill levels; virtual reality technology holds promise for this application. The goal of this research was to study the mechanics of music conducting and develop a system capable of closely simulating the conducting experience. After extensive discussions with professional and nonprofessional conductors, as well as extensive research on music conducting material, we identified several key features of conducting. A set of lightweight algorithms exploring those features were developed to enable tempo control and instrument emphasis, two core components of conducting. By using position/orientation sensors and data gloves as the interface for human-computer interaction, we developed a functional version of the system. Evaluating the algorithms in real-world scenarios gave us promising results; most users of the final system expressed satisfaction with the virtual experience.
Chapter PDF
Similar content being viewed by others
References
Borchers, J., Lee, E., Nakra, T.M.: You’re the Conductor: a Realistic Interactive Conducting System for Children. In: NIME 2004, pp. 68–73 (2004)
Murphy, D., Andersen, T.H., Jensen, K.: Conducting Audio Files Via Computer Vision. In: Gesture Workshop, pp. 529–540 (2003)
Borchers, J., Lee, E., Samminger, W., Muhlhauser, M.: Personal Orchestra: a Real-Time Audio/Video System for Interactive Conducting. Multimedia Syst. 9(6), 594–594 (2004)
Lee, E., Grull, I., Kiel, H., Borchers, J.: CONGA: a Framework for Adaptive Conducting Gesture Analysis. In: NIME 2006, pp. 260–265 (2006)
Usa, S., Mochida, Y.: A Multi-Modal Conducting Simulator. Journal of Japan Society for Fuzzy Theory and Systems 10(4), 127–136 (1998)
Kolesnik, P.: Conducting Gesture Recognition System. Master Thesis, McGill University (2004)
Marrin, T., Picard, R.W.: The Conductor’s Jacket: A Device for Recording Expressive Musical Gestures. In: Proceedings of the International Computer Music Conference TR470 (1998)
Lee, E., Wolf, M., Borchers, J.: Improving Orchestral Conducting Systems in Public Spaces: Examining the Temporal Characteristics and Conceptual Models of Conducting Gestures. In: CHI 2005, pp. 731–740 (2005)
Morita, H., Hashimoto, S., Ohteru, S.: A Computer Music System that Follows a Human Conductor. Computer 24(7), 44–53 (1991)
Huber, P.: Robust Statistics. Wiley, New York (1981)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Argueta, C.R., Ko, CJ., Chen, YS. (2009). Interacting with a Music Conducting System. In: Jacko, J.A. (eds) Human-Computer Interaction. Novel Interaction Methods and Techniques. HCI 2009. Lecture Notes in Computer Science, vol 5611. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-02577-8_72
Download citation
DOI: https://doi.org/10.1007/978-3-642-02577-8_72
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-02576-1
Online ISBN: 978-3-642-02577-8
eBook Packages: Computer ScienceComputer Science (R0)