Welcome to the InfoSci Platform
Music Control in an Interactive Conducting System Using Kinect

Music Control in an Interactive Conducting System Using Kinect

Yi-Shin Chen, Leng-Wee Toh, Yi-Lan Liu
Copyright: © 2013 |Volume: 4 |Issue: 4 |Pages: 23
ISSN: 1947-8534|EISSN: 1947-8542|EISBN13: 9781466635005|DOI: 10.4018/ijmdem.2013100103
Cite Article Cite Article

MLA

Chen, Yi-Shin, et al. "Music Control in an Interactive Conducting System Using Kinect." IJMDEM vol.4, no.4 2013: pp.35-57. http://doi.org/10.4018/ijmdem.2013100103

APA

Chen, Y., Toh, L., & Liu, Y. (2013). Music Control in an Interactive Conducting System Using Kinect. International Journal of Multimedia Data Engineering and Management (IJMDEM), 4(4), 35-57. http://doi.org/10.4018/ijmdem.2013100103

Chicago

Chen, Yi-Shin, Leng-Wee Toh, and Yi-Lan Liu. "Music Control in an Interactive Conducting System Using Kinect," International Journal of Multimedia Data Engineering and Management (IJMDEM) 4, no.4: 35-57. http://doi.org/10.4018/ijmdem.2013100103

Export Reference

Mendeley
Favorite Full-Issue Download

Abstract

Music conducting is the art of directing musical ensembles with hand gestures to personalize and diversify a piece of music. Although the ability to successfully perform a musical piece demands intense training and coordination for the conductor and the orchestra, preparing a practice session is expensive and time-consuming. Hence, there is a genuine need for alternatives capable of providing adequate training for conductors at all skill levels. The potential use of virtual and augmented reality technology holds particular promise. The goal of this research is to examine the mechanics of music conducting and to develop a system capable of closely simulating the experience of conducting a piece of music. After extensive discussions with professional and nonprofessional conductors, in addition to wide-ranging research regarding music conducting materials, several key features of conducting were identified. A set of lightweight algorithms exploring these features was developed to enable tempo control, volume adjustment, and instrument emphasis, which are core components of conducting. Such a system would be a helpful training tool for students, an experiential tool allowing professional conductors and composers to shape music at a low cost, or an entertainment tool for nonprofessional music lovers. In this paper, we propose a real-time interactive conducting system using Microsoft Kinect. The proposed system overcomes the limitation of Kinect's design, which is generally designed for large body movements. In this system, delicate conducting signals can be correctly recognized without referencing any prior knowledge. Evaluation of the algorithms in real-world scenarios reveals promising results. The system was evaluated by conductors of all skill levels and provided a high level of accuracy and a low latency. Users of the final system expressed satisfaction with the virtual experience.

Request Access

You do not own this content. Please login to recommend this title to your institution's librarian or purchase it from the IGI Global bookstore.