Abstract
This paper presents the development of methods for gesture control of sound spatialization. It provides a comparison of seven popular software spatialization systems from a control point of view, and examines human-factors issues relevant to gesture control. An effort is made to reconcile these two design- and parameter-spaces, and draw useful conclusions regarding likely successful mapping strategies. Lastly, examples are given using several different gesture-tracking and motion capture systems controlling various parameters of the spatialization system.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Zvonar, R.: A history of spatial music (2006), http://cec.concordia.ca/econtact/Multichannel/spatial_music.html
Chadabe, J.: Electric Sound: The Past and Promise of Electronic Music. Prentice-Hall, Englewood Cliffs (1997)
Ramakrishnan, C., Goßmann, J., Brm̈mer, L.: The zkm klangdom. In: Proceedings of the 2006 Conference on New Interfaces for Musical Expression (2006)
Valbom, L., Marcos, A.: Wave: Sound and music in an immersive environment. Computers and Graphics 29, 871–881 (2005)
Naef, M., Collicott, D.: A vr interface for collaborative 3d audio performance. In: Proceedings of the 2006 International Conference on New Interfaces for Musical Expression (NIME 2006), pp. 57–60 (2006)
Wozniewski, M., Settel, Z., Cooperstock, J.: A system for immersive spatial audio performance. In: Proceedings of the 2006 Conference on New Interfaces for Musical Expression (2006)
Schacher, J.: Gesture control of sounds in 3d space. In: Proceedings of the 2007 Conference on New Interfaces for Musical Expression (NIME 2007), New York, USA, pp. 358–362 (2007)
Pulkki, V.: Spatial Sound Generation and Perception by Amplitude Panning Techniques. PhD thesis, Helsinki University of Technology (2001)
IRCAM: Spatializateur website, http://forumnet.ircam.fr/356.html
Braasch, J.: A loudspeaker based sound projection using virtual microphone control (vimic). In: 118th Convention of the AES, Barcelona, Spain (2005)
Spors, S., Teutsch, H., Rabenstein, R.: High-quality acoustic rendering with wave field synthesis. Vision, Modeling, and Visualization, 101–108 (2002)
Malham, D.: Spatial hearing mechanisms and sound reproduction. Technical report, Music Technology Group, University of York (1998)
Jacob, R.J.K., Sibert, L.E., McFarlane, D.C., Mullen, M.P.: Integrality and separability of input devices. ACM Transactions on Computer-Human Interaction 1(1), 3–26 (1994)
Cooper, G.: Research into cognitive load theory and instructional design at unsw (December 1998), http://education.arts.unsw.edu.au/staff/sweller/clt/index.html
Cook, P.: Principles for designing computer music controllers. In: ACM CHI 2001 Workshop on New Interfaces for Musical Expression (2001)
Marshall, M.T., Peters, N., Jensenius, A.R., Boissinot, J., Wanderley, M.M., Braasch, J.: On the development of a system for the gesture control of spatialization. In: Proceedings of the International Computer Music Conference, pp. 260–266 (2006)
Baecker, R., Grudin, J., Buxton, W., Greenberg, S.: Readings in Human-Computer Interaction: Toward the Year 2000., 2nd edn. Morgan Kaufmann, San Francisco (1995)
Cadoz, C., Wanderley, M.: Gesture - music. Trends in Gesture Control of Music (2000)
Marshall, M., Malloch, J., Wanderley, M.: Using the ’energy’ of performance gestures as a control for a spatialization system. Technical Report MUMT-IDMIL-07-08, Input Devices and Music Interaction Laboratory, McGill University (May 2007)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Marshall, M.T., Malloch, J., Wanderley, M.M. (2009). Gesture Control of Sound Spatialization for Live Musical Performance. In: Sales Dias, M., Gibet, S., Wanderley, M.M., Bastos, R. (eds) Gesture-Based Human-Computer Interaction and Simulation. GW 2007. Lecture Notes in Computer Science(), vol 5085. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-92865-2_25
Download citation
DOI: https://doi.org/10.1007/978-3-540-92865-2_25
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-92864-5
Online ISBN: 978-3-540-92865-2
eBook Packages: Computer ScienceComputer Science (R0)