Abstract
We present the implementation of two different sonifications methods of ancillary gestures from clarinetists. The sonifications are data driven from the clarinetist’s posture which is captured with a VICON motion tracking system. The first sonification method is based on the velocities of the tracking markers, the second method involves a principal component analysis as a data preprocessing step. Further we develop a simple complementary visual display with a similar information content to match the sonification. The effect of the two sonifications with respect to the movement perception is studied in an experiment where test subjects annotate the clarinetists performance represented by various combinations of the resulting uni- and multimodal displays.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Cadoz, C., Wanderley, M.M.: Gesture - Music. In: Wanderley, M.M., Battier, M. (eds.) Trends in Gestural Control of Music. Ircam – Centre Pompidou (2000)
Wanderley, M.M., Vines, B.W., Middleton, N., McKay, C., Hatch, W.: The musical significance of clarinetists’ ancillary gestures: an exploration of the field. Journal of New Music Research 34(1), 97–113 (2005)
Wanderley, M.M.: Quantitative analysis of non-obvious performer gestures. In: Gesture and Sign Language in Human-Computer Interaction, pp. 241–253 (2002)
Hermann, T., Höner, O., Ritter, H.: Acoumotion - an interactive sonification system for acoustic motion control. In: Gibet, S., Courty, N., Kamp, J.-F. (eds.) GW 2005. LNCS (LNAI), vol. 3881, pp. 312–323. Springer, Heidelberg (2006)
Nusseck, M., Wanderley, M.M.: Music and motion—how music related ancillary body movements contribute to the experience of music. Music Perception 26(4) (2009)
Verfaille, V., Quek, O., Wanderley, M.M.: Sonification of musicians’ ancillary gestures. In: Proceedings of the 12th International Conference on Auditory Display, London, UK, June 20 -23 (2006)
Savard, A.: When gestures are perceived through sounds: A framework for sonification of musicians’ ancillary gestures. Master’s thesis, IDMIL CIRRMT McGill University (August 2008)
Effenberg, A.O.: Movement sonification: Effects on perception and action. IEEE Multim. 12(2), 56–69 (2005)
Goina, P., Polotti, M.: Elementary gestalts for gesture sonification. In: NIME 2008, pp. 150–153 (2009)
Ferrari, A., Benedetti, M.G., Pavan, E., Frigo, C., Bettinelli, D., Rabuffetti, M., Crenna, P., Leardini, A.: Quantitative comparison of five current protocols in gait analysis. GAIT POSTURE (2008)
de Campo, A.: Toward a data soni cation design space map. In: Scavone, G.P. (ed.) ICAD 2007, Schulich School of Music, McGill University, Schulich School of Music, McGill University, Montreal, Canada, pp. 342–347 (2007), http://www.icad.org/Proceedings/2007/deCampo2007.pdf
Hermann, T.: PythonSC, http://www.sonification.de/projects/sc3
Chion, M.: Un art sonore, le cinéma, le phrasé audio visuelle. Cahiers du cinéma, pp. 541–561 (2003)
Flückiger, B.: Sound Design Die virtuelle Klangwelt des Films. Schüren, Marburg (2001)
Schmidt, F.P.: Design and implementation of a realtime 3d graphics server. Master’s thesis, Bielefeld University, Germany (April 2007)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Grond, F., Hermann, T., Verfaille, V., Wanderley, M.M. (2010). Methods for Effective Sonification of Clarinetists’ Ancillary Gestures. In: Kopp, S., Wachsmuth, I. (eds) Gesture in Embodied Communication and Human-Computer Interaction. GW 2009. Lecture Notes in Computer Science(), vol 5934. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-12553-9_15
Download citation
DOI: https://doi.org/10.1007/978-3-642-12553-9_15
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-12552-2
Online ISBN: 978-3-642-12553-9
eBook Packages: Computer ScienceComputer Science (R0)