Abstract
This paper presents an interactive multi-modal system for real-time multi-parametric gestural control of audio processing applications. We claim that this can ease the use / control of different tasks and for this we present the following as a demonstration: (1) A musical application, i.e. the multi-parametric control of digital audio effects, and (2) a scientific application, i.e. the interactive navigation of audifications. In the first application we discuss the use of PCA-based control axes and clustering to obtain dimensionality reduced control variables. In the second application we show how the tightly closed human-computer loop actively supports the detection and discovery of features in data under analysis.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Kirk, R., Hunt, A., Wanderley, M.: Towards a model for instrumental mapping in expert musical interaction. In: Proceedings of the 2000 International Computer Music Conference, International Computer Music Association, San Fransisco, pp. 209–212 (2000)
Pashalidou, S.: Alternative control of digital audio effects, M.S. thesis, University of York, York, UK (2003)
Dombois, F.: Using audification in planetary seismology. In: Hiipakka, N.Z.J., Takala, T. (eds.) Proc. of the 7th Int. Conf. on Auditory Display, ICAD, Laboratory of Acoustics and Audio Signal Processing, Helsinki University of Technology, pp. 227–230 (2001)
Ritter, H.: The graphical simulation toolkit Neo/NST (2000), http://www.techfak.uni-bielefeld.de/ags/ni/projects/simulation_and_visual/neo/neo_e.html
Hermann, T.: Sonification for exploratory data analysis–demonstrations and sound examples (2002), http://www.techfak.uni-bielefeld.de/~thermann/projects/index.html
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Hermann, T., Paschalidou, S., Beckmann, D., Ritter, H. (2006). Gestural Interactions for Multi-parameter Audio Control and Audification. In: Gibet, S., Courty, N., Kamp, JF. (eds) Gesture in Human-Computer Interaction and Simulation. GW 2005. Lecture Notes in Computer Science(), vol 3881. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11678816_37
Download citation
DOI: https://doi.org/10.1007/11678816_37
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-32624-3
Online ISBN: 978-3-540-32625-0
eBook Packages: Computer ScienceComputer Science (R0)