Abstract
Recent developments at ACROE-ICA have yielded a first audio-haptic modeller-simulator for real time simulations of mass-interaction physical models. This paper discusses the conceptual and technological considerations for a haptic platform that supports dynamic coupling for audio-haptic interactions, in particular in the case of physical coupling with virtual musical instruments. We present work concerning system calibration and metrology, then demonstrate a model developed with this platform, exhibiting dynamic gesture-sound coupling. The quality of the haptic device’s dynamics along with the modularity of mass interaction physical modelling allow for subtle and highly precise interaction with simulated objects, enabling intricate musical gestures relying on high-bandwidth audio-haptic coupling.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Florens, J-L.: Coupleur Gestuel Retroactif pour la Commande et le Controle de Sons Synthetises en Temps-Reel. Ph.D., INPG Grenoble (1978)
Sinclair, S., Wanderley, M.M.: A run time programmable simulator to enable multi-modal interaction with rigid body systems. Interact. Comput. 21, 54–63 (2009)
Berdahl, E., Niemeyer, G., Smith, J.O.: Using haptics to assist performers in making gestures to a musical instrument. In: Proceedings of NIME’09, USA, pp. 177–182 (2009)
Florens, J.L.: Real time bowed string synthesis with force feedback gesture. Invited paper. 585, Mus. 06, vol. 88, Acta Acustica (2002)
Berdahl, E., Niemeyer, G., Smith, J.O.: Using haptic devices to interface directly with digital waveguide based musical instruments. In: Proceedings of NIME’09, USA, pp. 183–186 (2009)
Sinclair, S., Wanderley, M.M., Hayward, V., Scavone, G.: Noise-free haptic interaction with a bowed string acoustic model. In: World Haptics Conference, pp. 463–468 (2011)
Castagné, N., Cadoz, C., Florens, J.L., Luciani, A.: Haptics in computer music: a paradigm shift. In: Proceedings of EuroHaptics 2004, pp. 422–425 (2004)
Gillespie, B., O’Modhrain, S.: Embodied cognition as a motivating perspective for haptic interaction design: a position paper. In: World Haptics Conference, pp. 481–486 (2011)
Cadoz, C.: Le geste canal de communication homme/machine: la communication “instrumentale”. Technique et Science Informatiques 13, 31–61 (1994)
Hayward, V., Astley, O.R., Cruz-Hernandez, M., Grant, D., Robles-De-La-Torre, G.: Haptic interfaces and devices. Sens. Rev. 24(1), 16–29 (2004)
Lederman, S.J., Klatzky, R.L.: Haptic perception: a tutorial. Atten. Percept. Psychophys. 71(7), 1439–1459 (2009)
Cadoz, C., Luciani, A., Florens, J.L.: CORDIS-ANIMA: a modeling and simulation system for sound and image synthesis: the general formalism. Comput. Music J. 17(1), 19–29 (1993)
Florens, J.L., Luciani, A., Castagne, N., Cadoz, C.: ERGOS: a multi-degrees of freedom and versatile force feedback panoply. In: Proceedings of Eurohaptics. pp. 356–360 (2004)
Luciani, A., Florens, J.L., Couroussé, D., Castet, J.: Ergotic sounds: a new way to improve playability, believability and presence of virtual musical instruments. J. New Musical Res. 38, 303–323 (2009)
Leonard, J., Castagné, N., Cadoz, C., Florens, J.L.: Interactive physical design and haptic playing of virtual musical instruments. In: Proceedings of the International Computer Music Conference (ICMC’13), Perth, Australia (2013)
Acknowledgments
The authors would like to thank Annie Luciani for her participation in the presented work.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Leonard, J., Florens, JL., Cadoz, C., Castagné, N. (2014). Exploring the Role of Dynamic Audio-Haptic Coupling in Musical Gestures on Simulated Instruments. In: Auvray, M., Duriez, C. (eds) Haptics: Neuroscience, Devices, Modeling, and Applications. EuroHaptics 2014. Lecture Notes in Computer Science(), vol 8618. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-662-44193-0_59
Download citation
DOI: https://doi.org/10.1007/978-3-662-44193-0_59
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-662-44192-3
Online ISBN: 978-3-662-44193-0
eBook Packages: Computer ScienceComputer Science (R0)