Skip to main content

Exploring the Role of Dynamic Audio-Haptic Coupling in Musical Gestures on Simulated Instruments

  • Conference paper
  • First Online:
Haptics: Neuroscience, Devices, Modeling, and Applications (EuroHaptics 2014)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 8618))

Abstract

Recent developments at ACROE-ICA have yielded a first audio-haptic modeller-simulator for real time simulations of mass-interaction physical models. This paper discusses the conceptual and technological considerations for a haptic platform that supports dynamic coupling for audio-haptic interactions, in particular in the case of physical coupling with virtual musical instruments. We present work concerning system calibration and metrology, then demonstrate a model developed with this platform, exhibiting dynamic gesture-sound coupling. The quality of the haptic device’s dynamics along with the modularity of mass interaction physical modelling allow for subtle and highly precise interaction with simulated objects, enabling intricate musical gestures relying on high-bandwidth audio-haptic coupling.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Florens, J-L.: Coupleur Gestuel Retroactif pour la Commande et le Controle de Sons Synthetises en Temps-Reel. Ph.D., INPG Grenoble (1978)

    Google Scholar 

  2. Sinclair, S., Wanderley, M.M.: A run time programmable simulator to enable multi-modal interaction with rigid body systems. Interact. Comput. 21, 54–63 (2009)

    Article  Google Scholar 

  3. Berdahl, E., Niemeyer, G., Smith, J.O.: Using haptics to assist performers in making gestures to a musical instrument. In: Proceedings of NIME’09, USA, pp. 177–182 (2009)

    Google Scholar 

  4. Florens, J.L.: Real time bowed string synthesis with force feedback gesture. Invited paper. 585, Mus. 06, vol. 88, Acta Acustica (2002)

    Google Scholar 

  5. Berdahl, E., Niemeyer, G., Smith, J.O.: Using haptic devices to interface directly with digital waveguide based musical instruments. In: Proceedings of NIME’09, USA, pp. 183–186 (2009)

    Google Scholar 

  6. Sinclair, S., Wanderley, M.M., Hayward, V., Scavone, G.: Noise-free haptic interaction with a bowed string acoustic model. In: World Haptics Conference, pp. 463–468 (2011)

    Google Scholar 

  7. Castagné, N., Cadoz, C., Florens, J.L., Luciani, A.: Haptics in computer music: a paradigm shift. In: Proceedings of EuroHaptics 2004, pp. 422–425 (2004)

    Google Scholar 

  8. Gillespie, B., O’Modhrain, S.: Embodied cognition as a motivating perspective for haptic interaction design: a position paper. In: World Haptics Conference, pp. 481–486 (2011)

    Google Scholar 

  9. Cadoz, C.: Le geste canal de communication homme/machine: la communication “instrumentale”. Technique et Science Informatiques 13, 31–61 (1994)

    Google Scholar 

  10. Hayward, V., Astley, O.R., Cruz-Hernandez, M., Grant, D., Robles-De-La-Torre, G.: Haptic interfaces and devices. Sens. Rev. 24(1), 16–29 (2004)

    Article  Google Scholar 

  11. Lederman, S.J., Klatzky, R.L.: Haptic perception: a tutorial. Atten. Percept. Psychophys. 71(7), 1439–1459 (2009)

    Article  Google Scholar 

  12. Cadoz, C., Luciani, A., Florens, J.L.: CORDIS-ANIMA: a modeling and simulation system for sound and image synthesis: the general formalism. Comput. Music J. 17(1), 19–29 (1993)

    Article  Google Scholar 

  13. Florens, J.L., Luciani, A., Castagne, N., Cadoz, C.: ERGOS: a multi-degrees of freedom and versatile force feedback panoply. In: Proceedings of Eurohaptics. pp. 356–360 (2004)

    Google Scholar 

  14. Luciani, A., Florens, J.L., Couroussé, D., Castet, J.: Ergotic sounds: a new way to improve playability, believability and presence of virtual musical instruments. J. New Musical Res. 38, 303–323 (2009)

    Google Scholar 

  15. Leonard, J., Castagné, N., Cadoz, C., Florens, J.L.: Interactive physical design and haptic playing of virtual musical instruments. In: Proceedings of the International Computer Music Conference (ICMC’13), Perth, Australia (2013)

    Google Scholar 

Download references

Acknowledgments

The authors would like to thank Annie Luciani for her participation in the presented work.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to James Leonard .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Leonard, J., Florens, JL., Cadoz, C., Castagné, N. (2014). Exploring the Role of Dynamic Audio-Haptic Coupling in Musical Gestures on Simulated Instruments. In: Auvray, M., Duriez, C. (eds) Haptics: Neuroscience, Devices, Modeling, and Applications. EuroHaptics 2014. Lecture Notes in Computer Science(), vol 8618. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-662-44193-0_59

Download citation

  • DOI: https://doi.org/10.1007/978-3-662-44193-0_59

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-662-44192-3

  • Online ISBN: 978-3-662-44193-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics