Skip to main content
SpringerLink
Log in

Audio-Motor Synchronization: The Effect of Mapping Between Kinematics and Acoustic Cues on Geometric Motor Features

  • Conference paper
  • First Online:
Sound, Music, and Motion (CMMR 2013)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 8905))

Included in the following conference series:

Abstract

This paper presents an experiment dealing with the sensorimotor relation between auditory perception and graphical movements. Subjects were asked to synchronize their gestures with synthetic friction sounds. Some geometrical and dynamical parameters of the motor productions are analyzed according to the different mappings. This experiment provides a formal framework for a wider study which aims to evaluate the relation between audition, vision and gestures.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    The more classical model of roughness for a surface is the fractal one, whose spectrum is defined by \(S(\omega )=\frac{1}{\omega ^\beta }\). When \(\beta \) is null, the noise is white, when \(\beta \) equals 1 the noise is pink. The higher the \(\beta \) the smoother the modeled surface is [23].

References

  1. Aramaki, M., Kronland-Martinet, R.: Analysis-synthesis of impact sounds by real-time dynamic filtering. IEEE Trans. Audio Speech Lang. Process. 14(2), 695–705 (2006)

    Article  Google Scholar 

  2. Aramaki, M., Gondre, C., Kronland-Martinet, R., Voinier, T., Ystad, S.: Thinking the sounds: An intuitive control of an impact sound synthesizer. In: Proceedings of ICAD 09–15th International Conference on Auditory Display (2009)

    Google Scholar 

  3. Athenes, S., Sallagoïty, I., Zanone, P.G., Albaret, J.M.: Evaluating the coordination dynamics of handwriting. Hum. Mov. sci. 23(5), 621–641 (2004)

    Article  Google Scholar 

  4. Caramiaux, B., Susini, P., Bianco, T., Bevilacqua, F., Houix, O., Schnell, N., Misdariis, N.: Gestural embodiment of environmental sounds: An experimental study. In: Jensenius, A.R., et al. (eds) Proceedings of the International Conference on New Interfaces for Musical Expression, (NIME 2011) (2011)

    Google Scholar 

  5. Caramiaux, B., Bevilacqua, F., Schnell, N.: Towards a gesture-sound cross-modal analysis. In: Kopp, S., Wachsmuth, I. (eds.) GW 2009. LNCS, vol. 5934, pp. 158–170. Springer, Heidelberg (2010)

    Chapter  Google Scholar 

  6. Conan, S., Derrien, O., Aramaki, M., Ystad, S., Kronland-Martinet, R.: A synthesis model with intuitive control capabilities for rolling sounds. IEEE/ACM Trans. Speech Audio Lang. Process. 22(8), 1260–1273 (2014)

    Article  Google Scholar 

  7. Conan, S., Thoret, E., Aramaki, M., Derrien, O., Gondre, C., Kronland-Martinet, R., Ystad, S.: An intuitive synthesizer of continuous interaction sounds: rubbing, scratching and rolling. Comput. Music J. 38(4) (2014) (In press)

    Google Scholar 

  8. Danna, J., Athènes, S., Zanone, P.G.: Coordination dynamics of elliptic shape drawing: Effects of orientation and eccentricity. Hum. Mov. Sci. 30(4), 698–710 (2011)

    Article  Google Scholar 

  9. Dounskaia, N., Van Gemmert, A.W.A., Stelmach, G.E.: Interjoint coordination during handwriting-like movements. Experimental Brain Research 135(1), 127–140 (2000)

    Article  Google Scholar 

  10. Gaver, W.W.: What in the world do we hear? An ecological approach to auditory event perception. Ecol. Psychol. 5(1), 1–29 (1993)

    Article  MathSciNet  Google Scholar 

  11. Gaver, W.W.: How do we hear in the world? Explorations in ecological acoustics. J. Ecol. Psychol. 5(4), 285–313 (1993)

    Article  MathSciNet  Google Scholar 

  12. Godøy, R.I., Leman, M.: Musical Gestures: Sound, Movement, and Meaning. Taylor & Francis, New York (2010)

    Google Scholar 

  13. Goldstein, H.: Classical Mechanics. Addison-Wesley, New York (1962)

    Google Scholar 

  14. Lacquaniti, F., Terzuolo, C.A., Viviani, P.: The law relating kinematic and figural aspects of drawing movements. Acta Psychologica 54, 115–130 (1983)

    Article  Google Scholar 

  15. Leman, M.: Embodied Music Cognition and Mediation Technology. MIT Press, Cambridge (2007)

    Google Scholar 

  16. Rasamimanana, N.: Geste instrumental du violoniste en situation de jeu: analyse et modélisation. Ph.D Thesis - Université Pierre et Marie Curie - Paris VI (2008)

    Google Scholar 

  17. Stucchi, N., Viviani, P.: Cerebral dominance and asynchrony between bimanual two-dimensional movements. J. Exp. Psychol. Hum. Percept. Perform. 19(6), 1200–1220 (1993)

    Article  Google Scholar 

  18. Theurel, A., Frileux, S., Hatwell, Y., Gentaz, E.: The haptic recognition of geometrical shapes in congenitally blind and blindfolded adolescents: is there a haptic prototype effect? PloS one 7(6), e40251 (2012)

    Article  Google Scholar 

  19. Thoret, E., Aramaki, M., Kronland-Martinet, R., Velay, J.-L., Ystad, S.: Reenacting sensorimotor features of drawing movements from friction sounds. In: Aramaki, M., Barthet, M., Kronland-Martinet, R., Ystad, S. (eds.) CMMR 2012. LNCS, vol. 7900, pp. 130–153. Springer, Heidelberg (2013)

    Chapter  Google Scholar 

  20. Thoret, E., Aramaki M., Gondre C., Kronland-Martinet, R., Ystad, S.: Controlling a non linear friction model for evocative sound synthesis applications. In: Proceedings of the 16th International Conference on Digital Audio Effects (DAFx), Maynooth, Ireland, Sept 2013 (2013)

    Google Scholar 

  21. Thoret, E., Aramaki, M., Kronland-Martinet, R., Velay, J.L., Ystad, S.: From sound to shape: Auditory perception of drawing movements. J. Exp. Psychol. Hum. Percept. Perform. 40, 983–994 (2014)

    Article  Google Scholar 

  22. Thoret, E., Aramaki, M., Bringoux, L., Kronland-Martinet, R., Ystad, S.: When acoustic stimuli turn visual circles into ellipses: sounds evoking accelerations modify visuo-motor coupling, Poster at the 15th International Multisensory Research Forum (IMRF), Amsterdam 11–14 June 2014

    Google Scholar 

  23. Van Den Doel, K., Kry, P.G., Pai, D.K.: FoleyAutomatic: Physically-based sound effects for interactive simulation and animation. In: Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques, pp. 537–544. ACM (2001)

    Google Scholar 

  24. Viviani, P., Terzuolo, C.: Trajectory determines movement dynamics. Neuroscience 7(2), 431–437 (1982)

    Article  Google Scholar 

  25. Viviani, P., Campadelli, P., Mounoud, P.: Visuo-manual pursuit tracking of human two-dimensional movements. J. Exp. Psychol. Hum. Percept. Perform. 13(1), 62–78 (1987)

    Article  Google Scholar 

  26. Viviani, P., Schneider, R.: A developmental study of the relationship between geometry and kinematics in drawing movements. J. Exp. Psychol. Hum. Percept. Perform. 17, 198–218 (1991)

    Article  Google Scholar 

  27. Viviani, P., Baud-Bovy, G., Redolfi, M.: Perceiving and tracking kinesthetic stimuli: Further evidence of motor-perceptual interactions. J. Exp. Psychol. Hum. Percept. Perform. 23(4), 1232–1252 (1997)

    Article  Google Scholar 

  28. Young, W., Rodger, M., Craig, C.: Perceiving and re-enacting spatio-temporal characteristics of walking sounds. J. Exp. Psychol. Hum. Percept. Perform. 39(2), 464–476 (2013)

    Article  Google Scholar 

Download references

Acknowledgments

This work was funded by the French National Research Agency (ANR) under the MetaSon: Métaphores Sonores (Sound Metaphors) project (ANR-10-CORD-0003) in the CONTINT 2010 framework.

Author information

Authors and Affiliations

  1. LMA, CNRS, UPR 7051, Aix-Marseille Université, Ecole Centrale Marseille, Marseille Cedex 20, France

    Etienne Thoret, Mitsuko Aramaki, Richard Kronland-Martinet & Sølvi Ystad

  2. Aix-Marseille Université, CNRS, ISM, UMR 7287, 13288, Marseille Cedex 09, France

    Christophe Bourdin & Lionel Bringoux

Authors
  1. Etienne Thoret
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mitsuko Aramaki
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Christophe Bourdin
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Lionel Bringoux
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Richard Kronland-Martinet
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Sølvi Ystad
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Etienne Thoret .

Editor information

Editors and Affiliations

  1. CNRS - LMA, Marseille, France

    Mitsuko Aramaki

  2. Toulon-Var University and CNRS - LMA, Marseille, France

    Olivier Derrien

  3. CNRS - LMA, Marseille, France

    Richard Kronland-Martinet

  4. CNRS - LMA, Marseille, France

    Sølvi Ystad

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer International Publishing Switzerland

About this paper

Cite this paper

Thoret, E., Aramaki, M., Bourdin, C., Bringoux, L., Kronland-Martinet, R., Ystad, S. (2014). Audio-Motor Synchronization: The Effect of Mapping Between Kinematics and Acoustic Cues on Geometric Motor Features. In: Aramaki, M., Derrien, O., Kronland-Martinet, R., Ystad, S. (eds) Sound, Music, and Motion. CMMR 2013. Lecture Notes in Computer Science(), vol 8905. Springer, Cham. https://doi.org/10.1007/978-3-319-12976-1_15

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-12976-1_15

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-12975-4

  • Online ISBN: 978-3-319-12976-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation