Skip to main content

Performance Gestures of Musicians: What Structural and Emotional Information Do They Convey?

  • Conference paper
Gesture-Based Communication in Human-Computer Interaction (GW 2003)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 2915))

Included in the following conference series:

Abstract

This paper investigates how expressive gestures of a professional clarinetist contribute to the perception of structure and affect in musical performance. The thirty musically trained subjects saw, heard, or both saw and heard the performance. All subjects made the same judgments including a real-time judgment of phrasing, which targeted the experience of structure, and a real-time judgment of tension, which targeted emotional experience.

In addition to standard statistical methods, techniques in the field of Functional Data Analysis were used to interpret the data. These new techniques model data drawn from continuous processes and explore the hidden structures of the data as they change over time.

Three main findings add to our knowledge of gesture and movement in music: 1) The visual component carries much of the same structural information as the audio. 2) Gestures elongate the sense of phrasing during a pause in the sound and certain gestures cue the beginning of a new phrase. 3) The importance of visual information to the experience of tension changes with certain structural features in the sound. When loudness, pitch height, and note density are relatively low, the effect of removing the visual component is to decrease the experience of tension.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Aiello, R.: Music and Language: Parallels and Contrasts. In: Aiello, R., Sloboda, J. (eds.) Music Perceptions, pp. 40–63. Oxford University Press, NewYork (1994)

    Google Scholar 

  2. Clarke, E.F., Krumhansl, C.L.: Perceiving Musical Time. Music Perception 7, 213–252 (1990)

    Google Scholar 

  3. Davidson, J.: Visual Perception of Performance Manner in the Movements of Solo Musicians. Psychology of Music 21, 103–113 (1993)

    Article  Google Scholar 

  4. Delalande, F.: La Gestique de Gould. Glen Gould Pluriel, pp. 85–111. Louse Courteau, editrice, inc. (1988)

    Google Scholar 

  5. Deliège, I., El Ahmade, A.: Mechanisms for Cue Extraction in Musical Groupings: A Study of Perception on Sequenza VI for Viola Solo by Luciano Berio. Psychology of Music 18, 18–44 (1990)

    Article  Google Scholar 

  6. Fredrickson, W.E.: A Comparison of Perceived Musical Tension and Aesthetic Response. Psychology of Music 23, 81–87 (1995)

    Article  Google Scholar 

  7. Fredrickson, W.E.: Elementary, Middle, and High School Student Perceptions of Tension in Music. Journal of Research in Music Education 45(4), 626–635 (1997)

    Article  Google Scholar 

  8. Fredrickson, W.E.: Effect of Musical Performance on Perception of Tension in Gustav Holst’s First Suite in E-flat. Journal of Research in Music Education 47(1), 44–52 (1999)

    Article  Google Scholar 

  9. Fredrickson, W.E.: Perception of Tension in Music: Musicians versus Nonmusicians. Journal of Music Therapy 37(1), 40–50 (2000)

    Google Scholar 

  10. Krumhansl, C.L.: A Perceptual Analysis of Mozart’s Piano Sonata K. 282: Segmentation, Tension, and Musical Ideas. Music Perception 13(3), 401–432 (1996)

    Google Scholar 

  11. Krumhansl, C.L.: An Exploratory Study of Musical Emotions and Psychophysiology. Canadian Journal of Experimental Psychology 51(4), 336–352 (1997)

    Google Scholar 

  12. Krumhansl, C.L., Schenck, D.L.: Can dance reflect the structural and expressive qualities of music? A perceptual experiment on Balanchine’s choreography of Mozart’s Divertimento. Musicae Scientiae 15, 63–85 (1997)

    Google Scholar 

  13. Levelt, W.J.M.: Speaking: From Intention to Articulation. MIT Press, Cambridge (1989)

    Google Scholar 

  14. Madsen, C.K., Fredrickson, W.E.: The Experience of Musical Tension: A Replication of Nielsen’s Research Using the Continuous Response Digital Interface. Journal of Music Therapy 30(1), 46–63 (1993)

    Google Scholar 

  15. McFarland, D.H.: Respiratory Markers of Conversational Interaction. Journal of Speech, Language, and Hearing Research 44(1), 128–143 (2001)

    Article  MathSciNet  Google Scholar 

  16. Nielsen, F.V.: Oplevelse af misikalsk spending (The experience of musical tension). Akademisk Forlag, Copenhagen (1983)

    Google Scholar 

  17. Ramsay, J.O., Silverman, B.W.: Functional Data Analysis. Springer, New York (1997)

    MATH  Google Scholar 

  18. Wanderley, M.M.: Non-Obvious Performer Gestures in Instrumental Music. In: Braffort, A., Gherbi, R., Gibet, S., Richardson, J., Teil, D. (eds.) Gesture-Based Communication in Human-Computer Interaction, pp. 37–48. Springer, Heidelberg (1999)

    Chapter  Google Scholar 

  19. Wanderley, M.M., Depalle, P.: Gesturally Controlled Digital Audio Effects. In: Proceedings of the COST-6 Conference on Digital Audio Effects (DAFx-01). Limerick, Ireland, pp. 165–169 (2001)

    Google Scholar 

  20. Wanderley, M.M.: QuantitativeAnalysis of Non-Obvious Performer Gestures. In: Wachsmuth, I., Sowa, T. (eds.) Gesture and Sign Language in Human-Computer Interaction, pp. 241–253. Springer, Heidelberg (2002)

    Chapter  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2004 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Vines, B.W., Wanderley, M.M., Krumhansl, C.L., Nuzzo, R.L., Levitin, D.J. (2004). Performance Gestures of Musicians: What Structural and Emotional Information Do They Convey?. In: Camurri, A., Volpe, G. (eds) Gesture-Based Communication in Human-Computer Interaction. GW 2003. Lecture Notes in Computer Science(), vol 2915. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-24598-8_43

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-24598-8_43

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-21072-6

  • Online ISBN: 978-3-540-24598-8

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics