Skip to main content
SpringerLink
Log in

Communication of musical expression by means of mobile robot gestures

  • Original Paper
  • Published:
Journal on Multimodal User Interfaces Aims and scope Submit manuscript

Abstract

We developed a robotic system that can behave in an emotional way. A 3-wheeled simple robot with limited degrees of freedom was designed. Our goal was to make the robot displaying emotions in music performance by performing expressive movements. These movements have been compiled and programmed based on literature about emotion in music, musicians’ movements in expressive performances, and object shapes that convey different emotional intentions. The emotions happiness, anger, and sadness have been implemented in this way. General results from behavioral experiments show that emotional intentions can be synthesized, displayed and communicated by an artificial creature, also in constrained circumstances.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Picard RW (1997) Affective computing. MIT Press, Cambridge

    Google Scholar 

  2. Hashimoto S (2004) In: Sincák P, Vascák J, Hirota K (eds) Humanoid robot for kansei communication—computer must have body. Advances in fuzzy systems—applications and theory, vol 21. World Scientific, Singapore, pp 357–370

    Google Scholar 

  3. JSKE. What is kansei engineering? http://www.jske.org/historical/whatiskansei.html

  4. Frijda NH (1995) In: Roitblat HL, Meyer JA (eds) Comparative approaches to cognitive science. MIT Press, Cambridge

    Google Scholar 

  5. Breazeal CL, Brooks RA (2005) In: Fellous JM, Arbib MA (eds) Who needs emotions? The brain meets the robot. Oxford University Press, Oxford, pp 271–310

    Google Scholar 

  6. Lego Mindstorms NTX. http://mindstorms.lego.com/

  7. Leman M (2007) Embodied music cognition and mediation technology. MIT Press, Cambridge

    Google Scholar 

  8. Godøy RI, Leman M (2009) Musical gestures. Routledge, London

    Google Scholar 

  9. Schmidt L (2005) Proceedings of the 2nd Asia pacific society for the cognitive science of music APSCOM05, pp 148–154

  10. Dahl S, Friberg A (2007) Music Percep 24(5):433. http://www.speech.kth.se/~sofiadah/pdf/paper4-expression.pdf

    Article  Google Scholar 

  11. Isbister K, Höök K, Sharp M, Laaksolahti J (2006) In: Proceedings of the conference on human factors in computing systems (CHI), Montréal, pp 1163–1172

  12. NBC/NXC. http://bricxcc.sourceforge.net/nbc/

  13. Juslin PN (2001) In: Juslin PN, Sloboda JA (eds) Music and emotion: theory and research. University Press, Oxford, pp 309–337

    Google Scholar 

  14. Giordano B, Bresin R (2006) In: Baroni M, Addessi AR, Caterina R, Costa M (eds) ICMPC9—9th international conference on music perception & cognition. Bonomia University Press, Bologna, p 149. Abstract only

    Google Scholar 

  15. Juslin PN, Lindström E (2004) Musical expression of emotions: modeling composed and performed features. Manuscript in preparation

  16. Bresin R (2005) In: International computer music conference, Barcelona, pp 367–370. http://www.speech.kth.se/prod/publications/files/1342.pdf

  17. Pfeifer R, Scheier C (1999) Understanding intelligence. MIT Press, Cambridge

    Google Scholar 

  18. Dahl S (2005) On the beat: Human movement and timing in the production and perception of music. PhD thesis, TMH, KTH Stockholm. http://www.csc.kth.se/utbildning/forskar/avhandlingar/doktor/2005_2006/DahlSofia.pdf

  19. Dautenhahn K, Werry I (2002) In: IEEE/RSJ conferenceon intelligent robots and systems, Lausanne, pp 1132–1138.http://homepages.feis.herts.ac.uk/~comqkd/Dautenhahn-Werry-Iros2002.pdf

Download references

Author information

Authors and Affiliations

  1. Finnish Centre of Excellence in Interdisciplinary Music Research, Department of Music, University of Jyväskylä, Jyväskylä, Finland

    Birgitta Burger

  2. CSC School of Computer Science and Communication, TMH Dept. of Speech, Music and Hearing, KTH Royal Institute of Technology, Stockholm, Sweden

    Roberto Bresin

Authors
  1. Birgitta Burger
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Roberto Bresin
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Roberto Bresin.

Electronic Supplementary Material

Below is the link to the electronic supplementary material. (MOV 12.2 MB)

Below is the link to the electronic supplementary material. (MOV 11.5 MB)

Below is the link to the electronic supplementary material. (MOV 21.6 MB)

Rights and permissions

Reprints and permissions

About this article

Cite this article

Burger, B., Bresin, R. Communication of musical expression by means of mobile robot gestures. J Multimodal User Interfaces 3, 109–118 (2010). https://doi.org/10.1007/s12193-009-0022-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12193-009-0022-8

Search

Navigation