Skip to main content

Bodily Expression of Emotions in Animated Agents

  • Conference paper
  • First Online:
Advances in Visual Computing (ISVC 2021)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 13018))

Included in the following conference series:

Abstract

The goal of this research is to identify key affective body gestures that can clearly convey four emotions, namely happy, content, bored, and frustrated, in animated characters that lack facial features. Two studies were conducted, a first to identify affective body gestures from a series of videos, and a second to validate the gestures as representative of the four emotions. Videos were created using motion capture data of four actors portraying the four targeted emotions and mapping the data to two 3D character models, one male and one female. In the first study the researchers identified body gestures that are commonly produced by individuals when they experience each of the four emotions. In the second study the researchers tested four sets of identified body gestures, one set for each emotion. The animated gestures were mapped to the 3D character models and 91 participants were asked to identify the emotional state conveyed by the characters through the body gestures. The study identified six gestures that were shown to have an acceptable recognition rate of at least 80% for three of the four emotions tested. Contentment was the only emotion which was not conveyed clearly by the identified body gestures. The gender of the character had a significant effect on recognition rates across all emotions.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 69.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 89.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Massey University (2012). https://www.massey.ac.nz/~albarcza/gesture_dataset2012.html

  2. Archer, D.: Unspoken diversity: cultural differences in gestures. Qual. Sociol. 20(1), 79–105 (1997)

    Article  Google Scholar 

  3. Chaminade, T., Hodgins, J., Kawato, M.: Anthropomorphism influences perception of computer-animated characters actions. Soc. Cogn. Affect. Neurosci. 2(3), 206–216 (2007)

    Article  Google Scholar 

  4. Cheng, J., Zhou, W., Lei, X., Adamo, N., Benes, B.: The effects of body gestures and gender on viewer’s perception of animated pedagogical agent’s emotions. In: Kurosu, M. (ed.) HCII 2020. LNCS, vol. 12182, pp. 169–186. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-49062-1_11

    Chapter  Google Scholar 

  5. Cissell, K.: A study of the effects of computer animated character body style on perception of facial expression. Master’s thesis, Purdue University, USA (2013)

    Google Scholar 

  6. Dael, N., Mortillaro, M., Scherer, K.R.: The body action and posture coding system (BAP). J. Nonverbal Behav. 36(2), 97–121 (2012)

    Article  Google Scholar 

  7. Deng, Y., Chang, L., Yang, M., Huo, M., Zhou, R.: Gender differences in emotional response. PLOS ONE 11(6), e0158666 (2016)

    Article  Google Scholar 

  8. Einstein, G., Downar, J.: Gender/sex differences in emotions. Medicographia 35(3), 271–280 (2013)

    Google Scholar 

  9. Ekman, P.: Universal facial expressions of emotions. Calif. Ment. Health Digest 8(4), 151–158 (1970). https://www.paulekman.com/wp-content/uploads/2013/07/Universal-Facial-Expressions-of-Emotions1.pdf

  10. Ekman, P.: The Face of Man: Expressions of Universal Emotions in a New Guinea Village. Garland STPM Press, University of California (1980)

    Google Scholar 

  11. Ekman, P.: What scientists who study emotion agree about. Perspect. Psychol. Sci. 11(1), 31–34 (2016)

    Article  Google Scholar 

  12. Ekman, P., Friesen, E.: Facial Action Coding System: A Technique for the Measurement of Facial Movement. Consulting Psychologists Press, Palo Alto (1978)

    Google Scholar 

  13. Fabri, M., Moore, D., Hobbs, D.: Mediating the expression of emotion in educational collaborative virtual environments: an experimental study. Virtual Reality 7(2), 66–81 (2004)

    Article  Google Scholar 

  14. Gross, M.M., Crane, E.A., Fredrickson, B.L.: Effort-Shape and kinematic assessment of bodily expression of emotion during gait. Hum. Mov. Sci. 31(1), 202–221 (2012)

    Article  Google Scholar 

  15. Gu, S., Wang, F., Patel, N.P., Bourgeois, J.A., Huang, J.H.: A model for basic emotions using observations of behavior in Drosophila. Front. Psychol. 10, 781 (2019)

    Article  Google Scholar 

  16. Gunes, H., Piccardi, M.: A bimodal face and body gesture database for automatic analysis of human nonverbal affective behavior. In: 18th International Conference on Pattern Recognition ICPR 2006. vol. 1, pp. 1148–1153 (2006)

    Google Scholar 

  17. Gunes, H., Shan, C., Chen, S., Tian, Y.: Bodily expression for automatic affect recognition. In: Emotion Recognition, pp. 343–377. Wiley (2015)

    Google Scholar 

  18. Hall, J.A., Matsumoto, D.: Gender differences in judgments of multiple emotions from facial expressions. Emotion 4(2), 201–206 (2004)

    Article  Google Scholar 

  19. Huis In’t Veld, E.M.J., Van Boxtel, G.J.M., de Gelder, B.: The Body Action Coding System I: muscle activations during the perception and expression of emotion. Soc. Neurosci. 9(3), 249–264 (2014)

    Google Scholar 

  20. Isaacowitz, D.M., et al.: Age differences in recognition of emotion in lexical stimuli and facial expressions. Psychol. Aging 22(1), 147–159 (2007)

    Google Scholar 

  21. Karg, M., Samadani, A.A., Gorbet, R., Kuhnlenz, K., Hoey, J., Kulic, D.: Body movements for affective expression: a survey of automatic recognition and generation. IEEE Trans. Affect. Comput. 4(4), 341–359 (2013)

    Article  Google Scholar 

  22. Lawson, A.P., Mayer, R.E., Adamo-Villani, N., Benes, B., Lei, X., Cheng, J.: Recognizing the emotional state of human and virtual instructors. Comput. Hum. Behav. 114, 106554 (2021)

    Article  Google Scholar 

  23. Matsumoto, D., et al.: A new test to measure emotion recognition ability. J. Nonverbal Behav. 24(3), 179–209 (2000)

    Article  Google Scholar 

  24. Mill, A., Allik, J., Realo, A., Valk, R.: Age-related differences in emotion recognition ability: a cross-sectional study. Emotion 9(5), 619–630 (2009)

    Article  Google Scholar 

  25. Noel, S., Dumoulin, S., Whalen, T., Stewart, J.: Recognizing emotions on static and animated avatar faces. In: 2006 IEEE International Workshop on Haptic Audio Visual Environments and their Applications, HAVE 2006, pp. 99–104 (2006)

    Google Scholar 

  26. Noroozi, F., Kaminska, D., Corneanu, C., Sapinski, T., Escalera, S., Anbarjafari, G.: Survey on emotional body gesture recognition. IEEE Trans. Affect. Comput. 12(2), 505–523 (2021)

    Google Scholar 

  27. Pease, B., Pease, A.: The Definitive Book of Body Language. Pease International, Australia (2004)

    MATH  Google Scholar 

  28. Plutchik, R.: A General Psychoevolutionary Theory of Emotion. In: Theories of Emotion, pp. 3–33. Elsevier (1980)

    Google Scholar 

  29. Pollux, P.M., Hermens, F., Willmott, A.P.: Age-congruency and contact effects in body expression recognition from point-light displays (PLD). PeerJ. 4, e2796 (2016)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding authors

Correspondence to Zachary Meyer , Nicoletta Adamo or Bedrich Benes .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Meyer, Z., Adamo, N., Benes, B. (2021). Bodily Expression of Emotions in Animated Agents. In: Bebis, G., et al. Advances in Visual Computing. ISVC 2021. Lecture Notes in Computer Science(), vol 13018. Springer, Cham. https://doi.org/10.1007/978-3-030-90436-4_38

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-90436-4_38

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-90435-7

  • Online ISBN: 978-3-030-90436-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics