Abstract
The goal of this research is to identify key affective body gestures that can clearly convey four emotions, namely happy, content, bored, and frustrated, in animated characters that lack facial features. Two studies were conducted, a first to identify affective body gestures from a series of videos, and a second to validate the gestures as representative of the four emotions. Videos were created using motion capture data of four actors portraying the four targeted emotions and mapping the data to two 3D character models, one male and one female. In the first study the researchers identified body gestures that are commonly produced by individuals when they experience each of the four emotions. In the second study the researchers tested four sets of identified body gestures, one set for each emotion. The animated gestures were mapped to the 3D character models and 91 participants were asked to identify the emotional state conveyed by the characters through the body gestures. The study identified six gestures that were shown to have an acceptable recognition rate of at least 80% for three of the four emotions tested. Contentment was the only emotion which was not conveyed clearly by the identified body gestures. The gender of the character had a significant effect on recognition rates across all emotions.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Massey University (2012). https://www.massey.ac.nz/~albarcza/gesture_dataset2012.html
Archer, D.: Unspoken diversity: cultural differences in gestures. Qual. Sociol. 20(1), 79–105 (1997)
Chaminade, T., Hodgins, J., Kawato, M.: Anthropomorphism influences perception of computer-animated characters actions. Soc. Cogn. Affect. Neurosci. 2(3), 206–216 (2007)
Cheng, J., Zhou, W., Lei, X., Adamo, N., Benes, B.: The effects of body gestures and gender on viewer’s perception of animated pedagogical agent’s emotions. In: Kurosu, M. (ed.) HCII 2020. LNCS, vol. 12182, pp. 169–186. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-49062-1_11
Cissell, K.: A study of the effects of computer animated character body style on perception of facial expression. Master’s thesis, Purdue University, USA (2013)
Dael, N., Mortillaro, M., Scherer, K.R.: The body action and posture coding system (BAP). J. Nonverbal Behav. 36(2), 97–121 (2012)
Deng, Y., Chang, L., Yang, M., Huo, M., Zhou, R.: Gender differences in emotional response. PLOS ONE 11(6), e0158666 (2016)
Einstein, G., Downar, J.: Gender/sex differences in emotions. Medicographia 35(3), 271–280 (2013)
Ekman, P.: Universal facial expressions of emotions. Calif. Ment. Health Digest 8(4), 151–158 (1970). https://www.paulekman.com/wp-content/uploads/2013/07/Universal-Facial-Expressions-of-Emotions1.pdf
Ekman, P.: The Face of Man: Expressions of Universal Emotions in a New Guinea Village. Garland STPM Press, University of California (1980)
Ekman, P.: What scientists who study emotion agree about. Perspect. Psychol. Sci. 11(1), 31–34 (2016)
Ekman, P., Friesen, E.: Facial Action Coding System: A Technique for the Measurement of Facial Movement. Consulting Psychologists Press, Palo Alto (1978)
Fabri, M., Moore, D., Hobbs, D.: Mediating the expression of emotion in educational collaborative virtual environments: an experimental study. Virtual Reality 7(2), 66–81 (2004)
Gross, M.M., Crane, E.A., Fredrickson, B.L.: Effort-Shape and kinematic assessment of bodily expression of emotion during gait. Hum. Mov. Sci. 31(1), 202–221 (2012)
Gu, S., Wang, F., Patel, N.P., Bourgeois, J.A., Huang, J.H.: A model for basic emotions using observations of behavior in Drosophila. Front. Psychol. 10, 781 (2019)
Gunes, H., Piccardi, M.: A bimodal face and body gesture database for automatic analysis of human nonverbal affective behavior. In: 18th International Conference on Pattern Recognition ICPR 2006. vol. 1, pp. 1148–1153 (2006)
Gunes, H., Shan, C., Chen, S., Tian, Y.: Bodily expression for automatic affect recognition. In: Emotion Recognition, pp. 343–377. Wiley (2015)
Hall, J.A., Matsumoto, D.: Gender differences in judgments of multiple emotions from facial expressions. Emotion 4(2), 201–206 (2004)
Huis In’t Veld, E.M.J., Van Boxtel, G.J.M., de Gelder, B.: The Body Action Coding System I: muscle activations during the perception and expression of emotion. Soc. Neurosci. 9(3), 249–264 (2014)
Isaacowitz, D.M., et al.: Age differences in recognition of emotion in lexical stimuli and facial expressions. Psychol. Aging 22(1), 147–159 (2007)
Karg, M., Samadani, A.A., Gorbet, R., Kuhnlenz, K., Hoey, J., Kulic, D.: Body movements for affective expression: a survey of automatic recognition and generation. IEEE Trans. Affect. Comput. 4(4), 341–359 (2013)
Lawson, A.P., Mayer, R.E., Adamo-Villani, N., Benes, B., Lei, X., Cheng, J.: Recognizing the emotional state of human and virtual instructors. Comput. Hum. Behav. 114, 106554 (2021)
Matsumoto, D., et al.: A new test to measure emotion recognition ability. J. Nonverbal Behav. 24(3), 179–209 (2000)
Mill, A., Allik, J., Realo, A., Valk, R.: Age-related differences in emotion recognition ability: a cross-sectional study. Emotion 9(5), 619–630 (2009)
Noel, S., Dumoulin, S., Whalen, T., Stewart, J.: Recognizing emotions on static and animated avatar faces. In: 2006 IEEE International Workshop on Haptic Audio Visual Environments and their Applications, HAVE 2006, pp. 99–104 (2006)
Noroozi, F., Kaminska, D., Corneanu, C., Sapinski, T., Escalera, S., Anbarjafari, G.: Survey on emotional body gesture recognition. IEEE Trans. Affect. Comput. 12(2), 505–523 (2021)
Pease, B., Pease, A.: The Definitive Book of Body Language. Pease International, Australia (2004)
Plutchik, R.: A General Psychoevolutionary Theory of Emotion. In: Theories of Emotion, pp. 3–33. Elsevier (1980)
Pollux, P.M., Hermens, F., Willmott, A.P.: Age-congruency and contact effects in body expression recognition from point-light displays (PLD). PeerJ. 4, e2796 (2016)
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Meyer, Z., Adamo, N., Benes, B. (2021). Bodily Expression of Emotions in Animated Agents. In: Bebis, G., et al. Advances in Visual Computing. ISVC 2021. Lecture Notes in Computer Science(), vol 13018. Springer, Cham. https://doi.org/10.1007/978-3-030-90436-4_38
Download citation
DOI: https://doi.org/10.1007/978-3-030-90436-4_38
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-90435-7
Online ISBN: 978-3-030-90436-4
eBook Packages: Computer ScienceComputer Science (R0)