Abstract
We present an evaluation of copying behaviour in an embodied agent capable of processing expressivity characteristics of a user’s movement and conveying aspects of it in real-time. The agent responds to affective cues from gestures performed by actors, producing synthesised gestures that exhibit similar expressive qualities. Thus, copying is performed only at the expressive level and information about other aspects of the gesture, such as the shape, is not retained. This research is significant to social interaction between agents and humans, for example, in cases where an agent wishes to show empathy with a conversational partner without an exact copying of their motions.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Banziger, T., Scherer, K.: Introducing the Geneva Multimodal Emotion Portrayal (GEMEP) Corpus. In: Scherer, K.R., Bänziger, T., Roesch, E.B. (eds.) Blueprint for Affective Computing: A Sourcebook. Oxford University Press, Oxford (2010)
Bernhardt, D., Robinson, P.: Detecting affect from non-stylised body motions. In: Paiva, A., Prada, R., Picard, R.W. (eds.) ACII 2007. LNCS, vol. 4738, pp. 59–70. Springer, Heidelberg (2007)
Bianchi-Berthouze, N., Kleinsmith, A.: A categorical approach to affective gesture recognition. Connection Science 15(4), 259–269 (2003)
Boone, R.T., Cunningham, J.G.: Children’s Decoding of Emotion in Expressive Body Movement: The Development of Cue Attunement. Developmental Psychology 34(5), 1007–1016 (1998)
Camurri, A., Coletta, P., Varni, G., Ghisio, S.: Developing multimodal interactive systems with EyesWeb XMI. In: Proceedings of the 2007 Conference on New Interfaces for Musical Expression, pp. 305–308 (2007)
Camurri, A., Mazzarino, B., Volpe, G.: Analysis of expressive gesture: The Eyesweb Expressive Gesture Processing Library. In: Camurri, A., Volpe, G. (eds.) GW 2003. LNCS (LNAI), vol. 2915, pp. 460–467. Springer, Heidelberg (2004)
Camurri, A., Lagerlof, I., Volpe, G.: Recognizing emotion from dance movement: comparison of spectator recognition and automated techniques. International Journal of Human-Computer Studies 59(1-2), 213–225 (2003)
Castellano, G., Caridakis, G., Camurri, A., Karpouzis, K., Volpe, G., Kollias, S.: Body gesture and facial expression analysis for automatic affect recognition. In: Scherer, K.R., Bänziger, T., Roesch, E.B. (eds.) Blueprint for Affective Computing: A Sourcebook. Oxford University Press, Oxford (2010)
Castellano, G., Mancini, M.: Analysis of emotional gestures for the generation of expressive copying behaviour in an embodied agent. In: Dias, M.S., Gibet, S., Wanderley, M., Bastos, R. (eds.) GW 2007. LNCS (LNAI), vol. 5085, pp. 193–198. Springer, Heidelberg (2009)
Kleinsmith, A., Bianchi-Berthouze, N.: Recognising Human Emotions from Body Movement and Gesture Dynamics. In: Paiva, A., Prada, R., Picard, R.W. (eds.) ACII 2007. LNCS, vol. 4738, pp. 48–58. Springer, Heidelberg (2007)
Gunes, H., Piccardi, M.: Automatic temporal segment detection and affect recognition from face and body display. IEEE Transactions on Systems, Man and Cybernetics - Part B 39(1), 64–84 (2009)
Hartmann, B., Mancini, M., Buisine, S., Pelachaud, C.: Design and evaluation of expressive gesture synthesis for embodied conversational agents. In: Third International Joint Conference on Autonomous Agents & Multi-Agent Systems (AAMAS), Utretch (July 2005)
Kopp, S., Sowa, T., Wachsmuth, I.: Imitation games with an artificial agent: From mimicking to understanding shape-related iconic gestures. In: Camurri, A., Volpe, G. (eds.) GW 2003. LNCS (LNAI), vol. 2915, pp. 436–447. Springer, Heidelberg (2004)
Maatman, R.M., Gratch, J., Marsella, S.: Natural behavior of a listening agent. In: Panayiotopoulos, T., Gratch, J., Aylett, R.S., Ballin, D., Olivier, P., Rist, T. (eds.) IVA 2005. LNCS (LNAI), vol. 3661, pp. 25–36. Springer, Heidelberg (2005)
McDonnell, R., Joerg, S., McHugh, J., Newell, F., O’Sullivan, C.: Investigating the role of body shape on the perception of emotion. ACM Transactions on Applied Perception 6(3), 14–25 (2009)
McNeill, D.: Hand and mind: what gestures reveal about thought. University of Chicago Press, Chicago (1992)
Niewiadomski, R., Mancini, M., Hyniewska, S., Pelachaud, C.: Communicating emotional states with the Greta agent. In: Scherer, K.R., Bänziger, T., Roesch, E.B. (eds.) Blueprint for Affective Computing: A Sourcebook. Oxford University Press, Oxford (2010)
Petta, P., Pelachaud, C., Cowie, R. (eds.): Emotion-oriented systems: The Humaine handbook. Cognitive Technologies Series. Springer, Heidelberg (2011)
Reidsma, D., Nijholt, A., Poppe, R., Rienks, R., Hondorp, H.: Virtual rap dancer: Invitation to dance. In: CHI 2006 Extended Abstracts on Human Factors in Computing Systems, pp. 263–266. ACM, New York (2006)
Sanghvi, J., Castellano, G., Leite, I., Pereira, A., McOwan, P.W., Paiva, A.: Automatic analysis of affective postures and body motion to detect engagement with a game companion. In: ACM/IEEE International Conference on Human-Robot Interaction. ACM, Lausanne (2011)
Wallbott, H.G.: Bodily expression of emotion. European Journal of Social Psychology 28(6), 879–896 (1998)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Mancini, M., Castellano, G., Peters, C., McOwan, P.W. (2011). Evaluating the Communication of Emotion via Expressive Gesture Copying Behaviour in an Embodied Humanoid Agent. In: D’Mello, S., Graesser, A., Schuller, B., Martin, JC. (eds) Affective Computing and Intelligent Interaction. ACII 2011. Lecture Notes in Computer Science, vol 6974. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-24600-5_25
Download citation
DOI: https://doi.org/10.1007/978-3-642-24600-5_25
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-24599-2
Online ISBN: 978-3-642-24600-5
eBook Packages: Computer ScienceComputer Science (R0)