Abstract
This paper presents a system capable of acquiring input from a video camera, processing information related to the expressivity of human movement and generating expressive copying behaviour of an Embodied Agent. We model a bi-directional communication between user and agent based on real-time analysis of movement expressivity and generation of expressive copying behaviour: while the user is moving, the agent responds with a gesture that exhibits the same expressive characteristics. An evaluation study based on a perceptual experiment with participants showed the effectiveness of the designed interaction.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Picard, R.W.: Affective Computing. MIT Press, Cambridge (1997)
Reeves, B., Nass, C.: The media equation: How people treat computers, television and new media like real people and places. CLSI Publications, Stanford (1996)
Gratch, J., Wang, N., Gerten, J., Fast, E., Duffy, R.: Creating Rapport with Virtual Agents. In: Pelachaud, C., Martin, J.-C., André, E., Chollet, G., Karpouzis, K., Pelé, D. (eds.) IVA 2007. LNCS, vol. 4722, pp. 125–138. Springer, Heidelberg (2007)
Camurri, A., Coletta, P., Massari, A., Mazzarino, B., Peri, M., Ricchetti, M., Ricci, A., Volpe, G.: Toward real-time multimodal processing: EyesWeb 4.0. In: Proc. AISB 2004 Convention: Motion, Emotion and Cognition, Leeds, UK (March 2004)
Pelachaud, C.: Multimodal expressive embodied conversational agents. In: MULTIMEDIA 2005: Proceedings of the 13th annual ACM international conference on Multimedia, pp. 683–689. ACM Press, New York (2005)
Paiva, A., Chaves, R., Piedade, M., Bullock, A., Andersson, G., Höök, K.: Sentoy: a tangible interface to control the emotions of a synthetic character. In: AAMAS 2003: Proceedings of the second international joint conference on Autonomous agents and multiagent systems, pp. 1088–1089. ACM Press, New York (2003)
Kopp, S., Sowa, T., Wachsmuth, I.: Imitation games with an artificial agent: From mimicking to understanding shape- related iconic gestures. In: Camurri, A., Volpe, G. (eds.) GW 2003. LNCS, vol. 2915, pp. 436–447. Springer, Heidelberg (2004)
Reidsma, D., Nijholt, A., Poppe, R.W., Rienks, R.J., Hondorp, G.H.W.: Virtual Rap Dancer: Invitation to Dance. In: Olson, G., Jeffries, R. (eds.) CHI 2006, Conference on Human Factors in Computing Systems, Montréal, Québec, Canada, April 25, 2006, pp. 263–266. ACM, New York (2006)
Mancini, M., Castellano, G., Bevacqua, E., Peters, C.: Copying behaviour of espressive motion. In: Proc. of the the Mirage Conference (2007)
Hartmann, B., Mancini, M., Pelachaud, C.: Implementing expressive gesture synthesis for embodied conversational agents. In: Gibet, S., Courty, N., Kamp, J.-F. (eds.) GW 2005. LNCS, vol. 3881, pp. 188–199. Springer, Heidelberg (2006)
Thórisson, K.R., List, T., Pennock, C., DiPirro, J.: Whiteboards: Scheduling Blackboards for Interactive Robots. In: The AAAI 2005 Workshop On Modular Construction of Human-Like Intelligence, AAAI 2005, Pittsburgh, PA, July 9-13 (2005)
Wallbott, H.G.: Bodily expression of emotion. European Journal of Social Psychology 28, 879–896 (1998)
Bänziger, T., Pirker, H., Scherer, K.: GEMEP – GEneva Multimodal Emotion Portrayals: A corpus for the study of multimodal emotional expressions. In: 5th International Conference on Language Resources and Evaluation (LREC 2006), Genova, Italy (2006)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Castellano, G., Mancini, M. (2009). Analysis of Emotional Gestures for the Generation of Expressive Copying Behaviour in an Embodied Agent. In: Sales Dias, M., Gibet, S., Wanderley, M.M., Bastos, R. (eds) Gesture-Based Human-Computer Interaction and Simulation. GW 2007. Lecture Notes in Computer Science(), vol 5085. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-92865-2_21
Download citation
DOI: https://doi.org/10.1007/978-3-540-92865-2_21
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-92864-5
Online ISBN: 978-3-540-92865-2
eBook Packages: Computer ScienceComputer Science (R0)