Abstract
Gestural communication is part of non-verbal communication, but it is also a method that deaf people use to communicate with others through sign languages. In this paper, we present the research to improve communication in virtual characters no matter if it is spoken or signed using non-verbal communication. A brief study of hand gestures has been made to obtain some rules to improve natural behaviour in virtual characters. These rules, like the use of beats, are applied in an animation engine that emulates the behaviour of real people. The behaviour of the virtual character can also be modified by other channels such as user’s input, so the character’s attitude has to be adapted. This paper describes the architecture and main modules of the prototype designed to achieve natural behaviour in virtual characters and present the validation results obtained during the first phase of the development.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Andersen, M.L., Taylor, H.F.: Sociology: The essentials, 4th edn. Thomson Wadsworth, Beltmon (2007)
Birdwhistell, R.L.: El lenguaje de la expresión corporal. Ediciones Gustavo Gili, Spain (1979)
Cassell, J., Pelachaud, C., Badler, N., Steedman, M., Achorn, B., Becket, W., Douville, B., Prevost, S., Stone, M.: Animated conversation: Rule-based generation of facial expression, gesture and spoken intonation for multiple conversational agents. In: Computer Graphics. Annual Conf. Series, pp. 413–420. ACM (1994)
McNeill, D.: Hand and Mind: What Gestures Reveal about Thought. The University of Chicago Press, USA (1992)
Ekman, P., Friesen, W.: The Repertoire of Nonverbal Behavior: Categories, Origins, Usage, and Coding. Semiotica 1, 9–98 (1969)
Bergmann, K., Kopp, S.: Modeling the Production of Co-Verbal Iconic Gestures by Learning Bayesian Decision Networks. Applied Artificial Intelligence 24(6), 530–551 (2010)
Streeck, J.: Depicting by gesture. Gesture 8(3), 285–301 (2008)
Hostetter, A., Alibali, M.: Raise your hand if you’re spatial–Relations between verbal and spatial skills and gesture production. Gesture 7(1), 73–95 (2007)
Cassell, J.: A Framework For Gesture Generation And Interpretation. In: Cipolla, R., Pentland, A. (eds.) Computer Vision in Human-Machine Interaction. Cambridge University Press (1998)
Parrill, F., Sweetser, E.: What we mean by meaning. Gesture 4(2), 197–219 (2004)
Kettebekov, S.: Exploiting Prosodic Structuring of Coverbal Gesticulation. In: Proceedings of the ACM International Conference on Multimodal Interfaces, pp. 105–112 (2004)
Alibali, M.W., Kita, S., Young, A.J.: Gesture and the process of speech production: We think, therefore we gesture. Language and Cognitive Processes 15(6), 593–613 (2000)
Cienki, A., Müller, C.: Metaphor, gesture, and thought. In: Gibbs Jr., R.W. (ed.) The Cambridge Handbook of Metaphor and Thought. Cambridge University Press, Cambridge (2008)
Kobsa, A., Allgayer, J., Reddig, C., Reithinger, N., Schmauks, D., Harbusch, K., Wahlster, W.: Combining deictic gestures and natural language for referent identification. In: Proceedings Eleventh COLING, Bonn, Germany, pp. 356–361 (1986)
Giorgolo, G.: Space and Time in Our Hands. PhD. Universiteit Utrecht (2010)
Pierrehumbert, J., Hirschberg, J.: The meaning of intonational contours in interpretation of discourse. In: Cohen, P., Morgan, J., Pollack, M. (eds.) Intentions in Communication, ch. 14. MIT Press (1990)
Krahmer, E., Swerts, M.: The efects of visual beats on prosodic prominence: Acoustic analyses, auditory perception and visual perception. Journal of Memory and Language 57(3), 396–414 (2007)
Rieger, T.: Avatar Gestures. Journal of WSCG 2003 11(2), 379–386 (2003)
López, B., Hernández, A., Díaz Pardo de Vera, D., Santos de la Cámara, R., Rodríguez, M.C.: ECA gesture strategies for robust SLDS. In: Convention - Communication, Interaction and Social Intelligence on the Symposium on Multimodal Output Generation, Aberdeen, Scotland (2008)
Bergmann, K., Kopp, S.: Multimodal content representation for speech and gesture production. In: Theune, M., van der Sluis, I., Bachvarova, Y., André, E. (eds.) Symposium at the AISB Annual Convention: Multimodal Output Generation, Aberdeen, UK, pp. 61–68 (2008)
Rauscher, F.H., Krauss, R.M., Chen, Y.: Gesture, speech, and lexical access: The role of lexical movements in speech production. Psychological Science 7, 226–231 (1996)
Alseid, M., Rigas, D.: Users’ views of facial expressions and body gestures in e-learning interfaces: an empirical evaluation. World Scientific and Engineering Academy and Society, WSEAS (2009)
Efthimiou, E., Kouroupetroglou, G. (eds.): Proc. of the 9th International Gesture Workshop, Athens, Greece, May 25-27, 2011, pp. 25–27 (2011)
Kopp, S., Krenn, B., Marsella, S., Marshall, A., Pelachaud, C., Pirker, H., Thórisson, K., Vilhjalmsson, H.: Towards a Common Framework for Multimodal Generation in ECAs: The Behavior Markup Language. In: Proceedings of the 6th International (2006)
Marriott, A.: VHML – Virtual Human Markup Language. In: Talking Head Technology Workshop, at OzCHI Conference (2001)
Roseman, I., Antoniou, A., Jose, P.: Appraisal determinants of emotions: Constructing a more accurate and comprehensive theory. Cognition and Emotion 10 (1996)
Ortiz, A., Oyarzun, D., Carretero, M., Posada, J., Linaza, M.T., Garay-Vitoria, N.: Analysing emotional interaction through avatars. A generic architecture. e-Minds: International Journal on Human-Computer Interaction I(5) (March 2009) ISSN: 1697-9613 (print) - 1887-3022 (online)
Kendon, A.: Some functions of gaze direction in social interaction. Acta Psychologica 26, 22–63 (1967)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
del Puy Carretero, M., Ardanza, A., García, S., Díez, H., Oyarzun, D., Ruiz, N. (2012). Improving Gestural Communication in Virtual Characters. In: Perales, F.J., Fisher, R.B., Moeslund, T.B. (eds) Articulated Motion and Deformable Objects. AMDO 2012. Lecture Notes in Computer Science, vol 7378. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-31567-1_7
Download citation
DOI: https://doi.org/10.1007/978-3-642-31567-1_7
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-31566-4
Online ISBN: 978-3-642-31567-1
eBook Packages: Computer ScienceComputer Science (R0)