Abstract
Non-verbal communication, or “body language”, is a critical component in constructing believable virtual characters. Most often, body language is implemented by a set of ad-hoc rules. We propose a new method for authors to specify and refine their character’s body-language responses. Using our method, the author watches the character acting in a situation, and provides simple feedback on-line. The character then learns to use its body language to maximize the rewards, based on a reinforcement learning algorithm.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Cassell, J., Bickmore, T., Campbell, L., Chang, K., Vilhjálmsson, H., Yan, H.: Embodiment in conversational interfaces: Rea. In: ACM SIGCHI, pp. 520–527. ACM Press, New York (1999)
Cassell, J., Vilhjálmsson, H.H., Bickmore, T.: BEAT: the behavior expression animation toolkit. In: ACM SIGGRAPH, pp. 477–486 (2001)
Gillies, M., Dodgson, N.: Eye movements and attention for behavioural animation. Journal of Visualization and Computer Animation 13, 287–300 (2002)
Gillies, M., Ballin, D.: A model of interpersonal attitude and posture generation. In: Rist, T., Aylett, R., Ballin, D., Rickel, J. (eds.) Fourth Workshop on Intelligent Virtual Agents, Kloster Irsee, Germany (2003)
Sutton, R.S., Barto, A.G.: Reinforcement Learning: An Introduction. MIT Press, Cambridge (1998)
Kaelbling, L.P., Littman, M.L., Moore, A.W.: Reinforcement learning: A survey. Journal of Artificial Intelligence Research 4, 237–285 (1996)
Blumberg, B., Downie, M., Ivanov, Y., Berlin, M., Johnson, M.P., Tomlinson, B.: Integrated learning for interactive synthetic characters. In: SIGGRAPH 2002: Proceedings of the 29th annual conference on Computer graphics and interactive techniques, pp. 417–426. ACM Press, New York (2002)
Isbell, C., Shelton, C.R., Kearns, M., Singh, S., Stone, P.: A social reinforcement learning agent. In: AGENTS 2001: Proceedings of the fifth international conference on Autonomous agents, pp. 377–384. ACM Press, New York (2001)
Conde, T., Tambellini, W., Thalmann, D.: Behavioral animation of autonomous virtual agents helped by reinforcement learning. In: Rist, T., Aylett, R.S., Ballin, D., Rickel, J. (eds.) IVA 2003. LNCS (LNAI), vol. 2792, pp. 175–180. Springer, Heidelberg (2003)
Guye-Vuilléme, A., Capin, T.K., Pandzic, I.S., Magnenat-Thalmann, N., Thalmann, D.: Non-verbal communication interface for collaborative virtual environments. The Virtual Reality Journal 4, 49–59 (1999)
DeCarolis, B., Pelachaud, C., Poggi, I., Steedman, M.: APML, a markup language for believable behaviour generation. In: Prendiger, H., Ishizuka, M. (eds.) Life-like characters: tools, affective functions and applications, pp. 65–87. Springer, Heidelberg (2004)
Pelachaud, C., Poggi, I.: Subtleties of facial expressions in embodied agents. Journal of Visualization and Computer Animation 13, 287–300 (2002)
Rickel, J., Johnson, W.L.: Animated agents for procedural training in virtual reality: Perception, cognition, and motor control. Applied Artificial Intelligence 13, 343–382 (1999)
Garau, M., Slater, M., Bee, S., Sasse, M.A.: The impact of eye gaze on communication using humaniod avatars. In: ACM SIGCHI, pp. 309–316 (2001)
Chi, D., Costa, M., Zhao, L., Badler, N.: The emote model for effort and shape. In: ACM SIGGRAPH, pp. 173–182. ACM Press/Addison-Wesley Publishing Co. (2000)
Hall, E.T.: The Hidden Dimension. New York, Doubleday (1966)
Cassell, J., Nakano, Y., Bickmore, T., Sidner, C., Rich, C.: Annotating and generating posture from discourse structure in embodied conversational agents. In: Workshop on Representing, Annotating, and Evaluating Non-Verbal and Verbal Communicative Acts to Achieve Contextual Embodied Agents, Autonomous Agents 2001 Conference, Montreal, Canada (2001)
Bécheiraz, P., Thalmann, D.: A model of nonverbal communication and interpersonal relationship between virtual actors. In: Proceedings of the Computer Animation 1996, pp. 58–67. IEEE Computer Society Press, Los Alamitos (1996)
Gillies, M., Ballin, D.: Integrating autonomous behavior and user control for believable agents. In: Third international joint conference on Autonomous Agents and Multi-Agent Systems, Columbia University, New York City (2004)
Steed, A., Mortensen, J., Frecon, E.: Spelunking: Experiences using the DIVE System on CAVE-like Platforms. In: Immersive Projection Technologies and Virtual Environments, vol. 2, pp. 153–164. Springer, Heidelberg (2001)
Frecon, E., Smith, G., Steed, A., Stenius, M., Stahl, O.: An overview of the COVEN platform. Presence: Teleoperators and Virtual Environments 10, 109–127 (2001)
Cruz-Neira, C., Sandin, D.J., DeFanti, T.A., Kenyon, R.V., Hart, J.C.: The CAVE: Audio visual experience automatic virtual environment. Comm. ACM 35, 65–72 (1992)
Slater, M., Usoh, M.: Presence in immersive virtual environments. In: Proc. IEEE Virtual Reality 1993, Seattle, WA, pp. 33–40 (1993)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Friedman, D., Gillies, M. (2005). Teaching Virtual Characters How to Use Body Language. In: Panayiotopoulos, T., Gratch, J., Aylett, R., Ballin, D., Olivier, P., Rist, T. (eds) Intelligent Virtual Agents. IVA 2005. Lecture Notes in Computer Science(), vol 3661. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11550617_18
Download citation
DOI: https://doi.org/10.1007/11550617_18
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-28738-4
Online ISBN: 978-3-540-28739-1
eBook Packages: Computer ScienceComputer Science (R0)