Abstract
We present an extension of the CrossTalk system that allows to model emotional behaviour on three levels: scripting, processing and expression. CrossTalk is a self-explaining virtual character exhibition for public spaces. Its SceneMaker authoring suite provides authors with a screenplay-like language for scripting character and user interactions. This article presents an extension to the original CrossTalk scripting language by providing a set of appraisal and dialogue act tags, making emotional behaviour generation possible. These extensions rely on CrossTalk’s new EmotionEngine which processes emotions by computing and maintaining emotional states for each character. In combination with the ContextMemory module it enables the characters to adapt to user feedback and to react to previous encounters with users in an emotional way. We describe the use of the appraisal and dialogue act tags, their processing in the EmotionEngine and their impact on the characters’ verbal and non-verbal expressive behaviour.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Hayes-Roth, B., van Gent, R.: Story-Making with Improvisational Puppets. In: Proc. of Autonomous Agents 1997, pp. 92–112 (1997)
Swartout, W., Hill, R., Gratch, J., Johnson, W.L., Kyriakakis, C., LaBore, C., Lindheim, R., Marsella, S., Miraglia, D., Moore, B., Morie, J., Rickel, J., Thiébaux, M., Tuch, L., Whitney, R., Douglas, J.: Towards the Holodeck: Integrating Graphics, Sound, Character and Story. In: Proc. of Autonous Agents 2001, pp. 409–416 (2001)
Laurel, B.: Computers as theatre. Addison-Wesley, Reading (1993)
Murray, J.H.: Hamlet on the holodeck: The future of narrative in cyberspace. The MIT Press, Cambridge (2000)
Ryokai, K., Vaucelle, C., Cassell, J.: Virtual peers as partners in storytelling and literacy learning. Journal of Computer Assisted Learning 19(2), 195–208 (2003)
Prendinger, H., Ishizuka, M.: SCREAM: Scripting emotion-based agent minds. In: Proc. of AAMAS 2002, pp. 350–351. ACM Press, New York (2002)
Rist, T., Schmitt, M.: Applying Socio-Psychological Concepts of Cognitive Consistency to Negotiation Dialog Scenarios with Embodied Conversational Characters. In: Proc. of AISB 2002 Symposium on Animated Expressive Characters for Social Interactions, pp. 79–84 (2002)
André, E., Rist, T.: Presenting through performing: On the use of multiple animated characters in knowledge-based presentation systems. In: Proc. of IUI 2000, pp. 1–8. ACM Press, New York (2000)
Gebhard, P., Kipp, M., Klesen, M., Rist, T.: Authoring Scenes for Adaptive, Interactive Performances. In: Proceedings of the Second International Joint Conference on Autonomous Agents and Multiagent Systems, AAMAS-2003 (2003) (in press)
Bates, J.: The role of emotion in believable agents. Communications of the ACM 37(7), 122–125 (1994)
Cassell, J., Sullivan, J., Prevost, S., Churchill, E. (eds.): Embodied Conversational Agents. The MIT Press, Cambridge (2000)
Paiva, A.C.R. (ed.): IWAI 1999. LNCS, vol. 1814. Springer, Heidelberg (2000)
Trappl, R., Petta, P. (eds.) Creating Personalities for Synthetic Actors. LNCS, vol. 1195, Springer, Heidelberg (1997)
Ishizuka, M., Tsutsui, T., Saeyor, S., Dohi, H., Zong, Y., Prendinger, H.: MPML: A multimodal presentation markup language with character control functions. In: Proc. of the Workshop on Achieving Human-like Behavior in Interactive Animated Agents held in conjunction with the Fourth International Conference on Autonomous Agents, pp. 50–54 (2000)
Marriott, A., Stallo, J.: VHML Uncertainties and problems. A discussion. In: Proceedings AAMAS-2002 Workshop on Embodied conversational agents–let’s specify and evaluate them (2002)
De Carolis, B., Pelachaud, C., Poggi, I., de Rosis, F.: Behavior planning for a reflexive agent. In: Proceedings 17th International Conference on Artifcial Intelligence (IJCAI-2001), pp. 1059–1066 (2001)
Klesen, M., Kipp, M., Gebhard, P., Rist, T.: Staging Exhibitions: Methods and tools for modelling narrative structure to produce interactive performances with virtual actors. Journal of Virtual Reality–Special issue on Storytelling in Virtual Environments (2003) (in press)
Microsoft® Agent is a software technology (2003), http://www.microsoft.com/msagent/
Ortony, A., Clore, G.L., Collins, A.: The Cognitive Structure of Emotions. Cambridge University Press, Cambridge (1988)
McCrae, R.R., John, O.P.: An introduction to the five-factor model and its implications. Journal of Personality 60, 171–215 (1992)
IBM ViaVoice TTS technology (2003), http://www-3.ibm.com/software/speech/dev/
Schröder, M.: Emotional Speech Synthesis - A Review. In: Proc. Eurospeech 2001, Aalborg, vol. 1, pp. 561–564 (2001)
Anvil, K.M.: a generic annotation tool for multimodal dialogue. In: Proc. of the 7th Euro-pean Conference on Speech Communication and Technology (Eurospeech), pp. 1367–1370 (2001)
Kipp, M.: Analyzing individual nonverbal behavior for synthetic character animation. In: Cavé, C., Guaitella, I., Santi, S. (eds.) Oralité et Gestualité - Actes du colloque ORAGE (2001)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2003 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Gebhard, P., Kipp, M., Klesen, M., Rist, T. (2003). Adding the Emotional Dimension to Scripting Character Dialogues. In: Rist, T., Aylett, R.S., Ballin, D., Rickel, J. (eds) Intelligent Virtual Agents. IVA 2003. Lecture Notes in Computer Science(), vol 2792. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-39396-2_9
Download citation
DOI: https://doi.org/10.1007/978-3-540-39396-2_9
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-20003-1
Online ISBN: 978-3-540-39396-2
eBook Packages: Springer Book Archive