Abstract
This paper presents the NICE fairy-tale game system, which enables adults and children to engage in conversation with animated characters in a 3D world. In this paper we argue that spoken dialogue technology have the potential to greatly enrichen the user’s experience in future computer games. We also present some requirements that have to be fulfilled to successfully integrate spoken dialogue technology with a computer game application. Finally, we briefly describe an implemented system that has provided computer game characters with some conversational abilities that kids have interacted with in studies.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Aberdeen, J., Bayer, S., Caskey, S., Daminos, L., Goldschen, A., Hirschman, L., Loehr, D., Trappe, H.: Implementing practical dialogue systems with the DARPA Communicator architecture. In: Proc. IJCAI 1999 workshop on knowledge and reasoning in practical dialogue systems, pp. 81–88 (1999)
Allbeck, J., Badler, N.: Representing and Parameterizing Agent Behaviours. In: Prendinger, H., Ishizuka, M. (eds.) Life-Like Characters: Tools, Affective Functions, and Applications. Springer, Germany (2004)
Allwood, J.: Reasons for management in dialog. In: Beun, R.J., Baker, M., Reiner, M. (eds.) Dialogue and Instruction, pp. 241–250. Springer, Heidelberg (1995)
Aust, H., Oerder, M., Seide, F., Steinbiss, V.: The Philips automatic train timetable information system. Speech Communication 17(3-4), 249–262 (1995)
Boye, J., Gustafson, J.: How to do dialogue in a fairy-tale world. In: A demo session paper at the sixth SIGdial Workshop on Discourse and Dialogue, Lisabon (2005) (forthcoming)
Boye, J., Gustafson, J., Wirén, M.: Robust spoken language understanding in a computer game. J. of Speech Communication,forthcoming special issue on spoken language understanding (Forthcoming)
Brennan, S.: Processes that shape conversation and their implications for computational linguistics. In: Proceedings, 38th Annual Meeting of the ACL, Hong Kong (2000)
Brennan, S., Hulteen, E.: Interaction and feedback in a spoken language system: a theoretical framework. Knowledge-Based Systems 8, 143–151 (1995)
Byron, D., Heeman, P.: Discourse Marker Use in Spoken Dialog. In: Proceedings of the 5th Eurospean Conference On Speech Communication and Technology, Rhodes, Greece (September 1997)
Cavazza, M., Charles, F., Mead, S.J.: Character-based interactive storytelling. IEEE Intelligent Systems, Special issue on AI in Interactive Entertainment, 17–24 (2002)
Cassell, J., Vilhjálmsson, H., Bickmore, T.: BEAT: The Behavior Expression Animation Toolkit. In: Proceedings of SIGGRAPH 2001, Los Angeles, CA, pp. 477–486 (2001)
Cassell, J., Stocky, T., Bickmore, T., Gao, Y., Nakano, Y., Ryokai, K., Tversky, D., Vaucelle, C., Vilhjlmsson, H.: MACK: Media lab Autonomous Conversational Kiosk. Imagina, Monte Carlo (2002)
Charles, F., Cavazza, M.: Exploring the scalability of character-based storytelling. In: Proc. ACM Joint conference on autonomous agents and multi-agent systems, New York, USA (2004)
Chi, D., Costa, M., Zhao, L., Badler, N.: The EMOTE Model for Effort and Shape. In: Proceedings of SIGGRAPH 2000, ACM Computer Graphics Annual Conference, New Orleans, Louisiana, July 23-28, pp. 173–182 (2000)
Clark, H.: Managing problems in speaking. Speech Communication 15, 243–250 (1994)
Colburn, A., Cohen, M., Drucker, S.: The Role of Eye Gaze in Avatar Mediated Conversational Interfaces. MSR-TR-2000-81. Microsoft Research (2000)
Ekman, P.: Emotion in the human face, New York. Cambridge University Press, Cambridge (1982)
Ekman, P.: About brows: Emotional and conversational signals. In: Cranach, M., von, F.K., Lepenies, W., Ploog, D. (eds.) Human Ethology: Claims and Limits of a New Discipline: Contributions to the Colloquium, pp. 169–202. Cambridge University Press, Cambridge (1979)
Gamma, E., Helm, R.: Design patterns: elements of reusable object-oriented software. Addison-Wesley Longman Publishing Co., Inc, Boston (1995)
Goodwin, C.: Conversational Organization: interaction between speakers and hearers. Academic Press, London (1981)
Grosz, B., Sidner, C.: Attention, Intention, and the Structure of Discourse. Computational Linguistics 12(3), 175–204 (1986)
Gustafson, J., Bell, L.: Speech technology on trial - Experiences from the system. Natural Language Engineering 6(3-4), 273–286 (2000)
Gustafson, J., Sjölander, K.: Voice creation for conversational fairy-tale characters. In: Proceedings of the 5th ISCA Speech Synthesis Workshop, Pittsburgh (2004)
Hayes-Roth, B.: Character-based Interactive Story Systems. IEEE Intelligent Systems and Their Applications 13(6), 12–15 (1998)
Kahneman, D.: Attention and Effort. Prentice–Hall, Englewood–Cliffs (1973)
Lam, D.: Tokamak Game Physics SDK (2004), http://www.tokamakphysics.com/
Martin, D., Cheyer, A., Moran, D.: The Open Agent Architecture: a framework for building distributed software systems. Applied Artificial Intelligence 13(1-2), 91–128 (1999)
Mateas, M., Stern, A.: Architecture, authorial idioms and early observations of the interactive drama Facade. Technical report CM-CS-02-198 (2002)
McCrae, R., Costa, P.: Toward a new generation of personality theories: Theoretical contexts for the five-factor model. In: Wiggins, J.S. (ed.) The five-factor model of personality: Theoretical perspectives, New York, Guilford, pp. 51–87 (1996)
Pelachaud, C., Prevost, S.: Sight and Sound: Generating Facial Expressions and Spoken Intonation from Context. In: Proceedings of the second ESCA Workshop on Speech Synthesis, New Paltz, NY, USA, September, pp. 216–219 (1994)
Pelachaud, C., Badler, N., Steedman, M.: Generating Facial Expressions for Speech. Cognitive Science 20(1), 1–46 (1996)
Traum, D.: Issues in multi-party dialogues. In: Dignum, F.P.M. (ed.) ACL 2003. LNCS (LNAI), vol. 2922, pp. 201–211. Springer, Heidelberg (2004)
Varanese, A., LaMothe, A.: Game scripting mastery. Premier Press (2003)
Young, R.M.: An overview of the Mimesis architecture: Integrating intelligent narrative control into an existing gaming environment. Working notes of the AAAI spring symposium on Artificial intelligence and interactive entertainment (2001)
Zue, V., Glass, J., Goodline, D., Leung, H., Phillips, M., Polifroni, J., Seneff, S.: Integration of speech recognition and natural language processing in the MIT voyager system. In: Proc. ICASSP 1991, Toronto (1991)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Gustafson, J., Boye, J., Fredriksson, M., Johanneson, L., Königsmann, J. (2005). Providing Computer Game Characters with Conversational Abilities. In: Panayiotopoulos, T., Gratch, J., Aylett, R., Ballin, D., Olivier, P., Rist, T. (eds) Intelligent Virtual Agents. IVA 2005. Lecture Notes in Computer Science(), vol 3661. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11550617_4
Download citation
DOI: https://doi.org/10.1007/11550617_4
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-28738-4
Online ISBN: 978-3-540-28739-1
eBook Packages: Computer ScienceComputer Science (R0)