Abstract
User interaction with virtual agents generally takes place in virtual environments in which there is clear separation between the virtual actors and the user, due to the fact that in most cases, the user is in some way external to the virtual world. In Mixed-Reality Interactive Storytelling, the user’s video image is captured in real time and inserted into a virtual world populated by autonomous synthetic actors with which the user interacts. The user in turn watches the composite world projected on a large screen, following a ”magic mirror” metaphor. This context leads to re-investigating the techniques by which the user interacts with virtual actors, as well as exploring specific research problems. In this paper, we discuss some specificities of user interaction with virtual actors in Mixed Reality Interactive Storytelling. After a brief introduction to our system’s architecture and the example scenario supporting our experiments, we describe various techniques supporting multi-modal interaction with virtual actors.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Barthes, R.: Introductionà l’Analyse Structurale des Récits (in French). Communications 8, 1–27 (1966)
Cavazza, M., Charles, F., Mead, S.J.: Character-based Interactive Storytelling. IEEE Intelligent Systems, special issue on AI in Interactive Entertainment, 17-24 (2002)
Cavazza, M., Charles, F., Mead, S.J.: Under The Influence: Using Natural Language in Interactive Storytelling. In: 1st International Workshop on Entertainment Computing, IFIP Conference Proceedings, vol. 240, pp. 3–11. Kluwer, Dordrecht (2002)
Mead, S.J., Cavazza, M., Charles, F.: Influential Words: Natural Language in Interactive Storytelling. In: 10th International Conference on Human-Computer Interaction, Crete, Greece, vol. 2, pp. 741–745 (2003)
Marichal, X., Umeda, T.: Real-Time Segmentation of Video Objects for Mixed-Reality Interactive Applications. In: Proceedings of the SPIE’s Visual Communications and Image Processing (VCIP 2003) International Conference, Lugano, Switzerland (2003)
Swartout, W., Hill, R., Gratch, J., Johnson, W.L., Kyriakakis, C., LaBore, C., Lindheim, R., Marsella, S., Miraglia, D., Moore, B., Morie, J., Rickel, J., Thiebaux, M., Tuch, L., Whitney, R., Douglas, J.: Toward the Holodeck: Integrating Graphics, Sound, Character and Story. In: Proceedings of the Autonomous Agents 2001 Conference (2001)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2003 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Cavazza, M., Martin, O., Charles, F., Mead, S.J., Marichal, X. (2003). Interacting with Virtual Agents in Mixed Reality Interactive Storytelling. In: Rist, T., Aylett, R.S., Ballin, D., Rickel, J. (eds) Intelligent Virtual Agents. IVA 2003. Lecture Notes in Computer Science(), vol 2792. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-39396-2_39
Download citation
DOI: https://doi.org/10.1007/978-3-540-39396-2_39
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-20003-1
Online ISBN: 978-3-540-39396-2
eBook Packages: Springer Book Archive