Steven Dow
Blair MacIntyre
ABSTRACT
In this paper, we describe an augmented reality version of the acclaimed desktop-based interactive drama, Façade [18]. Few entertainment experiences combine interactive virtual characters, non-linear narrative, and unconstrained embodied interaction. In AR Façade players move through a physical apartment and use gestures and speech to interact with two autonomous characters, Trip and Grace. Our experience converting a desktop based game to augmented reality sheds light on the design challenges of developing mixed physical/virtual AI-based drama. We share our initial observations of players from a live demonstration and talk about our work moving forward.
- Bobick, A. F., Intille, S. S., Davis, J. W., Baird, F., Campbell, L. W., Ivanov, Y., Pinhanez, C. S., Schütte, A., and Wilson, A. The KidsRoom: A Perceptually-Based Interactive and Immersive Story Environment. PRESENCE: Teleoperators and Virtual Environments 8, 4 (Aug. 1999), 367--391. Google Scholar
Digital Library
- Cassell, J., Bickmore, T., Billinghurst, M., Campbell, L., Chang, K., Vilhjalmsson, H., and Yan, H. Embodiment in conversational interfaces: Rea. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI'99) (Pittsburgh, PA, USA). ACM Press, New York, NY, 1999. Google ScholarDigital Library
- Cavazza, M., Charles, F. and Mead, S. J. Interacting with Virtual Characters in Interactive Storytelling. In ACM Joint Conference on Autonomous Agents and Multi-Agent Systems, (Bologna, Italy). 2002, 318--325. Google ScholarDigital Library
- Charles, F., Cavazza, M., Mead, S. J., Martin, O., Nandi, A., and Marichal, X. Compelling Experiences in Mixed Reality Interactive Storytelling. In Proceedings of the ACM SIGCHI International Conference on Advances in Computer Entertainment Technology (ACE'04), (Singapore). ACM Press, New York, NY, 2004. Google ScholarDigital Library
- Cheok, A. D., Goh, K. H., Liu, W., Farbiz, V, Fong, S. W., Teo, S. L., Li, Y., and Yang, X. Human Pacman: A Mobile, Wide-area Entertainment System Based on Physical, Social, and Ubiquitous Computing. Personal Ubiquitous Computing, vol. 8, (2004), 71--81. Google ScholarDigital Library
- Corradini, A., Mehta, M., Bernsen, N. O. and Charfuelán, M. Animating an Interactive Conversational Character for an Educational Game System. In Proceedings of the International Conference on Intelligent User Interfaces (IUI'05), (San Diego, CA, USA). ACM Press, New York, NY, 2005, 183--190. Google ScholarDigital Library
- Flintham, M., Benford, S., Anastasi, R., Hemmings, V., Crabtree, A., Greenhalgh, C., Tandavanitj, N., Adams, M., and Row-Farr, J. Where On-line Meets on the Streets: Experiences with Mobile Mixed Reality Games. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI'03), (Ft. Lauderdale, FL, USA). ACM Press, New York, NY, 2003. Google ScholarDigital Library
- Hughes, C. E, Stapleton, C. B., Hughes, D. E., Smith, E. Mixed Reality in Education, Entertainment and Training: An Interdisciplinary Approach. IEEE Computer Graphics and Applications, 26(6) (2005), 24--30. Google ScholarDigital Library
- Johnson, W. L., Rickel, J. W. Animated Pedagogical Agents: Face-to-Face Interaction in Interactive Learning Environments. International Journal of Artificial Intelligence in Education, 11, (2000), 47--78.Google Scholar
- Knickmeyer, R. L. and Mateas, M. Preliminary Evaluation of the Interactive Drama Façade. In Extended Abstracts of the SIGGCHI Conference on Human Factors in Computing Systems (CHI'05), (Portland, OR, USA). ACM Press, New York, NY, 2005. Google ScholarDigital Library
- Koleva, B., Taylor, I., Benford, S., Fraser, M., Greenhalgh, C., Schndelbach, H., Lehn, D. v., Heath, V, Row-Farr, J., and Adams, M. Orchestrating a mixed reality performance. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI'01), (Seattle, WA, USA). ACM Press, New York, NY, 2001. Google ScholarDigital Library
- Laurel, B., Computers as Theatre. Addison-Wesley, 1991. Google ScholarDigital Library
- MacIntyre, B., and Bolter, J. D. Single-Narrative, Multiple Point-of-View Dramatic Experiences in Augmented Reality. In the Journal of Virtual Reality, 7(1) (December 2003), 10--16.Google ScholarDigital Library
- Magerko, B. and Laird, J. E. Building an Interactive Drama Architecture. In Proceedings of First International Conference on Technologies for Interactive Digital Storytelling and Entertainment, (Darmstadt, Germany). 2003, 226--237.Google Scholar
- Mateas, M., and Stern, A. Procedural Authorship: A Case-Study Of the Interactive Drama Façade. In Digital Arts and Culture (DAC), (Copenhagen, Denmark), November 2005.Google Scholar
- Mateas, M. and Stern, A. Natural Language Processing in Façade: Surface-text processing. In Technologies for Interactive Digital Storytelling and Entertainment (TIDSE), (Darmstadt, Germany). June 2004.Google Scholar
- Mateas, M. and Stern, A. A Behavior Language: Joint action and Behavioral Idioms. In H. Prendinger and M. Ishizuka (Eds), Life-like Characters. Tools, Affective Functions and Applications, Springer, 2004.Google Scholar
- Mateas, M. and Stern, A. Façade: An Experiment in Building a Fully-Realized Interactive Drama. In Game Developer's Conference: Game Design Track, (San Jose, CA). 2003.Google Scholar
- Maulsby, D., Greenberg, S., and Mander, R. Prototyping an intelligent agent through Wizard of Oz. In Proceedings of the Conference on Human Factors in Computing Systems (CHI'93), (Amsterdam, Netherlands). ACM Press, New York, NY, 1993. Google ScholarDigital Library
- Mori, M. On the Uncanny Valley. In Proceedings of the Humanoids-2005 workshop: Views of the Uncanny Valley, (Tsukuba, Japan). 5 December 2005.Google Scholar
- Murray, J., Hamlet on the Holodeck: The Future of Narrative in Cyberspace. New York, NY: The Free Press, 1997. Google ScholarDigital Library
- Riedl, M., Saretto, C. J., and Young, R. M. Managing interaction between users and agents in a multiagent storytelling environment. In Proceedings of the Second International Conference on Autonomous Agents and Multi-Agent Systems, June 2003. Google ScholarDigital Library
- Swartout, W., Hill, R., Gratch, J., Johnson, W., Kyriakakis, C., LaBore, C., Lindheim, R., Marsella, S., Miraglia, D., Moore, B., Morie, J., Rickel, J., Thiebaux, M., Tuch, L., Whitney, R., and Douglas, J. Toward the holodeck: Integrating graphics, sound, character and story. In Proceedings of Autonomous Agents, 2001. Google ScholarDigital Library
- Thomas, B., Close, B., Donoghue, J., Squires, J., Bondi, P. D., and Piekarski, W. First Person Indoor/Outdoor Augmented Reality Application: ARQuake. Personal Ubiquitous Computing, 6, (2002), 75--86. Google ScholarDigital Library
Index Terms
- Initial lessons from AR Façade, an interactive augmented reality drama
Recommendations
Presence and engagement in an interactive drama
CHI '07: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsIn this paper we present the results of a qualitative, empirical study exploring the impact of immersive technologies on presence and engagement, using the interactive drama Façade as the object of study. In this drama, players are situated in a married ...
AR façade: an augmented reality interactve drama
VRST '07: Proceedings of the 2007 ACM symposium on Virtual reality software and technologyOur demonstration presents AR Façade, a phyiscally embodied version of the interactive drama Façade, at the Beall Center in Irvine, CA. In this drama, players are situated in a married couple's apartment, and interact primarily through conversation with ...
Single-narrative, multiple point-of-view dramatic experiences in augmented reality
Researchers and practitioners working on story-based experiences in virtual environments often make two assumptions. One assumption is that, to be compelling, such experiences must enable the user to make significant choices that alter the outcome of ...
Comments