Abstract
We present a system supporting the re-use and re-purposing of captured video media for an interactive storytelling performance by a human storyteller. The system’s components are based on a philosophy of non-verbal embodied interaction for both media capture and media re-use. The system uses non-verbal interaction sensors during media capture and an augmented reality tangible interface supporting spatial and motion communications affordances during storytelling. We discuss the requirements for an interactive storytelling tool – media retrieval, media re-purposing, and expressive media control – and show how our system design and implementation support these requirements for interactive storytelling. Interface evaluation shows that our system enables communication for storytelling, in particular non-verbal spatial communication. We conclude with a discussion of how our storytelling system is being further developed.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Cavazza, M., Charles, F., Mead, S.J.: Emergent situations in interactive storytelling. In: Proceedings of 2002 ACM Symposium on Applied Computing, SAC 2002 (2002)
Osborn, B.A.: An Agent-Based Architecture For Generating Interactive Stories. PhD thesis, Naval Postgraduate School, Monterey, California (2002)
Grasbon, D., Braun, N.: A morphological approach to interactive storytelling. In: Fleischmann, M., Strauss, W. (eds.) Proceedings: CAST 2001 living in mixed realities, special issue of netzspannung.org/., The magazine for media production and inter-media research (2001)
Brooks, P.: Reading for the Plot, 5th edn. Harvard University Press, Boston (1998); Knopf, New York (1984) (Originally published)
Balabanovic, M., Chu, L.L., Wolff, G.J.: Storytelling with digital photographs. In: Proceedings of the SIGCHI conference on Human factors in computing systems, pp. 564–571. ACM Press, New York (2000)
Druin, A., Montemayor, J., Hendler, J., McAlister, B., Boltman, A., Fiterman, E., Plaisant, A., Kruskal, A., Olsen, H., Revett, I., Schwenn, T.P., Sumida, L., Wagner, R.: Designing PETS: A personal electronic teller of stories. In: Proceedings of CHI 1999, pp. 326–329 (1999)
Cassell, J., Ryokai, K.: Making space for voice: Technologies to support children’s fantasy and storytelling. Personal and Ubiquitous Computing 5, 169–190 (2001)
Bayon, V., Wilson, J.R., Stanton, D., Boltman, A.: Mixed reality storytelling environments. Virtual Reality 7, 54–63 (2003)
Davis, M.: Theoretical foundations for experiential systems design. In: Proceedings of the 2003 ACM SIGMM workshop on Experiential telepresence, Berkeley, California, pp. 45–52 (2003)
Dourish, P.: Where the Action Is - The Foundations of Embodied Interaction. Massachusetts Institute of Technology (2001)
Glassner, A.: Interactive Storytelling - Techniques for 21st Century Fiction. A.K. Peters, Natick (2004)
Appan, P., Sundaram, H., Birchfield, D.: Communicating everyday experiences. In: Proceedings of the 1st ACM workshop on Story representation, mechanism and context, pp. 17–24. ACM Press, New York (2004)
Sumi, Y.: Collaborative capturing of interactions by wearable/ubiquitous sensors. In: The 2nd CREST Workshop on Advanced Computing and Communicating Techniques for Wearable Information Playing, Panel, Killer Applications to Implement Wearable Information Playing Stations Used in Daily Life, Nara, Japan (2003)
Takahashi, M., Ito, S., Sumi, Y., Tsuchikawa, M., Kogure, K., Mase, K., Nishida, T.: A layered interpretation of human interaction captured by ubiquitous sensors. Presented at CARPE 2004, The First ACM Workshop on Continuous Archival and Retrieval of Personal Experiences, in conjunction with ACM Multimedia 2004 (2004)
Lew, M.: Live cinema: Designing an instrument for cinema editing as a live performance. In: Proceedings of the 2004 Conference on New Interfaces for Musical Expression (NIME 2004), Hamamatsu, Japan (2004)
Kato, H., Billinghurst, M.: Marker tracking and hmd calibration for a video-based augmented reality conferencing system. In: Proceedings of the 2nd International Workshop on Augmented Reality (IWAR 1999), San Francisco, USA (1999)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Lin, N., Mase, K., Sumi, Y., Toriyama, T. (2005). Enabling Communications-Based Interactive Storytelling Through a Tangible Mapping Approach. In: Subsol, G. (eds) Virtual Storytelling. Using Virtual Reality Technologies for Storytelling. ICVS 2005. Lecture Notes in Computer Science, vol 3805. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11590361_27
Download citation
DOI: https://doi.org/10.1007/11590361_27
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-30511-8
Online ISBN: 978-3-540-32285-6
eBook Packages: Computer ScienceComputer Science (R0)