Jae-Eun Shin
Woontack Woo
ABSTRACT
We report on a qualitative study in which 22 participants created Augmented Reality (AR) stories for outdoor cultural heritage sites. As storytelling is a crucial strategy for AR content aimed at providing meaningful experiences, the emphasis has been on what storytelling does, rather than how it is done, the end user’s needs prioritized over the author’s. To address this imbalance, we identify how recurring patterns in the spatial trajectories and narrative compositions of AR stories for cultural heritage sites are linked to the author’s intent and creative process: While authors tend to bind story arcs tightly to confined trajectories for narrative delivery, the need for spatial exploration results in thematic content mapped loosely onto encompassing trajectories. Based on our analysis, we present design recommendations for site-specific AR storytelling tools that can support authors in delivering their intent while leveraging the placeness of cultural heritage sites as a creative resource.
Footnotes
Supplemental Material
- Ronald Azuma. 2015. Location-Based Mixed and Augmented Reality Storytelling. In Fundamentals of Wearable Computers and Augmented Reality. CRC Press, 259–276.Google Scholar
- Ronald Azuma. 2016. The most important challenge facing augmented reality. Presence: Teleoperators and Virtual Environments 25, 3(2016), 234–238.Google ScholarDigital Library
- Evan Barba and Ramon Zamora Marroquin. 2017. A primer on spatial scale and its application to mixed reality. In 2017 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE, 100–110.Google ScholarCross Ref
- Helena Barbas and Nuno Correia. 2006. Documenting InStory–Mobile Storytelling in a Cultural Heritage Environment. In ECAI-17th European Conference on Artificial Intelligence-First European Workshop on Intelligent Technologies. Luciana Bordoni, Antonio Massimo Zancanaro-Universidade de Trento, 6–12.Google Scholar
- Roland Barthes. 1977. Image-music-text. Macmillan.Google Scholar
- Steve Benford, Gabriella Giannachi, Boriana Koleva, and Tom Rodden. 2009. From interaction to trajectories: designing coherent journeys through user experiences. In Proceedings of the SIGCHI conference on human factors in computing systems. 709–718.Google ScholarDigital Library
- Jay David Bolter, Richard Grusin, and Richard A Grusin. 2000. Remediation: Understanding new media. MIT Press.Google ScholarDigital Library
- Jay David Bolter and Richard A Grusin. 1996. Remediation. Configurations 4, 3 (1996), 311–358.Google ScholarCross Ref
- Stefan Boschert and Roland Rosen. 2016. Digital twin—the simulation aspect. In Mechatronic futures. Springer, 59–74.Google Scholar
- Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitative research in psychology 3, 2 (2006), 77–101.Google Scholar
- Brian Carroll. 2010. Writing for digital media. Routledge.Google Scholar
- Marc Cavazza, Olivier Martin, Fred Charles, Xavier Marichal, and Steven J Mead. 2003. User interaction in mixed reality interactive storytelling. In The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings.IEEE, 304–305.Google ScholarCross Ref
- Nuno Correia, Luís Alves, Helder Correia, Luis Romero, Carmen Morgado, Luís Soares, José C Cunha, Teresa Romão, A Eduardo Dias, and Joaquim A Jorge. 2005. InStory: a system for mobile information access, storytelling and gaming activities in physical spaces. In Proceedings of the 2005 ACM SIGCHI International Conference on Advances in computer entertainment technology. ACM, 102–109.Google ScholarDigital Library
- John W Creswell and Cheryl N Poth. 2016. Qualitative inquiry and research design: Choosing among five approaches. Sage publications.Google Scholar
- David Crow, Pengkai Pan, Lilly Kam, and Glorianna Davenport. 2003. M-views: A system for location-based storytelling. In ACM UbiComp.Google Scholar
- Areti Damala and Nenad Stojanovic. 2012. Tailoring the Adaptive Augmented Reality (A 2 R) museum visit: Identifying Cultural Heritage professionals’ motivations and needs. In 2012 IEEE international symposium on mixed and augmented reality-arts, media, and humanities (ISMAR-AMH). IEEE, 71–80.Google ScholarCross Ref
- Athanasios M. Demiris, Vassilios Vlahakis, and Nicolaos Ioannidis. 2006. System and Infrastructure Considerations for the Successful Introduction of Augmented Reality Guides in Cultural Heritage Sites. In Proceedings of the ACM Symposium on Virtual Reality Software and Technology (Limassol, Cyprus) (VRST ’06). Association for Computing Machinery, 141–144. https://doi.org/10.1145/1180495.1180524Google ScholarDigital Library
- Paul Dourish. 2006. Re-space-ing place: " place" and" space" ten years on. In Proceedings of the 2006 20th anniversary conference on Computer supported cooperative work. 299–308.Google ScholarDigital Library
- GJ Elliott, E Jones, and P Barker. 2002. A grounded theory approach to modelling learnability of hypermedia authoring tools. Interacting with Computers 14, 5 (2002), 547–574.Google ScholarCross Ref
- Jason Farman. 2013. Site-specificity, pervasive computing, and the reading interface. In The mobile story. Routledge, 15–28.Google Scholar
- Jason Farman. 2015. Stories, spaces, and bodies: The production of embodied space through mobile media storytelling. Communication Research and Practice 1, 2 (2015), 101–116.Google ScholarCross Ref
- Kate Fernie. 2015. LoCloud: local cultural heritage online and in the cloud. Uncommon Culture 6, 2 (2015), 83–87.Google Scholar
- Christos Fidas, Christos Sintoris, Nikoleta Yiannoutsou, and Nikolaos Avouris. 2015. A survey on tools for end user authoring of mobile applications for cultural heritage. In Information, Intelligence, Systems and Applications (IISA), 2015 6th International Conference on. IEEE, 1–5.Google Scholar
- Jacqueline Floch and Shanshan Jiang. 2015. One place, many stories digital storytelling for cultural heritage discovery in the landscape. In 2015 Digital Heritage, Vol. 2. IEEE, 503–510.Google Scholar
- F Fritz, A Susperregui, and Maria Teresa Linaza. 2005. Enhancing cultural tourism experiences with augmented reality technologies. 6th International Symposium on Virtual Reality, Archaeology and Cultural Heritage (VAST).Google Scholar
- Franca Garzotto and Luca Megale. 2006. CHEF: a user centered perspective for C ultural H eritage E nterprise F rameworks. In Proceedings of the working conference on Advanced visual interfaces. ACM, 293–301.Google ScholarDigital Library
- Jonathan Gray and Derek Johnson. 2013. A companion to media authorship. John Wiley & Sons.Google Scholar
- Taejin Ha, Younsung Kim, Eunseok Kim, Kihong Kim, Sangmin Lim, Seungmo Hong, Jeain Kim, Sunhyuck Kim, Junghwa Kim, and Woontack Woo. 2015. K-culture time machine: development of creation and provision technology for time-space-connected cultural contents. In International Conference on Human Interface and the Management of Information. Springer, 428–435.Google ScholarCross Ref
- Steve Harrison and Paul Dourish. 1996. Re-place-ing space: the roles of place and space in collaborative systems. In Proceedings of the 1996 ACM conference on Computer supported cooperative work. 67–76.Google ScholarDigital Library
- David C Harvey. 2015. Heritage and scale: settings, boundaries and relations. International Journal of Heritage Studies 21, 6 (2015), 577–593.Google ScholarCross Ref
- Charles E Hughes, Christopher B Stapleton, Darin E Hughes, and Eileen M Smith. 2005. Mixed reality in education, entertainment, and training. IEEE computer graphics and applications 25, 6 (2005), 24–30.Google ScholarDigital Library
- Tazim Jamal* and Steve Hill. 2004. Developing a framework for indicators of authenticity: The place and space of cultural and heritage tourism. Asia Pacific Journal of Tourism Research 9, 4 (2004), 353–372.Google ScholarCross Ref
- A Kampa and U Spierling. 2016. Requirements and solutions for location-based augmented reality storytelling in an outdoor museum. Culture and Computer Science–Augmented Reality, Proceedings of KUI (2016), 105–117.Google Scholar
- Antonia Kampa and Ulrike Spierling. 2017. Smart Authoring for Location-based Augmented Reality Storytelling Applications. In INFORMATIK 2017, Maximilian Eibl and Martin Gaedke (Eds.). Gesellschaft für Informatik, Bonn, 915–922.Google Scholar
- Eunseok Kim, Jungwha Kim, and Woontack Woo. 2015. Metadata schema for context-aware augmented reality applications in cultural heritage domain. In Digital Heritage, 2015, Vol. 2. IEEE, 283–290.Google Scholar
- Eunseok Kim and Woontack Woo. 2015. Augmented reality based space-telling framework for archeological site tours. J. HCI Korea 14, 4 (2015), 1–10.Google Scholar
- Hartmut Koenitz, Gabriele Ferri, Mads Haahr, Diğdem Sezen, and Tonguç İbrahim Sezen. 2015. Interactive digital narrative: History, theory and practice. Routledge.Google Scholar
- Chris D Kounavis, Anna E Kasimati, and Efpraxia D Zamani. 2012. Enhancing the tourism experience through mobile augmented reality: Challenges and prospects. International Journal of Engineering Business Management 4 (2012), 10.Google ScholarCross Ref
- Gunnar Liestøl. 2018. Story and storage–narrative theory as a tool for creativity in augmented reality storytelling. Virtual Creativity 8, 1 (2018), 75–89.Google ScholarCross Ref
- Vincenzo Lombardo and Rossana Damiano. 2012. Storytelling on mobile devices for cultural heritage. New Review of Hypermedia and Multimedia 18, 1-2 (2012), 11–35.Google ScholarDigital Library
- Blair MacIntyre, Jay David Bolter, Emmanuel Moreno, and Brendan Hannigan. 2001. Augmented reality as a new media experience. In Proceedings IEEE and ACM International Symposium on Augmented Reality. IEEE, 197–206.Google ScholarCross Ref
- Blair MacIntyre, Maribeth Gandy, Steven Dow, and Jay David Bolter. 2004. DART: a toolkit for rapid design exploration of augmented reality experiences. In Proceedings of the 17th annual ACM symposium on User interface software and technology. 197–206.Google ScholarDigital Library
- Wendy E Mackay. 1998. Augmented reality: linking real and virtual worlds: a new paradigm for interacting with computers. In Proceedings of the working conference on Advanced visual interfaces. 13–21.Google ScholarDigital Library
- Nadia Magnenat-Thalmann and George Papagiannakis. 2005. Virtual worlds and augmented reality in cultural heritage applications. Recording, modeling and visualization of cultural heritage (2005), 419–430.Google Scholar
- Michela Mortara, Chiara Eva Catalano, Francesco Bellotti, Giusy Fiucci, Minica Houry-Panchetti, and Panagiotis Petridis. 2014. Learning cultural heritage by serious games. Journal of Cultural Heritage 15, 3 (2014), 318–325.Google ScholarCross Ref
- Michael J Muller and Sandra Kogan. 2010. Grounded theory method in HCI and CSCW. Cambridge: IBM Center for Social Software(2010), 1–46.Google Scholar
- Janet Horowitz Murray. 2017. Hamlet on the holodeck: The future of narrative in cyberspace. MIT press.Google ScholarDigital Library
- Yanghee Nam. 2015. Designing interactive narratives for mobile augmented reality. Cluster Computing 18, 1 (2015), 309–320.Google ScholarDigital Library
- Michael Nebeling. 2022. XR tools and where they are taking us: characterizing the evolving research on augmented, virtual, and mixed reality prototyping and development tools. XRDS: Crossroads, The ACM Magazine for Students 29, 1 (2022), 32–38.Google ScholarDigital Library
- Zakiah Noh, Mohd Shahrizal Sunar, and Zhigeng Pan. 2009. A review on augmented reality for virtual heritage system. In International Conference on Technologies for E-Learning and Digital Entertainment. Springer, 50–61.Google ScholarDigital Library
- Augusto Palombini. 2017. Storytelling and telling history. Towards a grammar of narratives for Cultural Heritage dissemination in the Digital Era. Journal of Cultural Heritage 24 (2017), 134–139.Google ScholarCross Ref
- Hyerim Park, Maryam Shakeri, Ikbeom Jeon, Jangyoon Kim, Abolghasem Sadeghi-Niaraki, and Woontack Woo. 2022. Spatial transition management for improving outdoor cinematic augmented reality experience of the TV show. Virtual Reality (2022), 1–19.Google Scholar
- Hyerim Park and Woontack Woo. 2017. Metadata design for AR spacetelling experience using movie clips. In Consumer Electronics (ICCE), 2017 IEEE International Conference on. IEEE, 388–391.Google ScholarCross Ref
- Johanna Pirker, Christian Gütl, Patrick Weiner, Victor Manuel Garcia-Barrios, and Melanie Tomintz. 2014. Location-based Mobile Application Creator creating educational mobile scavenger hunts. In 2014 International Conference on Interactive Mobile Communication Technologies and Learning (IMCL2014). IEEE, 160–164.Google ScholarCross Ref
- Eric Ragan, Curtis Wilkes, Doug A Bowman, and Tobias Hollerer. 2009. Simulation of augmented reality systems in purely virtual environments. In 2009 IEEE Virtual Reality Conference. IEEE, 287–288.Google ScholarDigital Library
- Irina Rajewsky. 2005. Intermediality, intertextuality, and remediation: A literary perspective on intermediality. Intermédialités: histoire et théorie des arts, des lettres et des techniques/Intermediality: History and Theory of the Arts, Literature and Technologies6(2005), 43–64.Google Scholar
- George E Raptis and Nikolaos M Avouris. 2019. Supporting Designers in Creating Cognition-centered Personalized Cultural Heritage Activities. In Adjunct Publication of the 27th Conference on User Modeling, Adaptation and Personalization. 407–411.Google Scholar
- Edward Relph. 1976. Place and placelessness. Vol. 67. Pion London.Google Scholar
- Selma Rizvic. 2014. Story guided virtual cultural heritage applications. Journal of Interactive Humanities 2, 1 (2014), 2.Google ScholarCross Ref
- Marie-Laure Ryan, Kenneth Foote, and Maoz Azaryahu. 2016. Narrating space/spatializing narrative: Where narrative theory and geography meet. The Ohio State University Press.Google Scholar
- David Seamon and Jacob Sowers. 2008. Place and Placelessness, Edward Relph. Key texts in human geography 43 (2008), 51.Google Scholar
- Hitesh Nidhi Sharma, Sultan A Alharthi, Igor Dolgov, and Zachary O Toups. 2017. A framework supporting selecting space to make place in spatial mixed reality play. In Proceedings of the Annual Symposium on Computer-Human Interaction in Play. 83–100.Google ScholarDigital Library
- Jae-eun Shin, Hyerim Park, and Woontack Woo. 2017. Connecting the Dots: Enhancing the Usability of Indexed Multimedia Data for AR Cultural Heritage Applications through Storytelling. In Proceedings of the 15th International Workshop on Content-Based Multimedia Indexing. ACM, 11.Google Scholar
- Jae-eun Shin and Woontack Woo. 2018. Design guidelines for a location-based digital heritage storytelling tool to support author intent. In 2018 3rd Digital Heritage International Congress (DigitalHERITAGE) held jointly with 2018 24th International Conference on Virtual Systems & Multimedia (VSMM 2018). IEEE, 1–8.Google Scholar
- Christos Sintoris, Nikoleta Yiannoutsou, Alejandro Ortega-Arranz, Rodrigo López-Romero, Menita Masoura, Nikolaos Avouris, and Yannis Dimitriadis. 2014. TaggingCreaditor: A tool to create and share content for location-based games for learning. In Proc. 8th International Conference on Interactive Mobile Communication Technologies and Learning, IMCL2014.Google ScholarCross Ref
- Marilena Vecco. 2010. A definition of cultural heritage: From the tangible to the intangible. Journal of Cultural Heritage 11, 3 (2010), 321–324.Google ScholarCross Ref
- Vassilios Vlahakis, M Ioannidis, John Karigiannis, Manolis Tsotros, Michael Gounaris, Didier Stricker, Tim Gleue, Patrick Daehne, and Luís Almeida. 2002. Archeoguide: an augmented reality guide for archaeological sites. IEEE Computer Graphics and Applications 22, 5 (2002), 52–60.Google ScholarDigital Library
- Zeyu Wang, Cuong Nguyen, Paul Asente, and Julie Dorsey. 2021. DistanciAR: Authoring Site-Specific Augmented Reality Experiences for Remote Environments. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–12.Google ScholarDigital Library
- Qimo Zhang, Annika Hinze, and Nicholas Vanderschantz. 2020. Narrative Navigation: Visualizing Story Order and Locations in Augmented Reality. In Proceedings of the ACM/IEEE Joint Conference on Digital Libraries in 2020. 541–542.Google ScholarDigital Library
Index Terms
- How Space is Told: Linking Trajectory, Narrative, and Intent in Augmented Reality Storytelling for Cultural Heritage Sites
Recommendations
Virtual and augmented reality for cultural computing and heritage: a case study of virtual exploration of underwater archaeological sites (preprint)
Special Issue on Cultural TechnologyThe paper presents different issues dealing with both the preservation of cultural heritage using virtual reality (VR) and augmented reality (AR) technologies in a cultural context. While the VR/AR technologies are mentioned, the attention is paid to ...
Virtual and augmented reality for cultural computing and heritage: a case study of virtual exploration of underwater archaeological sites (preprint)
The paper presents different issues dealing with both the preservation of cultural heritage using virtual reality (VR) and augmented reality (AR) technologies in a cultural context. While the VR/AR technologies are mentioned, the attention is paid to ...
Object-focused mixed reality storytelling: technology-driven content creation and dissemination for engaging user experiences
PCI '18: Proceedings of the 22nd Pan-Hellenic Conference on InformaticsIn this paper we present the creation and deployment of a concerted set of Mixed Reality Technologies designed for creating engaging public experiences and enhanced storytelling opportunities focused on artefacts. Under the title of the Mixed Reality ...
Comments