Skip to main content
SpringerLink
Log in
Book cover

International Conference on Interactive Digital Storytelling

ICIDS 2022: Interactive Storytelling pp 270–291Cite as

Supporting Spatial Thinking in Augmented Reality Narrative: A Field Study

  • Conference paper
  • First Online:

  • 1817 Accesses

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 13762))

Abstract

Immersive augmented reality (AR) is an exciting medium for locative narrative. Immersive AR experiences are largely custom-made and site-specific, however: we lack generic tools that help authors consider interactions between physical layout, viewer perspective, and story progression, for specific sites or for locations unknown to the author. In this paper we evaluate Story CreatAR, a tool that incorporates spatial analysis techniques used in architecture, planning, and social sciences to help authors construct and deploy immersive AR narratives. We worked with three authors over several months, moving from script writing and story graph creation to deployment using the tool. We conduct a thematic analysis of each author’s actions, comments, generated artifacts, and interview responses. Authors faced a steep learning curve, sometimes misinterpreting spatial properties, and found it difficult to consider multi-site deployment. Despite these challenges, Story CreatAR helped authors consider the impact of layout on their stories in ways their scripts and graphs did not, and authors identified several additional areas for spatial analysis support, suggesting that tools like Story CreatAR are a promising direction for producing immersive AR narratives. Reflecting on author experiences, we identify a number of features that such tools should provide.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Singh, A.: Story creatar: a toolkit for spatially-adaptive augmented reality storytelling. In: 2021 IEEE Virtual Reality and 3D User Interfaces (VR), pp. 713–722, Los Alamitos, CA, USA. IEEE Computer Society, Apr (2021)

    Google Scholar 

  2. Magic leap. https://www.magicleap.com/en-us/magic-leap-1. Accessed 12 Jan 2022

  3. Microsoft. Microsoft hololens: mixed reality technology for business. https://www.microsoft.com/en-us/hololens. Accessed 12 Jan 2022

  4. Dzebic, V.: Isovist analysis as a tool for capturing responses towards the built environment (1970)

    Google Scholar 

  5. Bafna, S.: Space syntax: a brief introduction to its logic and analytical techniques - sonit bafna (2003)

    Google Scholar 

  6. Peponis, J., Wineman, J., Rashid, M., Kim, S., Bafna, S.: On the description of shape and spatial configuration inside buildings: convex partitions and their local properties. Environ. Plann. B. Plann. Des. 24(5), 761–781 (1997)

    Article  Google Scholar 

  7. Edward, T.: Hall. The hidden dimension, Peter Smith Pub (1992)

    Google Scholar 

  8. Tong, L., Serna, A., Pageaud, S., George, S., Tabard, A.: Its not how you stand, its how you move. In: Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services (2016)

    Google Scholar 

  9. Quest, O.: 2: our most advanced new all-in-one VR headset (2021)

    Google Scholar 

  10. Dooley, K.: Storytelling with virtual reality in 360-degrees: a new screen grammar. Stud. Australas. Cinema 11, 1–11 (2017)

    Google Scholar 

  11. Struck, G., Böse, R., Spierling, U.: Trying to get trapped in the past - exploring the illusion of presence in virtual drama

    Google Scholar 

  12. Benford, S., Giannachi, G., Koleva, B., Rodden, T.: From interaction to trajectories: designing coherent journeys through user experiences, pp. 709–718. Association for Computing Machinery, New York, NY, USA (2009)

    Google Scholar 

  13. Cardona-Rivera, R.E., Zagal, J.P., Debus, M.S.: GFI: a formal approach to narrative design and game research. In: Bosser, A.-G., Millard, D.E., Hargood, C. (eds.) ICIDS 2020. LNCS, vol. 12497, pp. 133–148. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-62516-0_13

    Chapter  Google Scholar 

  14. Barba, E.: Toward a language of mixed reality in the continuity style. Convergence Int. J. Res. into New Media Technol. 20, 41–54 (2013)

    Google Scholar 

  15. Krauss, V., Boden, A., Oppermann, L., Reiners, R.: Current Practices, Challenges, and Design Implications for Collaborative AR/VR Application Development. Association for Computing Machinery, New York, NY, USA (2021)

    Google Scholar 

  16. Longford, M.: Territory as interface: design for mobile experiences

    Google Scholar 

  17. Azuma, R.: Location-based mixed and augmented reality storytelling. Fundamentals of Wearable Computers and Augmented Reality, 278–295 (2015)

    Google Scholar 

  18. Hargood, C., Charles, F., Millard, D.: Intelligent generative locative hyperstructure. 238–241 (2018)

    Google Scholar 

  19. Packer, H.S., Hargood, C., Howard, Y., Papadopoulos, P., Millard, D.E.: Developing a writer’s toolkit for interactive locative storytelling

    Google Scholar 

  20. Dooley, K.: Scripting the virtual: formats and development paths for recent Australian narrative 360-degree virtual reality projects. J. Screenwriting 9, 175–189 (2018)

    Article  Google Scholar 

  21. Hargood, C., Weal, M.J., Millard, D.E.: The storyplaces platform: building a web-based locative hypertext system. In: Proceedings of the 29th on Hypertext and Social Media (2018)

    Google Scholar 

  22. Al-Sayed, K., Turner, A., Hillier, B., Iida, S., Penn, A.: Space syntax methodology. Bartlett School of Architecture, UCL, London, England, 4th edition (2014)

    Google Scholar 

  23. Space syntax. https://www.spacesyntax.online/. Accessed 12 Jan 2022

  24. SpaceGroupUCL. depthmapx. https://github.com/SpaceGroupUCL/depthmapX (2021)

  25. Cansik. cansik/architectural-floor-plan: afplan is an architectural floor plan analysis and recognition system to create extended plans for building services

    Google Scholar 

  26. Burgoon, J.K., Kendon, A.: Conducting interaction: patterns of behavior in focused encounters. Contemp. Sociol. 21(2), 256 (1992)

    Article  Google Scholar 

  27. Marquardt, N., Hinckley, K., Greenberg, S.: Cross-device interaction via micro-mobility and f-formations. In: Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology - UIST 12 (2012)

    Google Scholar 

  28. Ben Salem University of Plymouth, Ben Salem, University of Plymouth, Nic Earle University of Plymouth, Nic Earle, Contributor MetricsExpand All Ben Salem University of Plymouth Publication Years 2000 2000Publication counts1Available for Download1Citation count24Downloads (cumulative)1, and Ben Salem University of Plymouth Publication Years2000 2000Publication counts1Available for Download1Citation count24Downloads (cumulative)1. Designing a non-verbal language for expressive avatars (2000)

    Google Scholar 

  29. Kang Hoon Lee Seoul National University, Kang Hoon Lee, Seoul National University, Seoul National UniversityView Profile, Myung Geol Choi Seoul National University, Myung Geol Choi, Qyoun Hong Seoul National University, Qyoun Hong, Jehee Lee Seoul National University, Jehee Lee, et al. Group behavior from video: a data-driven approach to crowd simulation (2007)

    Google Scholar 

  30. Pedica, C., Vilhjálmsson H.H.: Spontaneous avatar behavior for human territoriality. Intelligent Virtual Agents Lecture Notes in Computer Science, pp. 344–357 (2009)

    Google Scholar 

  31. Greenberg, S., Hornbæk, K., Quigley, A., Reiterer, H., Rädle, R.: Proxemics in human-computer interaction (2014)

    Google Scholar 

  32. Annett, M., Grossman, T., Wigdor, D., Fitzmaurice, G.: Medusa: a proximity-aware multi-touch tabletop. In: Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology, UIST ’11, page 337–346, New York, NY, USA. Association for Computing Machinery (2011)

    Google Scholar 

  33. Marquardt, N., Diaz-Marino, R., Boring, S., Greenberg, S.: The proximity toolkit: prototyping proxemic interactions in ubiquitous computing ecologies. In: Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology, UIST ’11, pp. 315–326, New York, NY, USA. Association for Computing Machinery (2011)

    Google Scholar 

  34. Ballendat, T., Marquardt, N., Greenberg, S.: Proxemic interaction: designing for a proximity and orientation-aware environment. In: ACM International Conference on Interactive Tabletops and Surfaces, ITS ’10, page 121–130, New York, NY, USA. Association for Computing Machinery (2010)

    Google Scholar 

  35. Greenberg, S., Marquardt, N., Ballendat, T., Diaz-Marino, R., Wang, M.: Proxemic interactions: the new ubicomp?, Jan 2011

    Google Scholar 

  36. Alnusayri, M., Hu, G., Alghamdi, E., Reilly, D.: Proxemicui. In: Proceedings of the 8th ACM SIGCHI Symposium on Engineering Interactive Computing Systems - EICS 16, 2016

    Google Scholar 

  37. Joan Llobera Universitat de Barcelona, Joan Llobera, Universitat de Barcelona, Bernhard Spanlang Universitat de Barcelona, Bernhard Spanlang, Giulio Ruffini Starlab Barcelona, Giulio Ruffini, Starlab Barcelona, Mel Slater ICREA-Universitat de Barcelona, Mel Slater, et al. Proxemics with multiple dynamic characters in an immersive virtual environment, Oct 2010

    Google Scholar 

  38. Gampe, J.: Interactive narration within audio augmented realities. In: Iurgel, I.A., Zagalo, N., Petta, P. (eds.) ICIDS 2009. LNCS, vol. 5915, pp. 298–303. Springer, Heidelberg (2009). https://doi.org/10.1007/978-3-642-10643-9_34

    Chapter  Google Scholar 

  39. Holappa, J., Heikkinen, T., Roininen, E.: Martians from outer Space-experimenting with location-aware cooperative multiplayer gaming on public displays (2013)

    Google Scholar 

  40. Centieiro, P., Romão, T., Dias, A.E.: A location-based multiplayer mobile game to encourage pro-environmental behaviours (2011)

    Google Scholar 

  41. Ardito, C., Buono, P., Costabile, M., Lanzilotti, R., Pederson, T.: Mobile games to foster the learning of history at archaeological sites, pp. 81–86, 10 (2007)

    Google Scholar 

  42. Zeffiro, A.: A location of one’s own: a genealogy of locative media. Convergence Int. J. Res. into New Media Technol. 18, 249–266 (2012)

    Google Scholar 

  43. Know your bristol (2013)

    Google Scholar 

  44. Stenton, S.P., et al.: Mediascapes: context-aware multimedia experiences. IEEE Multimedia 14(3), 98–105 (2007)

    Article  Google Scholar 

  45. Treasuremapper (2011)

    Google Scholar 

  46. Lar - locative augmented reality unity3D tooolkit, May (2020)

    Google Scholar 

  47. Millard, D.E., Hargood, C.: Tiree tales: a co-operative inquiry into the poetics of location-based narrative. In: Proceedings of the 28th ACM Conference on Hypertext and Social Media, HT ’17, pp. 15–24, New York, NY, USA. Association for Computing Machinery (2017)

    Google Scholar 

  48. Tiago, J., Jacob, P.N., Coelho, N.F.: Issues in the development of location-based games. Int. J. Comput. Games Technol. (2011)

    Google Scholar 

  49. Hargood, C., Charles, F., Millard, D.E.: Intelligent generative locative hyperstructure. In: Proceedings of the 29th on Hypertext and Social Media, HT ’18, pp. 238–241, New York, NY, USA. Association for Computing Machinery (2018)

    Google Scholar 

  50. Valentina Nisi, Enrico Costanza, and Mara Dionisio. Placing location-based narratives in context through a narrator and visual markers. Interacting with Computers, 2016

    Google Scholar 

  51. Bala, P., Dionisio, M., Nisi, V., Nunes, N.: IVRUX: a tool for analyzing immersive narratives in virtual reality, pp. 3–11 (2016)

    Google Scholar 

  52. Barba, E.: Toward a language of mixed reality in the continuity style. Convergence 20(1), 41–54 (2014)

    Article  Google Scholar 

  53. Rose, M.: The immersive turn: hype and hope in the emergence of virtual reality as a nonfiction platform. Stud. Doc. Film 12(2), 132–149 (2018)

    Article  Google Scholar 

  54. Elsaesser, T.: Pushing the contradictions of the digital: ‘virtual reality’ and ‘interactive narrative’ as oxymorons between narrative and gaming. New Rev. of Film Television Stud. 12(3), 295–311 (2014)

    Article  Google Scholar 

  55. Abawi, D.F., Reinhold, S., Dörner, R.: A toolkit for authoring non-linear storytelling environments using mixed reality. In: TIDSE (2004)

    Google Scholar 

  56. Shin, J., Kim, H., Parker, C., Kim, H., Oh, S., Woo, W.: Is any room really ok? the effect of room size and furniture on presence, narrative engagement, and usability during a space-adaptive augmented reality game. In: 2019 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), pp. 135–144 (2019)

    Google Scholar 

  57. Choi, S.-K., Kim, D.-H., Kim, Y.-O.: A study on the placement of game objects using space syntax. J. Korea Game Soc. 12(5), 43–56 (2012)

    Article  Google Scholar 

  58. Reilly, D., et al.: Using space syntax to enable walkable AR experiences. In: 2020 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct) (2020)

    Google Scholar 

  59. Gal, R., Shapira, L., Ofek, E., Kohli, P.: Flare: fast layout for augmented reality applications. In: Mixed and Augmented Reality (ISMAR), 2014 IEEE International Symposium on. IEEE, September 2014

    Google Scholar 

  60. Kán, P., Kaufmann, H.: Automatic furniture arrangement using greedy cost minimization. In: 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), pp. 491–498 (2018)

    Google Scholar 

  61. Marwecki, S., Baudisch, P.: Scenograph: fitting real-walking VR experiences into various tracking volumes. In: Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology, UIST ’18, pp. 511–520. Association for Computing Machinery, New York, NY, USA (2018)

    Google Scholar 

  62. Cheng, L.-P., Ofek, E., Holz, C., Wilson, A.D.: VRoamer: generating on-the-fly VR experiences while walking inside large, unknown real-world building environments. In: 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), pp. 359–366 (2019)

    Google Scholar 

  63. Yang, J., Holz, C., Ofek, E., Wilson, A.: Dreamwalker: substituting real-world walking experiences with a virtual reality. In: User Interface Software and Technology (UIST) 2019. ACM, October (2019)

    Google Scholar 

  64. Unity Technologies

    Google Scholar 

  65. Microsoft. Microsoft rocketbox avatar library. https://github.com/microsoft/Microsoft-Rocketbox (2020)

  66. Microsoft teams

    Google Scholar 

  67. An online whiteboard and visual collaboration platform for teamwork: Miro

    Google Scholar 

  68. Virginia Braun and Victoria Clarke. Thematic analysis., pp. 57–71 (2012)

    Google Scholar 

  69. Hallgren, K.: Computing inter-rater reliability for observational data: an overview and tutorial. Tutorials Quantit. Methods Psychol. 8, 23–34 (2012)

    Article  Google Scholar 

  70. Social and technical challenges to the use of space syntax methodologies as

    Google Scholar 

  71. Benedikt, M.: To take hold of space: isovists and isovist fields (1979)

    Google Scholar 

Download references

Acknowledgements

We thank the story authors for their ongoing collaboration. This research was funded by NSERC and Snap Inc.

Author information

Authors and Affiliations

  1. Graphics and Experential Media Lab, Dalhousie University, Halifax, NS, Canada

    Abbey Singh, Matthew Peachey, Ramanpreet Kaur, Peter Haltner, Shannon Frederick, Mohammed Alnusayri, Joseph Malloch & Derek Reilly

  2. Fountain School of Performing Arts, Dalhousie University, Halifax, NS, Canada

    David Choco Manco, Colton Morris & Shannon Brownlee

Authors
  1. Abbey Singh
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Matthew Peachey
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ramanpreet Kaur
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Peter Haltner
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Shannon Frederick
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Mohammed Alnusayri
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. David Choco Manco
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Colton Morris
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Shannon Brownlee
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Joseph Malloch
    View author publications

    You can also search for this author in PubMed Google Scholar

  11. Derek Reilly
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Abbey Singh .

Editor information

Editors and Affiliations

  1. Amsterdam University of Applied Sciences, Amsterdam, The Netherlands

    Mirjam Vosmeer

  2. University of Skövde, Skövde, Sweden

    Lissa Holloway-Attaway

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Singh, A. et al. (2022). Supporting Spatial Thinking in Augmented Reality Narrative: A Field Study. In: Vosmeer, M., Holloway-Attaway, L. (eds) Interactive Storytelling. ICIDS 2022. Lecture Notes in Computer Science, vol 13762. Springer, Cham. https://doi.org/10.1007/978-3-031-22298-6_17

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-22298-6_17

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-22297-9

  • Online ISBN: 978-3-031-22298-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation