research-article

A User-Oriented Approach to Space-Adaptive Augmentation: The Effects of Spatial Affordance on Narrative Experience in an Augmented Reality Detective Game

Authors:

Woontack WooAuthors Info & Claims

CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems

Article No.: 722, Pages 1 - 13

https://doi.org/10.1145/3411764.3445675

Published: 07 May 2021 Publication History

CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems

A User-Oriented Approach to Space-Adaptive Augmentation: The Effects of Spatial Affordance on Narrative Experience in an Augmented Reality Detective Game

Pages 1 - 13

Abstract
Supplementary Material
References

Abstract

Space-adaptive algorithms aim to effectively align the virtual with the real to provide immersive user experiences for Augmented Reality(AR) content across various physical spaces. While such measures are reliant on real spatial features, efforts to understand those features from the user’s perspective and reflect them in designing adaptive augmented spaces have been lacking. For this, we compared factors of narrative experience in six spatial conditions during the gameplay of Fragments, a space-adaptive AR detective game. Configured by size and furniture layout, each condition afforded disparate degrees of traversability and visibility. Results show that whereas centered furniture clusters are suitable for higher presence in sufficiently large rooms, the same layout leads to lower narrative engagement. Based on our findings, we suggest guidelines that can enhance the effects of space adaptivity by considering how users perceive and navigate augmented space generated from different physical environments.

Supplementary Material

MP4 File (3411764.3445675_videopreview.mp4)

Preview video

Download
18.90 MB

References

[1]

Ronald Azuma. 1997. A survey of augmented reality. Presence: Teleoperators & Virtual Environments 6, 4(1997), 355–385.

Digital Library

[2]

Ronald Azuma. 2015. Location-Based Mixed and Augmented Reality Storytelling. Fundamentals of Wearable Computers and Augmented Reality (2015), 259–276.

[3]

Mieke Bal and Christine Van Boheemen. 2009. Narratology: Introduction to the theory of narrative. University of Toronto Press.

[4]

Bimal Balakrishnan and S Shyam Sundar. 2011. Where am I? How can I get there? Impact of navigability and narrative transportation on spatial presence. Human–Computer Interaction 26, 3 (2011), 161–204.

[5]

Samantha W Bindman, Lisa M Castaneda, Mike Scanlon, and Anna Cechony. 2018. Am I a Bunny?: The Impact of High and Low Immersion Platforms and Viewers’ Perceptions of Role on Presence, Narrative Engagement, and Empathy during an Animated 360 Video. In Proceedings of the 2018 CHI conference on human factors in computing systems. ACM, 457.

Digital Library

[6]

Frank Biocca. 2003. Can we resolve the book, the physical reality, and the dream state problems? From the two-pole to a three-pole model of shifts in presence. In EU Future and Emerging Technologies, Presence Initiative Meeting. Citeseer.

[7]

Rick Busselle and Helena Bilandzic. 2009. Measuring narrative engagement. Media Psychology 12, 4 (2009), 321–347.

[8]

Julie Carmigniani, Borko Furht, Marco Anisetti, Paolo Ceravolo, Ernesto Damiani, and Misa Ivkovic. 2011. Augmented reality technologies, systems and applications. Multimedia tools and applications 51, 1 (2011), 341–377.

[9]

Anthony Chemero. 2003. An outline of a theory of affordances. Ecological psychology 15, 2 (2003), 181–195.

[10]

Ashley Colley, Jacob Thebault-Spieker, Allen Yilun Lin, Donald Degraen, Benjamin Fischman, Jonna Häkkilä, Kate Kuehl, Valentina Nisi, Nuno Jardim Nunes, Nina Wenig, 2017. The geography of Pokémon GO: beneficial and problematic effects on places and movement. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, 1179–1192.

Digital Library

[11]

Steven Dow, Manish Mehta, Ellie Harmon, Blair MacIntyre, and Michael Mateas. 2007. Presence and engagement in an interactive drama. In Proceedings of the SIGCHI conference on Human factors in computing systems. ACM, 1475–1484.

Digital Library

[12]

Gabriel Evans, Jack Miller, Mariangely Iglesias Pena, Anastacia MacAllister, and Eliot Winer. 2017. Evaluating the Microsoft HoloLens through an augmented reality assembly application. In Degraded Environments: Sensing, Processing, and Display 2017, Vol. 10197. International Society for Optics and Photonics, 101970V.

[13]

Rod Furlan. 2016. The future of augmented reality: Hololens-Microsoft’s AR headset shines despite rough edges [Resources_Tools and Toys]. IEEE Spectrum 53, 6 (2016), 21–21.

Digital Library

[14]

Roderick Galantay, Jan Torpus, and Maia Engeli. 2004. Living-room: interactive, space-oriented augmented reality. In Proceedings of the 12th annual ACM international conference on Multimedia. ACM, 64–71.

Digital Library

[15]

Laura Germine, Ken Nakayama, Bradley C Duchaine, Christopher F Chabris, Garga Chatterjee, and Jeremy B Wilmer. 2012. Is the Web as good as the lab? Comparable performance from Web and lab in cognitive/perceptual experiments. Psychonomic bulletin & review 19, 5 (2012), 847–857.

[16]

Melanie C Green. 2004. Transportation into narrative worlds: The role of prior knowledge and perceived realism. Discourse processes 38, 2 (2004), 247–266.

[17]

Bin Guo, Ryota Fujimura, Daqing Zhang, and Michita Imai. 2012. Design-in-play: improving the variability of indoor pervasive games. Multimedia Tools and Applications 59, 1 (2012), 259–277.

Digital Library

[18]

Juho Hamari, Aqdas Malik, Johannes Koski, and Aditya Johri. 2019. Uses and gratifications of pokémon go: Why do people play mobile location-based augmented reality games?International Journal of Human–Computer Interaction 35, 9(2019), 804–819.

[19]

Ramy Hammady and Minhua Ma. 2019. Designing Spatial UI as a Solution of the Narrow FOV of Microsoft HoloLens: Prototype of Virtual Museum Guide. In Augmented Reality and Virtual Reality. Springer, 217–231.

[20]

Sandra G Hart. 2006. NASA-task load index (NASA-TLX); 20 years later. In Proceedings of the human factors and ergonomics society annual meeting, Vol. 50. Sage publications Sage CA: Los Angeles, CA, 904–908.

[21]

Sandra G Hart and Lowell E Staveland. 1988. Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. In Advances in psychology. Vol. 52. Elsevier, 139–183.

[22]

Franco Hidalgo and Thomas Bräunl. 2015. Review of underwater SLAM techniques. In 2015 6th International Conference on Automation, Robotics and Applications (ICARA). IEEE, 306–311.

[23]

Daniel Johnson, M John Gardner, and Ryan Perry. 2018. Validation of two game experience scales: the player experience of need satisfaction (PENS) and game experience questionnaire (GEQ). International Journal of Human-Computer Studies 118 (2018), 38–46.

[24]

Kangsoo Kim, Mark Billinghurst, Gerd Bruder, Henry Been-Lirn Duh, and Gregory F Welch. 2018. Revisiting Trends in Augmented Reality Research: A Review of the 2nd Decade of ISMAR (2008–2017). IEEE transactions on visualization and computer graphics 24, 11(2018), 2947–2962.

[25]

Sang Min Ko, Won Suk Chang, and Yong Gu Ji. 2013. Usability principles for augmented reality applications in a smartphone environment. International Journal of Human-Computer Interaction 29, 8(2013), 501–515.

[26]

James R Lewis. 2002. Psychometric evaluation of the PSSUQ using data from five years of usability studies. International Journal of Human-Computer Interaction 14, 3-4(2002), 463–488.

[27]

Matthew Lombard and Theresa Ditton. 1997. At the heart of it all: The concept of presence. Journal of computer-mediated communication 3, 2 (1997), JCMC321.

[28]

Lev Manovich. 2006. The poetics of augmented space. Visual communication 5, 2 (2006), 219–240.

[29]

Mark McGill, Daniel Boland, Roderick Murray-Smith, and Stephen Brewster. 2015. A dose of reality: Overcoming usability challenges in vr head-mounted displays. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. ACM, 2143–2152.

Digital Library

[30]

Niamh McNamara and Jurek Kirakowski. 2005. Defining usability: quality of use or quality of experience?. In IPCC 2005. Proceedings. International Professional Communication Conference, 2005. IEEE, 200–204.

[31]

Elisa D Mekler, Julia Ayumi Bopp, Alexandre N Tuch, and Klaus Opwis. 2014. A systematic review of quantitative studies on the enjoyment of digital entertainment games. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 927–936.

Digital Library

[32]

Carolyn Handler Miller. 2014. Digital storytelling: A creator’s guide to interactive entertainment. Focal Press.

[33]

Jack Miller, Melynda Hoover, and Eliot Winer. 2020. Mitigation of the Microsoft HoloLens’ hardware limitations for a controlled product assembly process. The International Journal of Advanced Manufacturing Technology 109, 5(2020), 1741–1754.

[34]

Kazuma Nagata, Soh Masuko, and Junichi Hoshino. 2018. Construction of Mixed Reality Story Environment Based on Real Space Shape. In International Conference on Entertainment Computing. Springer, 260–265.

[35]

Gary Ng, Joon Gi Shin, Alexander Plopski, Christian Sandor, and Daniel Saakes. 2018. Situated Game Level Editing in Augmented Reality. In Tangible and Embedded Interaction. 409–418.

[36]

A Imran Nordin, Paul A Cairns, Matthew Hudson, Alejandro Alonso, and Eduardo H Calvillo Gámez. 2014. The effect of surroundings on gaming experience. In FDG. Citeseer.

[37]

John V Pavlik and Frank Bridges. 2013. The emergence of augmented reality (AR) as a storytelling medium in journalism. Journalism & Communication Monographs 15, 1 (2013), 4–59.

[38]

Gerald Prince. 2003. A dictionary of narratology. U of Nebraska Press.

[39]

Aung Pyae and Leigh Ellen Potter. 2016. A player engagement model for an augmented reality game: A case of Pokémon go. In Proceedings of the 28th Australian Conference on Computer-Human Interaction. ACM, 11–15.

Digital Library

[40]

Daniel M Shafer, Corey P Carbonara, and Lucy Popova. 2011. Spatial presence and perceived reality as predictors of motion-based video game enjoyment. Presence: Teleoperators and Virtual Environments 20, 6(2011), 591–619.

Digital Library

[41]

Roy Shilkrot, Nick Montfort, and Pattie Maes. 2014. nARratives of augmented worlds. In 2014 IEEE International Symposium on Mixed and Augmented Reality-Media, Art, Social Science, Humanities and Design (ISMAR-MASH’D). IEEE, 35–42.

[42]

Jae-eun Shin, Hayun Kim, Callum Parker, Hyung-il Kim, Seoyoung Oh, and Woontack Woo. 2019. Is Any Room Really OK? The Effect of Room Size and Furniture on Presence, Narrative Engagement, and Usability During a Space-Adaptive Augmented Reality Game. In 2019 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE, 135–144.

[43]

Jacob H Steffen, James E Gaskin, Thomas O Meservy, Jeffrey L Jenkins, and Iopa Wolman. 2019. Framework of affordances for virtual reality and augmented reality. Journal of Management Information Systems 36, 3 (2019), 683–729.

[44]

Penelope Sweetser and Peta Wyeth. 2005. GameFlow: a model for evaluating player enjoyment in games. Computers in Entertainment (CIE) 3, 3 (2005), 3–3.

Digital Library

[45]

Arthur Tang, Frank Biocca, and Lynette Lim. 2004. Comparing differences in presence during social interaction in augmented reality versus virtual reality environments: An exploratory study. Proceedings of PRESENCE(2004), 204–208.

[46]

Jeff Thoss, Astrid Ensslin, and David Ciccoricco. 2018. Narrative Media: The Impossibilities of Digital Storytelling. Poetics Today 39, 3 (2018), 623–643.

[47]

Adam Tuliper. 2017. HoloLens - Introduction to the HoloLens, Part 2: Spatial Mapping. https://docs.microsoft.com/en-us/archive/msdn-magazine/2017/january/hololens-introduction-to-the-hololens-part-2-spatial-mapping

[48]

Jean D Wineman and John Peponis. 2010. Constructing spatial meaning: Spatial affordances in museum design. Environment and Behavior 42, 1 (2010), 86–109.

[49]

Werner Wirth, Tilo Hartmann, Saskia Böcking, Peter Vorderer, Christoph Klimmt, Holger Schramm, Timo Saari, Jari Laarni, Niklas Ravaja, Feliz Ribeiro Gouveia, 2007. A process model of the formation of spatial presence experiences. Media psychology 9, 3 (2007), 493–525.

[50]

Bob G Witmer, Christian J Jerome, and Michael J Singer. 2005. The factor structure of the presence questionnaire. Presence: Teleoperators & Virtual Environments 14, 3(2005), 298–312.

Digital Library

[51]

Jacob O Wobbrock, Leah Findlater, Darren Gergle, and James J Higgins. 2011. The aligned rank transform for nonparametric factorial analyses using only anova procedures. In Proceedings of the SIGCHI conference on human factors in computing systems. ACM, 143–146.

Digital Library

Cited By

Zhou QWang SWang J(2025)Exploring User Experience in Virtual Industrial Heritage Platforms: Impact of Cultural Identity, Functional Clarity, Scene Interactivity, and Narrative QualityBuildings10.3390/buildings1502025315:2(253)Online publication date: 16-Jan-2025
https://doi.org/10.3390/buildings15020253
Tan FXu PRam ASuen WZhao SHuang YHurter C(2024)AudioXtend: Assisted Reality Visual Accompaniments for Audiobook Storytelling During Everyday Routine TasksProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642514(1-22)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642514
Park HMin ALee HShakeri MJeon IWoo W(2024)Comfortable Mobility vs. Attractive Scenery: The Key to Augmenting Narrative Worlds in Outdoor Locative Augmented Reality StorytellingProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642431(1-19)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642431
Show More Cited By

Index Terms

A User-Oriented Approach to Space-Adaptive Augmentation: The Effects of Spatial Affordance on Narrative Experience in an Augmented Reality Detective Game

Index terms have been assigned to the content through auto-classification.

Recommendations

Negative Effects Associated with HMDs in Augmented and Virtual Reality
Virtual, Augmented and Mixed Reality. Design and Interaction
Abstract
Head mounted displays (HMD) are becoming ubiquitous. Simulator sickness has been an issue since the first simulators and HMDs were created. As computational power and display capabilities increase, so does their utilization in technologies such ...
Investigating the Design of Augmented Narrative Spaces Through Virtual-Real Connections: A Systematic Literature Review
CHI '24: Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems

Augmented Reality (AR) is regarded as an innovative storytelling medium that presents novel experiences by layering a virtual narrative space over a real 3D space. However, understanding of how the virtual narrative space and the real space are ...
Examining Pair Dynamics in Shared, Co-located Augmented Reality Narratives
SUI '24: Proceedings of the 2024 ACM Symposium on Spatial User Interaction

Augmented reality (AR) allows users to experience stories together in the same physical space. However, little is known about the experience of sharing AR narratives with others. Much of our current understanding is derived from multi-user VR ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems

May 2021

10862 pages

ISBN:9781450380966

DOI:10.1145/3411764

General Chairs:
Yoshifumi Kitamura
Tohoku University, Japan
,
Aaron Quigley
University of New South Wales, Australia
,
Program Chairs:
Katherine Isbister
University of California Santa Cruz, USA
,
Takeo Igarashi
The University of Tokyo, Japan
,
Publications Chairs:
Pernille Bjørn
University of Copenhagen, Denmark
,
Steven Drucker
Microsoft Research, USA

Copyright © 2021 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 May 2021

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Badges

Honorable Mention

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

Korea Ministry of Science and Information Technology (MSIT), Korea

Conference

CHI '21

Sponsor:

SIGCHI

CHI '21: CHI Conference on Human Factors in Computing Systems

May 8 - 13, 2021

Yokohama, Japan

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

16
Total Citations
View Citations
1,261
Total Downloads

Downloads (Last 12 months)211
Downloads (Last 6 weeks)58

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Zhou QWang SWang J(2025)Exploring User Experience in Virtual Industrial Heritage Platforms: Impact of Cultural Identity, Functional Clarity, Scene Interactivity, and Narrative QualityBuildings10.3390/buildings1502025315:2(253)Online publication date: 16-Jan-2025
https://doi.org/10.3390/buildings15020253
Tan FXu PRam ASuen WZhao SHuang YHurter C(2024)AudioXtend: Assisted Reality Visual Accompaniments for Audiobook Storytelling During Everyday Routine TasksProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642514(1-22)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642514
Park HMin ALee HShakeri MJeon IWoo W(2024)Comfortable Mobility vs. Attractive Scenery: The Key to Augmenting Narrative Worlds in Outdoor Locative Augmented Reality StorytellingProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642431(1-19)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642431
Kotsopoulos KKotsanas KBellos GKotsanas PTsolis DLikothanassis SPavlidis G(2024)Development of Innovative Applications Through the Exploitation of Landmarks for the Promotion of Ancient Greek Technology ExhibitsStrategic Innovative Marketing and Tourism10.1007/978-3-031-51038-0_67(621-630)Online publication date: 1-Jun-2024
https://doi.org/10.1007/978-3-031-51038-0_67
Fernández-Ruiz MRuiz-Torres DPuente Bienvenido H(2023)Environmental Visualization and Exploration in Mobile Augmented Reality Games: Redefining the Spatial AffordancesInteraction Design and Architecture(s)10.55612/s-5002-056-004(69-88)Online publication date: 15-Mar-2023
https://doi.org/10.55612/s-5002-056-004
Shin JYoon BKim DWoo W(2023)The Effects of Spatial Complexity on Narrative Experience in Space-Adaptive AR StorytellingIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2022.320193429:12(5137-5148)Online publication date: 1-Dec-2023
https://dl.acm.org/doi/10.1109/TVCG.2022.3201934
Kim DWoo W(2023)Edge-Centric Space Rescaling with Redirected Walking for Dissimilar Physical-Virtual Space Registration2023 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR59233.2023.00098(829-838)Online publication date: 16-Oct-2023
https://doi.org/10.1109/ISMAR59233.2023.00098
Clua ETrevisan DPorcino TMarques BOliveira EBarbosa LLisboa TFerrari VPeres V(2023)Challenges for XR in GamesGrand Research Challenges in Games and Entertainment Computing in Brazil - GranDGamesBR 2020–203010.1007/978-3-031-27639-2_8(159-186)Online publication date: 10-Mar-2023
https://doi.org/10.1007/978-3-031-27639-2_8
Chiossi FZagermann JKarolus JRodrigues NBalestrucci PWeiskopf DEhinger BFeuchtner TReiterer HChuang LErnst MBulling AMayer SSchmidt A(2022)Adapting visualizations and interfaces to the userit - Information Technology10.1515/itit-2022-003564:4-5(133-143)Online publication date: 31-Aug-2022
https://doi.org/10.1515/itit-2022-0035
Luo WLehmann AWidengren HDachselt R(2022)Where Should We Put It? Layout and Placement Strategies of Documents in Augmented Reality for Collaborative SensemakingProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3501946(1-16)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3501946
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Figures

Tables

Media

View Table of Conten