research-article

Public Access

Estimating Distances in Action Space in Augmented Reality

Authors:

Holly C. Gagnon,

Carlos Salas Rosales,

Jeanine K. Stefanucci,

Sarah H. Creem-Regehr,

Robert E. BodenheimerAuthors Info & Claims

ACM Transactions on Applied Perception (TAP), Volume 18, Issue 2

Article No.: 7, Pages 1 - 16

https://doi.org/10.1145/3449067

Published: 21 May 2021 Publication History

All formats PDF

Abstract

Augmented reality (AR) is important for training complex tasks, such as navigation, assembly, and medical procedures. The effectiveness of such training may depend on accurate spatial localization of AR objects in the environment. This article presents two experiments that test egocentric distance perception in augmented reality within and at the boundaries of action space (up to 35 m) in comparison with distance perception in a matched real-world (RW) environment. Using the Microsoft HoloLens, in Experiment 1, participants in two different RW settings judged egocentric distances (ranging from 10 to 35 m) to an AR avatar or a real person using a visual matching measure. Distances to augmented targets were underestimated compared to real targets in the two indoor, RW contexts. Experiment 2 aimed to generalize the results to an absolute distance measure using verbal reports in one of the indoor environments. Similar to Experiment 1, distances to augmented targets were underestimated compared to real targets. We discuss these findings with respect to the importance of methodologies that directly compare performance in real and mediated environments, as well as the inherent differences present in mediated environments that are “matched” to the real world.

References

[1]

Haley Adams. 2020. [DC] Resolving cue conflicts in augmented reality. In 2020 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW). IEEE, 547–548.

[2]

Murat Akçayır and Gökçe Akçayır. 2017. Advantages and challenges associated with augmented reality for education: A systematic review of the literature. Educational Research Review 20 (2017), 1–11.

[3]

Jeffrey Andre and Sheena Rogers. 2006. Using verbal and blind-walking distance estimates to investigate the two visual systems hypothesis. Perception & Psychophysics 68, 3 (2006), 353–361.

[4]

Bobby Bodenheimer, Jingjing Ming, Haojie Wu, Gayathri Narasimham, Bjoern Rump, Tim P. McNamara, Thomas H. Carr, and John J. Rieser. 2007. Distance estimation in virtual and real environments using bisection. In Symposium on Applied Perception in Graphics and Visualization. 35–40.

[5]

Lauren E. Buck, Mary K. Young, and Bobby Bodenheimer. 2018. A comparison of distance estimation in HMD-based virtual environments with different HMD-based conditions. ACM Transactions on Applied Perception 15, 3 (July 2018), Article 21, 15 pages.

Digital Library

[6]

Sarah H. Creem-Regehr, Jeanine K. Stefanucci, and William B. Thompson. 2015. Perceiving absolute scale in virtual environments: How theory and application have mutually informed the role of body-based perception. In Psychology of Learning and Motivation, Brian H. Ross (Ed.). Vol. 62. Academic Press, 195–224.

[7]

Sarah H. Creem-Regehr, Jeanine K. Stefanucci, William B. Thompson, Nathan Nash, and Michael McCardell. 2015. Egocentric distance perception in the Oculus Rift (DK2). In Proceedings of the ACM SIGGRAPH Symposium on Applied Perception (SAP’15). ACM, New York, NY, 47–50.

Digital Library

[8]

Sarah H. Creem-Regehr, Peter Willemsen, Amy A. Gooch, and William B. Thompson. 2005. The influence of restricted viewing conditions on egocentric distance perception: Implications for real and virtual indoor environments. Perception 34, 2 (2005), 191–204.

[9]

James E. Cutting and Peter M. Vishton. 1995. Perceiving layout and knowing distance: The integration, relative potency and contextual use of different information about depth. In Perception of Space and Motion, William Epstein and Sheena Rogers (Eds.). Academic Press, New York, 69–117.

[10]

Arindam Dey, Mark Billinghurst, Robert W. Lindeman, and J. Edward Swan. 2018. A systematic review of 10 years of augmented reality usability studies: 2005 to 2014. Frontiers in Robotics and AI 5 (2018), 37.

[11]

Arindam Dey, Andrew Cunningham, and Christian Sandor. 2010. Evaluating depth perception of photorealistic mixed reality visualizations for occluded objects in outdoor environments. In Proceedings of the 17th ACM Symposium on Virtual Reality Software and Technology. ACM, 211–218.

Digital Library

[12]

Arindam Dey, Graeme Jarvis, Christian Sandor, and Gerhard Reitmayr. 2012. Tablet versus phone: Depth perception in handheld augmented reality. In 2012 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE, 187–196.

Digital Library

[13]

Catherine Diaz, Michael Walker, Danielle Albers Szafir, and Daniel Szafir. 2017. Designing for depth perceptions in augmented reality. In 2017 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE, 111–122.

[14]

Holly C. Gagnon, Dun Na, Keith Heiner, Jeanine Stefanucci, Sarah Creem-Regehr, and Bobby Bodenheimer. 2020. The role of viewing distance and feedback on affordance judgments in augmented reality. In 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). 922–929.

[15]

Yuan Gao, Etienne Peillard, Jean-Marie Normand, Guillaume Moreau, Yue Liu, and Yongtian Wang. 2020. Influence of virtual objects’ shadows and lighting coherence on distance perception in optical see-through augmented reality. Journal of the Society for Information Display 28, 2 (2020), 117–135.

[16]

Victoria Interrante, Lee Anderson, and Brian Ries. 2006. Distance perception in immersive virtual environments, revisited. In Proceedings of IEEE Virtual Reality. 3–10.

Digital Library

[17]

Victoria Interrante, Brian Ries, Jason Lindquist, and Lee Anderson. 2007. Elucidating the factors that can facilitate veridical spatial perception in immersive virtual environments. In Proceedings of the IEEE Symposium on 3D User Interfaces. 11–18.

[18]

Jonathan W. Kelly, Lucia A. Cherep, and Zachary D. Siegel. 2017. Perceived space in the HTC vive. ACM Transactions on Applied Perception 15, 1 (Nov. 2017), Article 2, 16 pages.

Digital Library

[19]

Benjamin R. Kunz, Leah Wouters, Daniel Smith, William B. Thompson, and Sarah H. Creem-Regehr. 2009. Revisiting the effect of quality of graphics on distance judgments in virtual environments: A comparison of verbal reports and blind walking. Attention, Perception, & Psychophysics 71, 6 (2009), 1284–1293.

[20]

Liisa Kuparinen, J. Edward Swan II, Scott Rapson, and Christian Sandor. 2013. Depth perception in tablet-based augmented reality at medium-and far-field distances. In Proceedings of the ACM Symposium on Applied Perception (SAP’13). Association for Computing Machinery, 121 pages.

[21]

Mikko Kytö, Aleksi Mäkinen, Timo Tossavainen, and Pirkko Oittinen. 2014. Stereoscopic depth perception in video see-through augmented reality within action space. Journal of Electronic Imaging 23, 1 (2014), 011006.

[22]

Joseph S. Lappin, Amy L. Shelton, and John J. Rieser. 2006. Environmental context influences visually perceived distance. Attention, Perception, & Psychophysics 4 (2006), 571–581.

[23]

Jingjing (May) Liu, Gayathri Narasimham, Jeanine Stefanucci, Sarah Creem-Regehr, and Bobby Bodenheimer. 2020. Distance perception in modern mobile augmented reality. In 2020 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW). 196–200.

[24]

Mark A. Livingston, Zhuming Ai, J. Edward Swan, and Harvey S. Smallman. 2009. Indoor vs. outdoor depth perception for mobile augmented reality. In 2009 IEEE Virtual Reality Conference. IEEE, 55–62.

[25]

Jack M. Loomis and John W. Philbeck. 2008. Measuring spatial perception with spatial updating and action. In Embodiment, Ego-Space, and Action, R. L. Klatzky, B. MacWihnney, and M. Behrmann (Eds.). Taylor & Francis, New York.

[26]

Jack M. Loomis, José A. Da Silva, Naofumi Fujita, and Sergio S. Fukusima. 1992. Visual space perception and visually directed action. Journal of Experimental Psychology: Human Perception and Performance 18, 4 (1992), 906–921.

[27]

Betty J. Mohler, Sarah H. Creem-Regehr, and William B. Thompson. 2006. The influence of feedback on egocenteric distance judgments in real and virtual environments. In Proceedings of the Symposium on Applied Perception in Graphics and Visualization. 9–14.

[28]

Phillip E. Napieralski, Bliss M. Altenhoff, Jeffrey W. Bertrand, Lindsay O. Long, Sabarish V. Babu, Christopher C. Pagano, Justin Kern, and Timothy A. Davis. 2011. Near-field distance perception in real and virtual environments using both verbal and action responses. ACM Transactions on Applied Perception (TAP) 8, 3 (2011), 18.

[29]

Christopher C. Pagano and Geoffrey P. Bingham. 1998. Comparing measures of monocular distance perception: Verbal and reaching errors are not correlated.Journal of Experimental Psychology: Human Perception and Performance 24, 4 (1998), 1037.

[30]

Christopher C. Pagano, Richard P. Grutzmacher, and Joseph C. Jenkins. 2001. Comparing verbal and reaching responses to visually perceived egocentric distances. Ecological Psychology 13, 3 (2001), 197–226.

[31]

Pranav Parekh, Shireen Patel, Nivedita Patel, and Manan Shah. 2020. Systematic review and meta-analysis of augmented reality in medicine, retail, and games. Visual Computing for Industry, Biomedicine, and Art 3, 1 (2020), 1–20.

[32]

Nikolai Pärsch, Clemens Harnischmacher, Martin Baumann, Arnd Engeln, and Lutz Krauß. 2019. Designing augmented reality navigation visualizations for the vehicle: A question of real world object coverage? In HCI in Mobility, Transport, and Automotive Systems, Heidi Krömker (Ed.). Springer International Publishing, Cham, 161–175.

[33]

John W. Philbeck and Jack M. Loomis. 1997. Comparison of two indicators of perceived egocentric distance under full-cue and reduced-cue conditions.Journal of Experimental Psychology: Human Perception and Performance 23, 1 (1997), 72.

[34]

John W. Philbeck, Jack M. Loomis, and Andrew C. Beall. 1997. Visually perceived location is an invariant in the control of action. Perception and Psychophysics 59 (1997), 601–612.

[35]

Jodie M. Plumert, Joseph K. Kearney, James F. Cremer, and Karar Recker. 2005. Distance perception in real and virtual environments. ACM Transactions on Applied Perception 2 (2005), 216–233.

Digital Library

[36]

Grant Pointon, Chelsey Thompson, Sarah Creem-Regehr, Jeanine Stefanucci, Miti Joshi, Richard Paris, and Bobby Bodenheimer. 2018. Judging action capabilities in augmented reality. In Proceedings of the 15th ACM Symposium on Applied Perception. 1–8.

Digital Library

[37]

Rebekka S. Renner, Boris M. Velichkovsky, and Jens R. Helmert. 2013. The perception of egocentric distances in virtual environments—A review. ACM Computer Surveys 46, 2 (2013), 23:1–23:40.

[38]

Anthony R. Richardson and David Waller. 2007. Interaction with an immersive virtual environment corrects users’ distance estimates. Human Factors 49, 3 (2007), 507–517.

[39]

Carlos Salas Rosales, Grant Pointon, Haley Adams, Jeanine Stefanucci, Sarah Creem-Regehr, William B Thompson, and Bobby Bodenheimer. 2019. Distance judgments to on-and off-ground objects in augmented reality. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, 237–243.

[40]

Cynthia S. Sahm, Sarah H. Creem-Regehr, William B. Thompson, and Peter Willemsen. 2005. Throwing versus walking as indicators of distance perception in real and virtual environments. ACM Transactions on Applied Perception 1, 3 (2005), 35–45.

Digital Library

[41]

Zachary D. Siegel and Jonathan W. Kelly. 2017. Walking through a virtual environment improves perceived size within and beyond the walked space. Attention, Perception, & Psychophysics 79, 1 (2017), 39–44.

[42]

J. Edward Swan, Adam Jones, Eric Kolstad, Mark A. Livingston, and Harvey S. Smallman. 2007. Egocentric depth judgments in optical, see-through augmented reality. IEEE Transactions on Visualization and Computer Graphics 13, 3 (2007), 429–442.

Digital Library

[43]

J. Edward Swan, Liisa Kuparinen, Scott Rapson, and Christian Sandor. 2017. Visually perceived distance judgments: Tablet-based augmented reality versus the real world. International Journal of Human–Computer Interaction 33, 7 (2017), 576–591.

[44]

J. Edward Swan, Mark A. Livingston, Harvey S. Smallman, Dennis Brown, Yohan Baillot, Joseph L. Gabbard, and Deborah Hix. 2006. A perceptual matching technique for depth judgments in optical, see-through augmented reality. In Proceedings of the IEEE Virtual Reality Conference (2006), 19–26.

Digital Library

[45]

Martha Teghtsoonian and Robert Teghtsoonian. 1969. Scaling apparent distance in natural indoor settings. Psychonomic Science 16, 6 (June 1969), 281–283.

[46]

Robert Teghtsoonian and Martha Teghtsoonian. 1970. Scaling apparent distance in a natural outdoor setting. Psychonomic Science 21, 4 (Oct. 1970), 215–216.

[47]

William B. Thompson, Peter Willemsen, Amy A. Gooch, Sarah H. Creem-Regehr, Jack M. Loomis, and Andy C. Beall. 2004. Does the quality of the computer graphics matter when judging distances in visually immersive environments. Presence: Teleoperators and Virtual Environments 13 (2004), 560–571.

Digital Library

[48]

William H. Warren. 2019. Perceiving surface layout: Ground theory, affordances, and the objects of perception. In Perception as Information Detection: Reflections on Gibson’s Ecological Approach to Visual Perception, J. Wagman and J. Blau (Eds.). Taylor & Francis, 151–173.

[49]

Jason Wither and Tobias Hollerer. 2005. Pictorial depth cues for outdoor augmented reality. In Proceedings of the 9th IEEE International Symposium on Wearable Computers (ISWC’05). IEEE, 92–99.

Digital Library

[50]

Bob G. Witmer and Wallace J. Sadowski, Jr.1998. Nonvisually guided locomotion to a previously viewed target in real and virutal environments. Human Factors 40 (1998), 478–488.

[51]

Christine J. Ziemer, Jodie M. Plumert, James F. Cremer, and Joseph K. Kearney. 2009. Estimating distance in real and virtual environments: Does order make a difference?Attention, Perception, & Psychophysics 71, 5 (2009), 1095–1106.

Cited By

Hirota MSasaki KKato KNakagomi RTakigawa RKageyama CMorino SSuzuki MMihashi TMizota AHayashi T(2024)Ocular Accommodative and Pupillary Responses During Fixation on Augmented Reality With a Maxwellian DisplayInvestigative Ophthalmology & Visual Science10.1167/iovs.65.11.3065:11(30)Online publication date: 18-Sep-2024
https://doi.org/10.1167/iovs.65.11.30
Benjamin JErickson AGottsacker MBruder GWelch G(2024)Evaluating Transitive Perceptual Effects Between Virtual Entities in Outdoor Augmented Reality2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR58804.2024.00082(619-629)Online publication date: 16-Mar-2024
https://doi.org/10.1109/VR58804.2024.00082
Liu CMa SLiu YWang YSong W(2024)Depth Perception in Optical See-Through Augmented Reality: Investigating the Impact of Texture Density, Luminance Contrast, and Color ContrastIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.345616230:11(7266-7276)Online publication date: 1-Nov-2024
https://dl.acm.org/doi/10.1109/TVCG.2024.3456162
Show More Cited By

Index Terms

Estimating Distances in Action Space in Augmented Reality
1. Applied computing
  1. Law, social and behavioral sciences
    1. Psychology
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Empirical studies in HCI
    2. Interaction paradigms
      1. Virtual reality

Recommendations

Judging action capabilities in augmented reality
SAP '18: Proceedings of the 15th ACM Symposium on Applied Perception

The utility of mediated environments increases when environmental scale (size and distance) is perceived accurately. We present the use of perceived affordances---judgments of action capabilities---as an objective way to assess space perception in an ...
Perceiving Absolute Distance in Augmented Reality Displays with Realistic and Non-realistic Shadows
SAP '23: ACM Symposium on Applied Perception 2023

Although distance perception to Augmented Reality (AR) objects has been studied for decades, little is known about absolute distance perception with the newest available AR displays. One significant distinction in categories of head-worn AR displays is ...
Haptics in Augmented Reality
ICMCS '99: Proceedings of the IEEE International Conference on Multimedia Computing and Systems - Volume 2

An augmented reality system merges synthetic sensory information into a user's perception of a three-dimensional environment. An important performance goal for an augmented reality system is that the user perceives a single seamless environment. In most ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Applied Perception

ACM Transactions on Applied Perception Volume 18, Issue 2

April 2021

78 pages

ISSN:1544-3558

EISSN:1544-3965

DOI:10.1145/3465476

Editors:
Martin Giese
University of Tübingen, Germany
,
Victoria Interrante
University of Minnesota, USA

Issue’s Table of Contents

Copyright © 2021 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 May 2021

Accepted: 01 February 2021

Revised: 01 December 2020

Received: 01 July 2020

Published in TAP Volume 18, Issue 2

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Funding Sources

Office of Naval Research

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

12
Total Citations
View Citations
1,100
Total Downloads

Downloads (Last 12 months)311
Downloads (Last 6 weeks)53

Reflects downloads up to 02 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Hirota MSasaki KKato KNakagomi RTakigawa RKageyama CMorino SSuzuki MMihashi TMizota AHayashi T(2024)Ocular Accommodative and Pupillary Responses During Fixation on Augmented Reality With a Maxwellian DisplayInvestigative Ophthalmology & Visual Science10.1167/iovs.65.11.3065:11(30)Online publication date: 18-Sep-2024
https://doi.org/10.1167/iovs.65.11.30
Benjamin JErickson AGottsacker MBruder GWelch G(2024)Evaluating Transitive Perceptual Effects Between Virtual Entities in Outdoor Augmented Reality2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR58804.2024.00082(619-629)Online publication date: 16-Mar-2024
https://doi.org/10.1109/VR58804.2024.00082
Liu CMa SLiu YWang YSong W(2024)Depth Perception in Optical See-Through Augmented Reality: Investigating the Impact of Texture Density, Luminance Contrast, and Color ContrastIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.345616230:11(7266-7276)Online publication date: 1-Nov-2024
https://dl.acm.org/doi/10.1109/TVCG.2024.3456162
Li FGao QWang NGreene NSong TDianat OAzimi E(2024)Mixed reality guided root canal therapyHealthcare Technology Letters10.1049/htl2.1207711:2-3(167-178)Online publication date: 2-Apr-2024
https://doi.org/10.1049/htl2.12077
Wang XSouthwick DRobinson INitsche MResch GMazalek AWelsh T(2024)Prolonged exposure to mixed reality alters task performance in the unmediated environmentScientific Reports10.1038/s41598-024-69116-w14:1Online publication date: 15-Aug-2024
https://doi.org/10.1038/s41598-024-69116-w
Cooper E(2023)The Perceptual Science of Augmented RealityAnnual Review of Vision Science10.1146/annurev-vision-111022-1237589:1(455-478)Online publication date: 15-Sep-2023
https://doi.org/10.1146/annurev-vision-111022-123758
Bodenheimer BAdams HWhitaker MStefanucci JCreem-Regehr S(2023)Perceiving Absolute Distance in Augmented Reality Displays with Realistic and Non-realistic ShadowsACM Symposium on Applied Perception 202310.1145/3605495.3605800(1-9)Online publication date: 5-Aug-2023
https://dl.acm.org/doi/10.1145/3605495.3605800
Gupta ACecil JMoosavi MWilliams JMerienne F(2023)Effect of Tactile Affordance During the Design of Extended Reality-Based Training Environments for Healthcare ContextsVirtual, Augmented and Mixed Reality10.1007/978-3-031-35634-6_31(441-452)Online publication date: 23-Jul-2023
https://dl.acm.org/doi/10.1007/978-3-031-35634-6_31
Adams HStefanucci JCreem-Regehr SBodenheimer B(2022)Depth Perception in Augmented Reality: The Effects of Display, Shadow, and Position2022 IEEE Conference on Virtual Reality and 3D User Interfaces (VR)10.1109/VR51125.2022.00101(792-801)Online publication date: Mar-2022
https://doi.org/10.1109/VR51125.2022.00101
Sadeghi Milani ACecil-Xavier AGupta ACecil JKennison S(2022)A Systematic Review of Human–Computer Interaction (HCI) Research in Medical and Other Engineering FieldsInternational Journal of Human–Computer Interaction10.1080/10447318.2022.211653040:3(515-536)Online publication date: 14-Sep-2022
https://doi.org/10.1080/10447318.2022.2116530
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

Figures

Tables

Media

View Issue’s Table of Contents