research-article

Judging action capabilities in augmented reality

Authors:

Chelsey Thompson,

Sarah Creem-Regehr,

Jeanine Stefanucci,

Bobby BodenheimerAuthors Info & Claims

SAP '18: Proceedings of the 15th ACM Symposium on Applied Perception

Article No.: 6, Pages 1 - 8

https://doi.org/10.1145/3225153.3225168

Published: 10 August 2018 Publication History

Abstract

The utility of mediated environments increases when environmental scale (size and distance) is perceived accurately. We present the use of perceived affordances---judgments of action capabilities---as an objective way to assess space perception in an augmented reality (AR) environment. The current study extends the previous use of this methodology in virtual reality (VR) to AR. We tested two locomotion-based affordance tasks. In the first experiment, observers judged whether they could pass through a virtual aperture presented at different widths and distances, and also judged the distance to the aperture. In the second experiment, observers judged whether they could step over a virtual gap on the ground. In both experiments, the virtual objects were displayed with the HoloLens in a real laboratory environment. We demonstrate that affordances for passing through and perceived distance to the aperture are similar in AR to those measured in the real world, but that judgments of gap-crossing in AR were underestimated. These differences across two affordances may result from the different spatial characteristics of the virtual objects (on the ground versus extending off the ground).

References

[1]

Bobby Bodenheimer and Qiang Fu. 2015. The Effect of Avatar Model in Stepping off a Ledge in an Immersive Virtual Environment. In Proceedings of the ACM SIGGRAPH Symposium on Applied Perception (SAP '15). ACM, New York, NY, USA, 115--118.

Digital Library

[2]

Lauren E Buck, Mary K Young, and Bobby Bodenheimer. In press, 2018. A Comparison of Distance Estimation in HMD-based Virtual Environments with Different HMD-based Conditions. ACM Trans. Appl. Percept. (In press, 2018).

Digital Library

[3]

Sarah H. Creem-Regehr, Jeanine K. Stefanucci, and William B. Thompson. 2015a. Perceiving Scale in Virtual Environments: How theory and application have mutually informed the role of body-based perception. In The Psychology of Learning and Motivation, B. Ross (Ed.). Vol. 63. 195--224.

[4]

Sarah H. Creem-Regehr, Jeanine K. Stefanucci, William B. Thompson, Nathan Nash, and Michael McCardell. 2015b. Egocentric Distance Perception in the Oculus Rift (DK2). In Proceedings of the ACM SIGGRAPH Symposium on Applied Perception (SAP '15). ACM, New York, NY, USA, 47--50.

Digital Library

[5]

Sarah H Creem-Regehr, Peter Willemsen, Amy A Gooch, and William B Thompson. 2005. The influence of restricted viewing conditions on egocentric distance perception: Implications for real and virtual indoor environments. Perception 34, 2 (2005), 191--204.

[6]

James E Cutting and Peter M Vishton. 1995. Perception of Space and Motion. Handbook of perception and cognition, Vol. 5. Academic Press, San Diego, CA, Chapter Percieving layout and knowing distances: The integration, relativie potency, and contexual use of different information and depth, 69--117.

[7]

Catherine Diaz, Michael Walker, Danielle Albers Szafir, and Daniel Szafir. 2017. Designing for Depth Perceptions in Augmented Reality. In 2017 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE, 111--122.

[8]

Michael N. Geuss, Jeanine K. Stefanucci, Sarah H. Creem-Regehr, and William B. Thompson. 2010. Can I Pass?: Using Affordances to Measure Perceived Size in Virtual Environments. In Proceedings of the 7th Symposium on Applied Perception in Graphics and Visualization (APGV '10). ACM, New York, NY, USA, 61--64.

Digital Library

[9]

Michael N. Geuss, Jeanine K. Stefanucci, Sarah H. Creem-Regehr, William B. Thompson, and Betty J. Mohler. 2015. Effect of Display Technology on Perceived Scale of Space. Human Factors: The Journal of the Human Factors and Ergonomics Society 57, 7 (2015), 1235--1247.

[10]

James J. Gibson. 1979. The ecological approach to visual perception. Houghton Mifflin, Boston, MA.

[11]

Timofey Y. Grechkin, Tien Dat Nguyen, Jodie M. Plumert, James F. Cremer, and Joseph K. Kearney. 2010. How does presentation method and measurement protocol affect distance estimation in real and virtual environments? ACM Trans. Appl. Percept. 7, Article 26 (July 2010), 18 pages. Issue 4.

Digital Library

[12]

Yang Jiang and Leonard S Mark. 1994. The effect of gap depth on the perception of whether a gap is crossable. Perception & Psychophysics 56, 6 (1994), 691--700.

[13]

J. Adam Jones, J. Edward Swan, II, Gurjot Singh, Eric Kolstad, and Stephen R. Ellis. 2008. The effects of virtual reality, augmented reality, and motion parallax on egocentric depth perception. In Proceedings of the 5th symposium on Applied perception in graphics and visualization (APGV '08). ACM, New York, NY, USA, 9--14.

Digital Library

[14]

Eunice Jun, Jeanine K. Stefanucci, Sarah H. Creem-Regehr, Michael N. Geuss, and William B. Thompson. 2015. Big Foot: Using the Size of a Virtual Foot to Scale Gap Width. ACM Trans. Appl. Percept. 12, 4(2015), 16:1--16:12.

Digital Library

[15]

Jonathan W. Kelly, Lucia A. Cherep, and Zachary D. Siegel. 2017. Perceived Space in the HTC Vive. ACM Trans. Appl. Percept. 15, 1, Article 2 (Nov. 2017), 16 pages.

Digital Library

[16]

Ernst Kruijff, J. Edward Swan, and Steven Feiner. 2010. Perceptual issues in augmented reality revisited. In 2010 IEEE International Symposium on Mixed and Augmented Reality. 3--12.

[17]

Qiufeng Lin, John Rieser, and Bobby Bodenheimer. 2012. Stepping over and ducking under: the influence of an avatar on locomotion in an HMD-based immersive virtual environment. In Proceedings of the ACM Symposium on Applied Perception (SAP 12). ACM, New York, NY, USA, 7--10.

Digital Library

[18]

Qiufeng Lin, John Rieser, and Bobby Bodenheimer. 2015. Affordance Judgments in HMD-Based Virtual Environments: Stepping over a Pole and Stepping off a Ledge. ACM Transactions on Applied Perception 12, 2, Article 6 (April 2015), 21 pages.

Digital Library

[19]

Qiufeng Lin, John J. Rieser, and Bobby Bodenheimer. 2013. Stepping off a ledge in an HMD-based immersive virtual environment. In Proceedings of the ACM Symposium on Applied Perception (SAP '13). ACM, New York, NY, USA, 107--110.

Digital Library

[20]

Qiufeng Lin, X Xie, A Erdemir, G Narasimham, T McNamara, J Rieser, and B Bodenheimer. 2011. Egocentric Distance Perception in Real and HMD-based Virtual Environments: The Effect of Limited Scanning Method. In Proceedings of the Symposium on Applied Perception in Graphics and Visualization. Toulouse, France.

Digital Library

[21]

Jack M. Loomis, José A. Da Silva, Naofumi Fujita, and Sergio S. Fukusima. 1992. Visual Space Perception and Visually Directed Action. Journal of Experimental Psychology: Human Perception and Performance 18, 4 (1992), 906--921.

[22]

Leonard S Mark. 1987. Eyeheight-scaled information about affordances: a study of sitting and stair climbing. Journal of Experimental Psychology: Human Perception and Performance 13, 3 (1987), 361.

[23]

Phillip E Napieralski, Bliss M Altenhoff, Jeffrey W Bertrand, Lindsay O Long, Sabarish V Babu, Christopher C Pagano, Justin Kern, and Timothy A Davis. 2011. Near-field distance perception in real and virtual environments using both verbal and action responses. ACM Transactions on Applied Perception (TAP) 8, 3 (2011), 18.

Digital Library

[24]

Donald A Norman. 2002. The design of everyday things. Basic books.

Digital Library

[25]

Grant Pointon, Chelsey Thompson, Sarah Creem-Regehr, Jeanine Stefanucci, and Bobby Bodenheimer. 2018. Affordances as a Measure of Perceptual Fidelity in Augmented Reality. In 2018 IEEE VR 2018 Workshop on Perceptual and Cognitive Issues in AR (PERCAR). 1--6.

[26]

Gurjot Singh, J Edward Swan II, J Adam Jones, and Stephen R Ellis. 2010. Depth judgment measures and occluding surfaces in near-field augmented reality. In Proceedings of the 7th Symposium on Applied Perception in Graphics and Visualization. ACM, 149--156.

Digital Library

[27]

Missie Smith, Nadejda Doutcheva, Joseph L. Gabbard, and Gary Burnett. 2015. Optical see-through head up displays' effect on depth judgments of real world objects. In 2015 IEEE Virtual Reality (VR). 401--405.

[28]

Jeanine K Stefanucci, Sarah H Creem-Regehr, William B Thompson, David A Lessard, and Michael N Geuss. 2015. Evaluating the accuracy of size perception on screen-based displays: Displayed objects appear smaller than real objects. Journal of Experimental Psychology: Applied 21, 3 (2015), 215--223.

[29]

J Edward Swan, Adam Jones, Eric Kolstad, Mark A Livingston, and Harvey S Smallman. 2007. Egocentric depth judgments in optical, see-through augmented reality. IEEE transactions on visualization and computer graphics 13, 3 (2007), 429--442.

Digital Library

[30]

J Edward Swan, Liisa Kuparinen, Scott Rapson, and Christian Sandor. 2017. Visually Perceived Distance Judgments: Tablet-Based Augmented Reality Versus the Real World. International Journal of Human-Computer Interaction 33, 7 (2017), 576--591.

[31]

William H. Warren. 1984. Perceiving affordances: Visual guidance of stair climbing. Journal of Experimental Psychology: Human Perception and Performance 10 (1984), 683--703.

[32]

William H. Warren and Suzanne Whang. 1987. Visual Guidance of Walking Through Apertures: Body Scaled Information for Affordances. Journal of Experimental Psychology: Human Perception and Performance 13 (1987), 371--383.

[33]

Bing Wu, Teng Leng Ooi, and Zijiang J He. 2004. Perceiving distance accurately by a directional process of integrating ground information. Nature 428 (2004), 73--77.

Cited By

Gagnon HFinney HStefanucci JBodenheimer BCreem-Regehr S(2024)Reaching Between Worlds: Calibration and Transfer of Perceived Affordances from Virtual to Real Environments2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR58804.2024.00120(1011-1021)Online publication date: 16-Mar-2024
https://doi.org/10.1109/VR58804.2024.00120
Cooper E(2023)The Perceptual Science of Augmented RealityAnnual Review of Vision Science10.1146/annurev-vision-111022-1237589:1(455-478)Online publication date: 15-Sep-2023
https://doi.org/10.1146/annurev-vision-111022-123758
Gagnon HStefanucci JCreem-Regehr SBodenheimer B(2023)Calibrated Passability Perception in Virtual Reality Transfers to Augmented RealityACM Transactions on Applied Perception10.1145/361345020:4(1-16)Online publication date: 25-Oct-2023
https://dl.acm.org/doi/10.1145/3613450
Show More Cited By

Index Terms

Judging action capabilities in augmented reality
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Virtual reality

Recommendations

Calibrated Passability Perception in Virtual Reality Transfers to Augmented Reality
Special Issue on SAP 2023
As applications for virtual reality (VR) and augmented reality (AR) technology increase, it will be important to understand how users perceive their action capabilities in virtual environments. Feedback about actions may help to calibrate perception for ...
Haptics in Augmented Reality
ICMCS '99: Proceedings of the IEEE International Conference on Multimedia Computing and Systems - Volume 2

An augmented reality system merges synthetic sensory information into a user's perception of a three-dimensional environment. An important performance goal for an augmented reality system is that the user perceives a single seamless environment. In most ...
Augmented reality as perceptual reality
VSMM'06: Proceedings of the 12th international conference on Interactive Technologies and Sociotechnical Systems

As shown in Paul Milgram et al’s Reality-Virtuality Continuum (1994), Augmented Reality occupies a very unique status in the spectrum of Mixed Reality. Unlike Virtual Reality, which is completely made up of the virtual and has been the most important ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SAP '18: Proceedings of the 15th ACM Symposium on Applied Perception

August 2018

162 pages

ISBN:9781450358941

DOI:10.1145/3225153

Conference Chairs:
Cindy Grimm
Oregon State University
,
Peter Willemsen
University of Minnesota
,
Program Chairs:
Joseph Kearney
University of Iowa
,
Bernhard Riecke
Simon Fraser University

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 10 August 2018

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

SAP '18

Sponsor:

SIGGRAPH

SAP '18: ACM Symposium on Applied Perception 2018

August 10 - 11, 2018

British Columbia, Vancouver, Canada

Acceptance Rates

Overall Acceptance Rate 43 of 94 submissions, 46%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

21
Total Citations
View Citations
474
Total Downloads

Downloads (Last 12 months)48
Downloads (Last 6 weeks)7

Reflects downloads up to 02 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Gagnon HFinney HStefanucci JBodenheimer BCreem-Regehr S(2024)Reaching Between Worlds: Calibration and Transfer of Perceived Affordances from Virtual to Real Environments2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR58804.2024.00120(1011-1021)Online publication date: 16-Mar-2024
https://doi.org/10.1109/VR58804.2024.00120
Cooper E(2023)The Perceptual Science of Augmented RealityAnnual Review of Vision Science10.1146/annurev-vision-111022-1237589:1(455-478)Online publication date: 15-Sep-2023
https://doi.org/10.1146/annurev-vision-111022-123758
Gagnon HStefanucci JCreem-Regehr SBodenheimer B(2023)Calibrated Passability Perception in Virtual Reality Transfers to Augmented RealityACM Transactions on Applied Perception10.1145/361345020:4(1-16)Online publication date: 25-Oct-2023
https://dl.acm.org/doi/10.1145/3613450
Bodenheimer BAdams HWhitaker MStefanucci JCreem-Regehr S(2023)Perceiving Absolute Distance in Augmented Reality Displays with Realistic and Non-realistic ShadowsACM Symposium on Applied Perception 202310.1145/3605495.3605800(1-9)Online publication date: 5-Aug-2023
https://dl.acm.org/doi/10.1145/3605495.3605800
Creem-Regehr SStefanucci JBodenheimer B(2022)Perceiving Affordances for Passing Through Apertures: A Discussion of Factors Influencing Replication Across Extended Reality2022 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)10.1109/ISMAR-Adjunct57072.2022.00061(274-275)Online publication date: Oct-2022
https://doi.org/10.1109/ISMAR-Adjunct57072.2022.00061
Zhao YStefanucci JCreem-Regehr SBodenheimer B(2021)The Perception of Affordances in Mobile Augmented RealityACM Symposium on Applied Perception 202110.1145/3474451.3476239(1-10)Online publication date: 16-Sep-2021
https://dl.acm.org/doi/10.1145/3474451.3476239
Gagnon HRosales CMileris RStefanucci JCreem-Regehr SBodenheimer R(2021)Estimating Distances in Action Space in Augmented RealityACM Transactions on Applied Perception10.1145/344906718:2(1-16)Online publication date: 21-May-2021
https://dl.acm.org/doi/10.1145/3449067
Zhao YStefanucci JCreem-Regehr SBodenheimer B(2021)Affordance Judgments in Mobile Augmented Reality with Cues2021 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)10.1109/VRW52623.2021.00162(559-560)Online publication date: Mar-2021
https://doi.org/10.1109/VRW52623.2021.00162
Chakraborty SStefanucci JCreem-Regehr SBodenheimer B(2021)Distance Estimation with Mobile Augmented Reality in Action Space: Effects of Animated Cues2021 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)10.1109/VRW52623.2021.00034(144-147)Online publication date: Mar-2021
https://doi.org/10.1109/VRW52623.2021.00034
Chakraborty SStefanucci JCreem-Regehr SBodenheimer B(2021)Distance Estimation with Social Distancing: A Mobile Augmented Reality Study2021 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)10.1109/ISMAR-Adjunct54149.2021.00027(87-91)Online publication date: Oct-2021
https://doi.org/10.1109/ISMAR-Adjunct54149.2021.00027
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten