Uwe Gruenefeld
Yvonne Brück
Susanne Boll
ABSTRACT
Locating objects in the environment can be a difficult task, especially when the objects are occluded. With Augmented Reality, we can alternate our perceived reality by augmenting it with visual cues or removing visual elements of reality, helping users to locate occluded objects. However, to our knowledge, it has not yet been evaluated which visualization technique works best for estimating the distance and size of occluded objects in optical see-through head-mounted Augmented Reality. To address this, we compare four different visualization techniques derived from previous work in a laboratory user study. Our results show that techniques utilizing additional aid (textual or with a grid) help users to estimate the distance to occluded objects more accurately. In contrast, a realistic rendering of the scene, such as a cutout in the wall, resulted in higher distance estimation errors.
- Benjamin Avery, Christian Sandor, and Bruce H. Thomas. 2009. Improving Spatial Perception for Augmented Reality X-Ray Vision. In 2009 IEEE Virtual Reality Conference. 79–82. https://doi.org/10.1109/VR.2009.4811002Google Scholar
- Ronald T. Azuma. 1997. A Survey of Augmented Reality. Presence: Teleoperators and Virtual Environments 6, 4(1997), 355–385. https://doi.org/10.1162/pres.1997.6.4.355 arXiv:https://doi.org/10.1162/pres.1997.6.4.355Google ScholarDigital Library
- Woodrow Barfield, Craig Rosenberg, and Thomass A Furness III. 1995. Situation awareness as a function of frame of reference, computer-graphics eyepoint elevation, and geometric field of view. The International journal of aviation psychology 5, 3 (1995), 233–256.Google Scholar
- Peter Barnum, Yaser Sheikh, Ankur Datta, and Takeo Kanade. 2009. Dynamic seethroughs: Synthesizing hidden views of moving objects. In 2009 8th IEEE International Symposium on Mixed and Augmented Reality. 111–114. https://doi.org/10.1109/ISMAR.2009.5336483Google ScholarDigital Library
- Andy Cockburn, Amy Karlson, and Benjamin B. Bederson. 2009. A Review of Overview+Detail, Zooming, and Focus+Context Interfaces. ACM Comput. Surv. 41, 1, Article 2 (Jan. 2009), 31 pages. https://doi.org/10.1145/1456650.1456652Google ScholarDigital Library
- Ashley Colley, Olli Koskenranta, Jani Väyrynen, Leena Ventä-Olkkonen, and Jonna Häkkilä. 2014. Windows to Other Places: Exploring Solutions for Seeing through Walls Using Handheld Projection. In Proceedings of the 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, Foundational (Helsinki, Finland) (NordiCHI ’14). Association for Computing Machinery, New York, NY, USA, 127–136. https://doi.org/10.1145/2639189.2639226Google ScholarDigital Library
- Niklas Elmqvist, Ulf Assarsson, and Philippas Tsigas. 2007. Employing Dynamic Transparency for 3D Occlusion Management: Design Issues and Evaluation. In Human-Computer Interaction – INTERACT 2007, Cécilia Baranauskas, Philippe Palanque, Julio Abascal, and Simone Diniz Junqueira Barbosa (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 532–545.Google ScholarCross Ref
- Niklas Elmqvist and Philippas Tsigas. 2008. A Taxonomy of 3D Occlusion Management for Visualization. IEEE Transactions on Visualization and Computer Graphics 14, 5 (Sep. 2008), 1095–1109. https://doi.org/10.1109/TVCG.2008.59Google ScholarDigital Library
- Mustafa Tolga Eren and Selim Balcisoy. 2018. Evaluation of X-ray visualization techniques for vertical depth judgments in underground exploration. The Visual Computer 34, 3 (01 Mar 2018), 405–416. https://doi.org/10.1007/s00371-016-13465Google Scholar
- Steven Feiner, Blair Macintyre, and Dorée Seligmann. 1993. Knowledge-based augmented reality. Commun. ACM 36, 7 (1993), 53–62.Google ScholarDigital Library
- Chris Furmanski, Ronald Azuma, and Mike Daily. 2002. Augmented-Reality Visualizations Guided by Cognition: Perceptual Heuristics for Combining Visual and Obscured Information. In Proceedings of the 1st International Symposium on Mixed and Augmented Reality(ISMAR ’02). IEEE Computer Society, USA, 320.Google ScholarCross Ref
- Simon Grondin. 2016. Depth Perception. Springer International Publishing, Cham, 103–122. https://doi.org/10.1007/978-3-319-31791-5_7Google Scholar
- Howard E. Gruber. 1954. The Relation of Perceived Size to Perceived Distance. The American Journal of Psychology 67, 3 (1954), 411–426. http://www.jstor.org/stable/1417933Google ScholarCross Ref
- Uwe Gruenefeld, Lars Prädel, and Wilko Heuten. 2019. Locating Nearby Physical Objects in Augmented Reality. In Proceedings of the 18th International Conference on Mobile and Ubiquitous Multimedia (Pisa, Italy) (MUM ’19). Association for Computing Machinery, New York, NY, USA, Article 1, 10 pages. https://doi.org/10.1145/3365610.3365620Google ScholarDigital Library
- Marco Iosa, Augusto Fusco, Giovanni Morone, and Stefano Paolucci. 2012. Walking there: environmental influence on walking-distance estimation. Behavioural brain research 226, 1 (2012), 124–132.Google Scholar
- F. E. Jamiy and R. Marsh. 2019. Distance Estimation In Virtual Reality And Augmented Reality: A Survey. In 2019 IEEE International Conference on Electro Information Technology (EIT). 063–068.Google Scholar
- James Kalat. 2015. Biological psychology. Nelson Education.Google Scholar
- Denis Kalkofen, Erick Mendez, and Dieter Schmalstieg. 2009. Comprehensible Visualization for Augmented Reality. IEEE Transactions on Visualization and Computer Graphics 15, 2 (March 2009), 193–204. https://doi.org/10.1109/TVCG.2008.96Google ScholarDigital Library
- Klemen Lilija, Henning Pohl, Sebastian Boring, and Kasper Hornbundefinedk. 2019. Augmented Reality Views for Occluded Interaction. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, Article 446, 12 pages. https://doi.org/10.1145/3290605.3300676Google ScholarDigital Library
- Peter Lincoln, Alex Blate, Montek Singh, Turner Whitted, Andrei State, Anselmo Lastra, and Henry Fuchs. 2016. From Motion to Photons in 80 Microseconds: Towards Minimal Latency for Virtual and Augmented Reality. IEEE Transactions on Visualization and Computer Graphics 22, 4 (April 2016), 1367–1376. https://doi.org/10.1109/TVCG.2016.2518038Google ScholarDigital Library
- Mark A Livingston, J Edward Swan, Joseph L Gabbard, Tobias H Hollerer, Deborah Hix, Simon J Julier, Yohan Baillot, and Dennis Brown. 2003. Resolving multiple occluded layers in augmented reality. In The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings. IEEE, 56–65.Google ScholarCross Ref
- Alejandro Martin-Gomez, Ulrich Eck, and Nassir Navab. 2019. Visualization Techniques for Precise Alignment in VR: A Comparative Study. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). 735–741. https://doi.org/10.1109/VR.2019.8798135Google Scholar
- Paul Milgram and Fumio Kishino. 1994. A taxonomy of mixed reality visual displays. IEICE TRANSACTIONS on Information and Systems 77, 12 (1994), 1321–1329.Google Scholar
- Shohei Mori, Sei Ikeda, and Hideo Saito. 2017. A survey of diminished reality: Techniques for visually concealing, eliminating, and seeing through real objects. IPSJ Transactions on Computer Vision and Applications 9, 1 (June 2017), 17. https://doi.org/10.1186/s41074-017-0028-1Google ScholarCross Ref
- Shohei Mori, Momoko Maezawa, and Hideo Saito. 2017. A work area visualization by multi-view camera-based diminished reality. Multimodal Technologies and Interaction 1, 3 (2017), 18.Google ScholarCross Ref
- Alessandro Mulloni, Hartmut Seichter, and Dieter Schmalstieg. 2011. Handheld augmented reality indoor navigation with activity-based instructions. In Proceedings of the 13th international conference on human computer interaction with mobile devices and services. ACM, 211–220.Google ScholarDigital Library
- Nassir Navab, Joerg Traub, Tobias Sielhorst, Marco Feuerstein, and Christoph Bichlmeier. 2007. Action- and Workflow-Driven Augmented Reality for Computer-Aided Medical Procedures. IEEE Computer Graphics and Applications 27, 5 (Sep. 2007), 10–14. https://doi.org/10.1109/MCG.2007.117Google ScholarDigital Library
- John W Philbeck and Jack M Loomis. 1997. Comparison of two indicators of perceived egocentric distance under full-cue and reduced-cue conditions.Journal of Experimental Psychology: Human Perception and Performance 23, 1(1997), 72.Google ScholarCross Ref
- John W Philbeck, Jack M Loomis, and Andrew C Beall. 1997. Visually perceived location is an invariant in the control of action. Perception & Psychophysics 59, 4 (1997), 601–612.Google ScholarCross Ref
- Dirk Reiners, Didier Stricker, Gudrun Klinker, and Stefan Müller. 1999. Augmented reality for construction tasks: Doorlock assembly. In Proceedings of the international workshop on Augmented reality: placing artificial objects in real scenes: placing artificial objects in real scenes. AK Peters, Ltd., 31–46.Google ScholarDigital Library
- Cindy M Robertson, Blair MacIntyre, and Bruce N Walker. 2008. An evaluation of graphical context when the graphics are outside of the task area. In 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality. IEEE, 73–76.Google ScholarDigital Library
- Gerhard Schall, Erick Mendez, Ernst Kruijff, Eduardo Veas, Sebastian Junghanns, Bernhard Reitinger, and Dieter Schmalstieg. 2009. Handheld augmented reality for underground infrastructure visualization. Personal and ubiquitous computing 13, 4 (2009), 281–291.Google Scholar
- William Steptoe, Simon Julier, and Anthony Steed. 2014. Presence and discernability in conventional and non-photorealistic immersive augmented reality. In 2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 213–218. https://doi.org/10.1109/ISMAR.2014.6948430Google ScholarCross Ref
- Takahiro Tsuda, Haruyoshi Yamamoto, Yoshinari Kameda, and Yuichi Ohta. 2005. Visualization Methods for Outdoor See-through Vision. In Proceedings of the 2005 International Conference on Augmented Tele-Existence (Christchurch, New Zealand) (ICAT ’05). Association for Computing Machinery, New York, NY, USA, 62–69. https://doi.org/10.1145/1152399.1152412Google ScholarDigital Library
- Stefanie Zollmann, Raphael Grasset, Gerhard Reitmayr, and Tobias Langlotz. 2014. Image-Based X-Ray Visualization Techniques for Spatial Understanding in Outdoor Augmented Reality. In Proceedings of the 26th Australian Computer-Human Interaction Conference on Designing Futures: The Future of Design (Sydney, New South Wales, Australia) (OzCHI ’14). Association for Computing Machinery, New York, NY, USA, 194–203. https://doi.org/10.1145/2686612.2686642Google ScholarDigital Library
- Stefanie Zollmann, Gerhard Schall, Sebastian Junghanns, and Gerhard Reitmayr. 2012. Comprehensible and Interactive Visualizations of GIS Data in Augmented Reality. In Advances in Visual Computing, George Bebis, Richard Boyle, Bahram Parvin, Darko Koracin, Charless Fowlkes, Sen Wang, Min-Hyung Choi, Stephan Mantler, Jürgen Schulze, Daniel Acevedo, Klaus Mueller, and Michael Papka (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 675–685.Google Scholar
Recommendations
EyeSee360: designing a visualization technique for out-of-view objects in head-mounted augmented reality
SUI '17: Proceedings of the 5th Symposium on Spatial User InteractionHead-mounted displays allow user to augment reality or dive into a virtual one. However, these 3D spaces often come with problems due to objects that may be out of view. Visualizing these out-of-view objects is useful under certain scenarios, such as ...
Locating nearby physical objects in augmented reality
MUM '19: Proceedings of the 18th International Conference on Mobile and Ubiquitous MultimediaLocating objects in physical environments can be an exhausting and frustrating task, particularly when these objects are out of the user's view or occluded by other objects. With recent advances in Augmented Reality (AR), these environments can be ...
Visualizing out-of-view objects in head-mounted augmented reality
MobileHCI '17: Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and ServicesVarious off-screen visualization techniques that point to off-screen objects have been developed for small screen devices. A similar problem arises with head-mounted Augmented Reality (AR) with respect to the human field-of-view, where objects may be ...
Comments