Yi-Hsuan Huang
ABSTRACT
Virtual Reality (VR) technologies are increasingly being applied to various contexts like those gaming, therapy, training, and education. Several of these applications require high degrees of accuracy in spatial and depth perception. Contemporary VR experiences continue to be confronted by the issue of distance compression wherein people systematically underestimate distances in the virtual world, leading to impoverished experiences. Consequently, a number of studies have focused on extensively understanding and exploring factors that influence this phenomenon to address the challenges it poses. Inspired by previous work that has sought to compensate distance compression effects in VR, we examined the potential of manipulating an auditory stimulus’ reverberation time (RT) to alter how users perceive depth. To this end, we conducted a two action forced choice study in which participants repeatedly made relative depth judgements between a pair of scenes featuring a virtual character placed at different distances with varying RTs. Results revealed that RT influences how users perceive depth with this influence being more pronounced in the near field. We found that users tend to associate longer RTs with farther distances and vice versa, indicating the potential to alter RT towards compensating distance underestimation in VR. However, it must be noted that excessively increasing RT (especially in the near field) could come at the cost of sensory segregation, wherein users are unable to unify visual and auditory sensory stimuli in their perceptions of depth. Researchers must hence strive to find the optimal amount of RT to add to a stimulus to ensure seamless virtual experiences.
- Scott M. Andrus, Graham Gaylor, and Bobby Bodenheimer. 2014. Distance Estimation in Virtual Environments Using Different HMDs. In Proceedings of the ACM Symposium on Applied Perception. ACM, 130–130.Google Scholar
Digital Library
- Will Bailey and Bruno M Fazenda. 2017. The effect of reverberation and audio spatialization on egocentric distance estimation of objects in stereoscopic virtual reality. The Journal of the Acoustical Society of America 141, 5 (2017), 3510–3510.Google ScholarCross Ref
- Leo Leroy Beranek and Tim Mellow. 2012. Acoustics: sound fields and transducers. Academic Press, 473.Google Scholar
- Jonathan S Berry, David AT Roberts, and Nicolas S Holliman. 2014. 3D sound and 3D image interactions: a review of audio-visual depth perception. Proc.SPIE 9014(2014), 1–16.Google Scholar
- Stephanie Claire Boyle. 2018. Investigating the neural mechanisms underlying audio-visual perception using electroencephalography (EEG). Ph.D. Dissertation. University of Glasgow.Google Scholar
- P Breedveld, HG Stassen, DW Meijer, and LPS Stassen. 1999. Theoretical background and conceptual solution for depth perception and eye-hand coordination problems in laparoscopic surgery. Minimally invasive therapy & allied technologies 8, 4(1999), 227–234.Google Scholar
- Adelbert W Bronkhorst and Tammo Houtgast. 1999. Auditory distance perception in rooms. Nature 397, 6719 (1999), 517.Google Scholar
- Gerd Bruder, Fernando Argelaguet Sanz, Anne-Hélène Olivier, and Anatole Lécuyer. 2015. Distance estimation in large immersive projection systems, revisited. In 2015 IEEE Virtual Reality (VR). IEEE, 27–32.Google Scholar
- Lauren E. Buck, Mary K. Young, and Bobby Bodenheimer. 2018. A Comparison of Distance Estimation in HMD-Based Virtual Environments with Different HMD-Based Conditions. ACM Trans. Appl. Percept. 15, 3 (July 2018), 21:1–21:15.Google ScholarDigital Library
- Yi-Ting Chen, Chi-Hsuan Hsu, Chih-Han Chung, Yu-Shuen Wang, and Sabarish V Babu. 2019. iVRNote: Design, creation and evaluation of an interactive note-taking interface for study and reflection in VR learning environments. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, 172–180.Google ScholarCross Ref
- Marina A Cidota, Rory MS Clifford, Stephan G Lukosch, and Mark Billinghurst. 2016. Using Visual Effects to Facilitate Depth Perception for Spatial Tasks in Virtual and Augmented Reality. In 2016 IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct). IEEE, 172–177.Google ScholarCross Ref
- Philip Coleman, Andreas Franck, P Jackson, R Hughes, Luca Remaggi, and Frank Melchior. 2017. Object-based reverberation for spatial audio. Journal of the Audio Engineering Society 65, 1/2 (2017), 66–77.Google ScholarCross Ref
- Brian Cullen, Karen Collins, Andrew Hogue, and Bill Kapralos. 2016. Sound and stereoscopic 3D: Examining the effects of sound on depth perception in stereoscopic 3D. In 2016 7th International Conference on Information, Intelligence, Systems Applications (IISA). IEEE, 1–6.Google ScholarCross Ref
- Alexandre Gomes de Siqueira, Rohith Venkatakrishnan, Roshan Venkatakrishnan, Ayush Bharqava, Kathryn Lucaites, Hannah Solini, Moloud Nasiri, Andrew Robb, Christopher Pagano, Brygg Ullmer, and Sabarish V. Babu. 2021. Empirically Evaluating the Effects of Perceptual Information Channels on the Size Perception of Tangibles in Near-Field Virtual Reality. In 2021 IEEE Virtual Reality and 3D User Interfaces (VR). 1–10. https://doi.org/10.1109/VR50410.2021.00086Google Scholar
- Elham Ebrahimi, Bliss M Altenhoff, Christopher C Pagano, and Sabarish V Babu. 2015. Carryover effects of calibration to visual and proprioceptive information on near field distance judgments in 3D user interaction. In 2015 IEEE Symposium on 3D User Interfaces (3DUI). IEEE, 97–104.Google ScholarCross Ref
- Elham Ebrahimi, Leah S Hartman, Andrew Robb, Christopher C Pagano, and Sabarish V Babu. 2018. Investigating the effects of anthropomorphic fidelity of self-avatars on near field depth perception in immersive virtual environments. In 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, 1–8.Google ScholarCross Ref
- Marc O Ernst and Martin S Banks. 2002. Humans integrate visual and haptic information in a statistically optimal fashion. Nature 415, 6870 (2002), 429.Google Scholar
- Pablo Etchemendy, Ezequiel Abregú, Esteban Calcagno, Manuel Eguía, Nilda Vechiatti, Federico Iasi, and Ramiro Vergara. 2017. Auditory environmental context affects visual distance perception. Scientific Reports 7(2017).Google Scholar
- Daniel Finnegan. 2017. Compensating for distance compression in virtual audiovisual environments. Ph.D. Dissertation. University of Bath.Google Scholar
- Daniel J. Finnegan, Eamonn O’Neill, and Michael J. Proulx. 2016. Compensating for Distance Compression in Audiovisual Virtual Environments Using Incongruence. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 200–212.Google ScholarDigital Library
- Donald L Fisher, AP Pollatsek, and Abhishek Pradhan. 2006. Can novice drivers be trained to scan for information that will reduce their likelihood of a crash?Injury Prevention 12, suppl 1 (2006), i25–i29.Google Scholar
- Timofey Y. Grechkin, Tien Dat Nguyen, Jodie M. Plumert, James F. Cremer, and Joseph K. Kearney. 2010. How Does Presentation Method and Measurement Protocol Affect Distance Estimation in Real and Virtual Environments?ACM Trans. Appl. Percept. 7, 4 (July 2010), 26:1–26:18.Google Scholar
- William LeRoy Heinrichs, Patricia Youngblood, Phillip M Harter, and Parvati Dev. 2008. Simulation for team training and assessment: case studies of online training with virtual worlds. World journal of surgery 32, 2 (2008), 161–170.Google Scholar
- Fernando Iazzetta, Fabio Kon, Marcelo Gomes de Queiroz, Flávio Soares, Correa da Silva, and Marcio de Avelar Gomes. 2004. AcMus: Computational tools for measurement, analysis and simulation of room acoustics. In Proceedings of the European Acoustics Symposium.Google Scholar
- Victoria Interrante, Brian Ries, and Lee Anderson. 2006. Distance perception in immersive virtual environments, revisited. In IEEE virtual reality conference (VR 2006). IEEE, 3–10.Google ScholarDigital Library
- Neofytos Kaplanis, Søren Bech, Søren Holdt Jensen, and Toon van Waterschoot. 2014. Perception of Reverberation in Small Rooms: A Literature Study. In Audio Engineering Society Conference: 55th International Conference: Spatial Audio.Google Scholar
- Jonathan W. Kelly, Lucia A. Cherep, Brenna Klesel, Zachary D. Siegel, and Seth George. 2018. Comparison of Two Methods for Improving Distance Perception in Virtual Reality. ACM Trans. Appl. Percept. 15, 2 (March 2018), 11:1–11:11.Google ScholarDigital Library
- Scott A. Kuhl, William B. Thompson, and Sarah H. Creem-Regehr. 2006. Minification Influences Spatial Judgments in Virtual Environments. In Proceedings of the 3rd Symposium on Applied Perception in Graphics and Visualization. ACM, 15–19.Google ScholarDigital Library
- Eike Langbehn, Tino Raupp, Gerd Bruder, Frank Steinicke, Benjamin Bolte, and Markus Lappe. 2016. Visual Blur in Immersive Virtual Environments: Does Depth of Field or Motion Blur Affect Distance and Speed Estimation?. In Proceedings of the 22Nd ACM Conference on Virtual Reality Software and Technology. ACM, 241–250.Google ScholarDigital Library
- Markus Leyrer, Sally A Linkenauger, Heinrich H Bülthoff, Uwe Kloos, and Betty Mohler. 2011. The influence of eye height and avatars on egocentric distance estimates in immersive virtual environments. In Proceedings of the ACM SIGGRAPH symposium on applied perception in graphics and visualization. 67–74.Google ScholarDigital Library
- Markus Leyrer, Sally A. Linkenauger, Heinrich H. Bülthoff, and Betty J. Mohler. 2015. Eye Height Manipulations: A Possible Solution to Reduce Underestimation of Egocentric Distances in Head-Mounted Displays. ACM Trans. Appl. Percept. 12, 1 (Feb. 2015), 1:1–1:23.Google ScholarDigital Library
- Bochao Li, Ruimin Zhang, and Scott Kuhl. 2014. Minication affects action-based distance judgments in oculus rift HMDs. In Proceedings of the ACM Symposium on Applied Perception. ACM, 91–94.Google ScholarDigital Library
- Chiuhsiang Joe Lin, Bereket Haile Woldegiorgis, Dino Caesaron, and Lai-Yu Cheng. 2015. Distance estimation with mixed real and virtual targets in stereoscopic displays. Displays 36(2015), 41–48.Google ScholarCross Ref
- Jack M Loomis, Joshua M Knapp, 2003. Visual perception of egocentric distance in real and virtual environments. Virtual and adaptive environments 11 (2003), 21–46.Google Scholar
- Donald H Mershon and L Edward King. 1975. Intensity and reverberation as factors in the auditory perception of egocentric distance. Perception & Psychophysics 18, 6 (Nov. 1975), 409–415.Google ScholarCross Ref
- Ross Messing and Frank H Durgin. 2005. Distance perception and the visual horizon in head-mounted displays. ACM Transactions on Applied Perception (TAP) 2, 3 (2005), 234–250.Google ScholarDigital Library
- Damian T. Murphy and Simon Shelley. 2010. OpenAIR: An Interactive Auralization Web Resource and Database. In Audio Engineering Society Convention 129. Audio Engineering Society.Google Scholar
- Adrian KT Ng, Leith KY Chan, and Henry YK Lau. 2017. Corrective feedback for depth perception in CAVE-like systems. In 2017 IEEE Virtual Reality (VR). IEEE, 293–294.Google Scholar
- Alex Peer and Kevin Ponto. 2016. Perceptual space warping: Preliminary exploration. In 2016 IEEE Virtual Reality (VR). IEEE, 261–262.Google Scholar
- Kevin Ponto, Michael Gleicher, Robert G Radwin, and Hyun Joon Shin. 2013. Perceptual calibration for immersive display environments. IEEE Transactions on Visualization and Computer Graphics 19, 4(2013), 691–700.Google ScholarDigital Library
- Rebekka S. Renner, Boris M. Velichkovsky, and Jens R. Helmert. 2013. The Perception of Egocentric Distances in Virtual Environments - A Review. ACM Comput. Surv. 46, 2 (Dec. 2013), 23:1–23:40.Google ScholarDigital Library
- Adam R Richardson and David Waller. 2005. The effect of feedback training on distance estimation in virtual environments. Applied Cognitive Psychology: The Official Journal of the Society for Applied Research in Memory and Cognition 19, 8 (2005), 1089–1108.Google ScholarCross Ref
- Jannick P Rolland, William Gibson, and Dan Ariely. 1995. Towards quantifying depth and size perception in virtual environments. Presence: Teleoperators & Virtual Environments 4, 1(1995), 24–49.Google ScholarDigital Library
- Cynthia S Sahm, Sarah H Creem-Regehr, William B Thompson, and Peter Willemsen. 2005. Throwing versus walking as indicators of distance perception in similar real and virtual environments. ACM Transactions on Applied Perception (TAP) 2, 1 (2005), 35–45.Google ScholarDigital Library
- Ladan Shams and Robyn Kim. 2010. Crossmodal influences on visual perception. Physics of life reviews 7, 3 (2010), 269–284.Google Scholar
- Amy Turner, Jonathan Berry, and Nick Holliman. 2011. Can the perception of depth in stereoscopic images be influenced by 3D sound?Proc.SPIE 7863(2011), 1–10.Google Scholar
- Vesa Valimaki, Julian D Parker, Lauri Savioja, Julius O Smith, and Jonathan S Abel. 2012. Fifty years of artificial reverberation. IEEE Transactions on Audio, Speech, and Language Processing 20, 5(2012), 1421–1448.Google ScholarDigital Library
- Koorosh Vaziri, Peng Liu, Sahar Aseeri, and Victoria Interrante. 2017. Impact of Visual and Experiential Realism on Distance Perception in VR Using a Custom Video See-through System. In Proceedings of the ACM Symposium on Applied Perception. ACM, 8:1–8:8.Google ScholarDigital Library
- Ekaterina Volkova, Stephan de la Rosa, Heinrich H. Bülthoff, and Betty Mohler. 2014a. The MPI Emotional Body Expressions Database for Narrative Scenarios. PLOS ONE 9, 12 (Dec. 2014), 1–28.Google ScholarCross Ref
- Ekaterina P Volkova, Betty J Mohler, Trevor J Dodds, Joachim Tesch, and Heinrich H Bülthoff. 2014b. Emotion categorization of body expressions in narrative scenarios. Frontiers in psychology 5 (2014), 623.Google Scholar
- Jaye Wald and Steven Taylor. 2000. Efficacy of virtual reality exposure therapy to treat driving phobia: a case report. Journal of behavior therapy and experimental psychiatry 31, 3-4(2000), 249–257.Google ScholarCross Ref
- Peter Willemsen, Mark B Colton, Sarah H Creem-Regehr, and William B Thompson. 2009a. The effects of head-mounted display mechanical properties and field of view on distance judgments in virtual environments. ACM Transactions on Applied Perception (TAP) 6, 2 (2009), 1–14.Google ScholarDigital Library
- Peter Willemsen, Mark B. Colton, Sarah H. Creem-Regehr, and William B. Thompson. 2009b. The Effects of Head-mounted Display Mechanical Properties and Field of View on Distance Judgments in Virtual Environments. ACM Trans. Appl. Percept. 6, 2 (March 2009), 8:1–8:14.Google ScholarDigital Library
- Bob G Witmer and Paul B Kline. 1998. Judging perceived and traversed distance in virtual environments. Presence 7, 2 (1998), 144–167.Google ScholarDigital Library
- Yang Xi, Ning Gao, Mengchao Zhang, Lin Liu, and Qi Li. 2018. The Bayesian Causal Inference in Multisensory Information Processing: A Narrative Review. In International Conference on Intelligent Information Hiding and Multimedia Signal Processing. Springer, 151–161.Google Scholar
- Seraphina Yong and Hao-Chuan Wang. 2018. Using Spatialized Audio to Improve Human Spatial Knowledge Acquisition in Virtual Reality. In Proceedings of the 23rd International Conference on Intelligent User Interfaces Companion. ACM, 51:1–51:2.Google ScholarDigital Library
- Mary K. Young, Graham B. Gaylor, Scott M. Andrus, and Bobby Bodenheimer. 2014. A Comparison of Two Cost-differentiated Virtual Reality Systems for Perception and Action Tasks. In Proceedings of the ACM Symposium on Applied Perception. ACM, 83–90.Google ScholarDigital Library
- Zhiying Zhou, Adrian David Cheok, Xubo Yang, and Yan Qiu. 2004. An experimental study on the role of software synthesized 3D sound in augmented reality environments. Interacting with Computers 16, 5 (2004), 989–1016.Google ScholarCross Ref
- Christine J Ziemer, Jodie M Plumert, James F Cremer, and Joseph K Kearney. 2009. Estimating distance in real and virtual environments: Does order make a difference?Attention, Perception, & Psychophysics 71, 5 (2009), 1095–1106.Google ScholarCross Ref
- Using Audio Reverberation to Compensate Distance Compression in Virtual Reality
Recommendations
Near-field distance perception in real and virtual environments using both verbal and action responses
Few experiments have been performed to investigate near-field egocentric distance estimation in an Immersive Virtual Environment (IVE) as compared to the Real World (RW). This article investigates near-field distance estimation in IVEs and RW conditions ...
The effects of virtual reality, augmented reality, and motion parallax on egocentric depth perception
APGV '08: Proceedings of the 5th symposium on Applied perception in graphics and visualizationAs the use of virtual and augmented reality applications becomes more common, the need to fully understand how observers perceive spatial relationships grows more critical. One of the key requirements in engineering a practical virtual or augmented ...
Extending Virtual Reality Display Wall Environments Using Augmented Reality
SUI '19: Symposium on Spatial User InteractionTwo major form factors for virtual reality are head-mounted displays and large display environments such as CAVE®and the LCD-based successor CAVE2®. Each of these has distinct advantages and limitations based on how they’re used. This work explores ...
Comments