skip to main content
10.1145/3613904.3641919acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

The Effect of Spatial Audio on Curvature Gains in VR Redirected Walking

Published: 11 May 2024 Publication History

Abstract

Redirected walking (RDW) is a technique that allows users to navigate larger physical spaces in virtual reality (VR) environments by manipulating the users’ view of the virtual world. In this study, we investigate the effect of adding spatial audio elements to curvature gains in RDW aiming to increase the perceptual threshold for the manipulation and allowing for higher levels of unnoticed redirection. We conducted a user study (n = 18), evaluating perceptual thresholds across conditions with and without spatial audio elements across different curvature gains. We found that spatial audio can significantly increase thresholds with a large effect size. This finding indicates the value of spatial audio for RDW. It could facilitate higher levels of redirection, while maintaining a convincing experience, leading to more freedom to navigate virtual environments in even smaller physical spaces.

Supplemental Material

MP4 File - Video Presentation
Video Presentation
Transcript for: Video Presentation
MP4 File - Video Presentation
Video Presentation
Transcript for: Video Presentation
CSV File - Dataset
The file includes data used for the analysis, consisting of detection percentages across conditions.
JASP File - Supplemental Materials
The file includes the data analysis.

References

[1]
Eric R. Bachmann, Eric Hodgson, Cole Hoffbauer, and Justin Messinger. 2019. Multi-User Redirected Walking and Resetting Using Artificial Potential Fields. IEEE Transactions on Visualization and Computer Graphics 25, 5 (may 2019), 2022–2031. https://doi.org/10.1109/tvcg.2019.2898764
[2]
Jennifer L. Campos, John S. Butler, and Heinrich H. Bülthoff. 2012. Multisensory integration in the estimation of walked distances. Experimental Brain Research 218, 4 (mar 2012), 551–565. https://doi.org/10.1007/s00221-012-3048-1
[3]
James J. Clark and Alan L. Yuille. 1990. Data Fusion for Sensory Information Processing Systems. Springer US. https://doi.org/10.1007/978-1-4757-2076-1
[4]
Robbe Cools and Adalberto L. Simeone. 2019. Investigating the Effect of Distractor Interactivity for Redirected Walking in Virtual Reality. In Symposium on Spatial User Interaction (New Orleans, LA, USA) (SUI ’19). Association for Computing Machinery, New York, NY, USA, Article 4, 5 pages. https://doi.org/10.1145/3357251.3357580
[5]
Johannes Dichgans and Thomas Brandt. 1978. Visual-Vestibular Interaction: Effects on Self-Motion Perception and Postural Control. In Perception. Springer Berlin Heidelberg, 755–804. https://doi.org/10.1007/978-3-642-46354-9_25
[6]
Paul A. Dizio and James R. Lackner. 1986. Perceived orientation, motion, and configuration of the body during viewing of an off-vertical, rotating surface. Perception & Psychophysics 39, 1 (jan 1986), 39–46. https://doi.org/10.3758/bf03207582
[7]
Marc O Ernst and Heinrich H Bülthoff. 2004. Merging the senses into a robust percept. Trends in cognitive sciences 8, 4 (2004), 162–169.
[8]
Linwei Fan, Huiyu Li, and Miaowen Shi. 2022. Redirected Walking for Exploring Immersive Virtual Spaces with HMD: A Comprehensive Review and Recent Advances. IEEE Transactions on Visualization and Computer Graphics (2022), 1–1. https://doi.org/10.1109/tvcg.2022.3179269
[9]
Linwei Fan, Huiyu Li, and Miaowen Shi. 2023. Redirected Walking for Exploring Immersive Virtual Spaces With HMD: A Comprehensive Review and Recent Advances. IEEE Transactions on Visualization and Computer Graphics 29, 10 (Oct. 2023), 4104–4123. https://doi.org/10.1109/tvcg.2022.3179269
[10]
Tobias Feigl, Eliise Kõre, Christopher Mutschler, and Michael Philippsen. 2017. Acoustical manipulation for redirected walking. In Proceedings of the 23rd ACM Symposium on Virtual Reality Software and Technology (Gothenburg, Sweden) (VRST ’17). Association for Computing Machinery, New York, NY, USA, 1–2. https://doi.org/10.1145/3139131.3141205
[11]
Julian Frommel, Sven Sonntag, and Michael Weber. 2017. Effects of Controller-Based Locomotion on Player Experience in a Virtual Reality Exploration Game. In Proceedings of the 12th International Conference on the Foundations of Digital Games (Hyannis, Massachusetts) (FDG ’17). Association for Computing Machinery, New York, NY, USA, Article 30, 6 pages. https://doi.org/10.1145/3102071.3102082
[12]
Peizhong Gao, Keigo Matsumoto, Takuji Narumi, and Michitaka Hirose. 2020. Visual-Auditory Redirection: Multimodal Integration of Incongruent Visual and Auditory Cues for Redirected Walking. In 2020 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE. https://doi.org/10.1109/ismar50242.2020.00092
[13]
E. Bruce Goldstein. 1980. Sensation and perception. Wadsworth Pub. Co. 492 pages.
[14]
Joseph Henrich, Steven J Heine, and Ara Norenzayan. 2010. Most people are not WEIRD. Nature 466, 7302 (2010), 29–29.
[15]
JASP Team. 2021. JASP (Version 0.17.2)[Computer software]. https://jasp-stats.org/
[16]
Andreas Junker, Carl Hutters, Daniel Reipur, Lasse Embol, Niels Christian Nilsson, Stefania Serafin, and Evan Suma Rosenberg. 2021. Revisiting Audiovisual Rotation Gains for Redirected Walking. In 2021 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW). IEEE. https://doi.org/10.1109/vrw52623.2021.00071
[17]
Andrew J. Kolarik, Brian C. J. Moore, Pavel Zahorik, Silvia Cirstea, and Shahina Pardhan. 2015. Auditory distance perception in humans: a review of cues, development, neuronal bases, and effects of sensory loss. Attention, Perception, & Psychophysics 78, 2 (nov 2015), 373–395. https://doi.org/10.3758/s13414-015-1015-1
[18]
James R Lackner. 1977. Induction of illusory self-rotation and nystagmus by a rotating sound-field.Aviation, space, and environmental medicine (1977).
[19]
Eike Langbehn, Paul Lubos, Gerd Bruder, and Frank Steinicke. 2017. Bending the curve: Sensitivity to bending of curved paths and application in room-scale vr. IEEE transactions on visualization and computer graphics 23, 4 (2017), 1389–1398.
[20]
Keigo Matsumoto, Yuki Ban, Takuji Narumi, Yohei Yanase, Tomohiro Tanikawa, and Michitaka Hirose. 2016. Unlimited corridor. In ACM SIGGRAPH 2016 Emerging Technologies. ACM. https://doi.org/10.1145/2929464.2929482
[21]
Florian Meyer, Malte Nogalski, and Wolfgang Fohl. 2016. Detection Thresholds In Audio-Visual Redirected Walking. (2016). https://doi.org/10.5281/ZENODO.851259
[22]
Pedro Monteiro, Diana Carvalho, Miguel Melo, Frederico Branco, and Maximino Bessa. 2018. Application of the steering law to virtual reality walking navigation interfaces. Computers & Graphics 77 (dec 2018), 80–87. https://doi.org/10.1016/j.cag.2018.10.003
[23]
Mahdi Nabiyouni, Ayshwarya Saktheeswaran, Doug A Bowman, and Ambika Karanth. 2015. Comparing the performance of natural, semi-natural, and non-natural locomotion techniques in virtual reality. In 2015 IEEE Symposium on 3D User Interfaces (3DUI). IEEE, 3–10.
[24]
Niels Christian Nilsson, Tabitha Peck, Gerd Bruder, Eri Hodgson, Stefania Serafin, Mary Whitton, Frank Steinicke, and Evan Suma Rosenberg. 2018. 15 years of research on redirected walking in immersive virtual environments. IEEE computer graphics and applications 38, 2 (2018), 44–56.
[25]
Niels Christian Nilsson, Evan Suma, Rolf Nordahl, Mark Bolas, and Stefania Serafin. 2016. Estimation of detection thresholds for audiovisual rotation gains. In 2016 IEEE Virtual Reality (VR). IEEE, 241–242.
[26]
Malte Nogalski and Wolfgang Fohl. 2016. Acoustic redirected walking with auditory cues by means of wave field synthesis. In 2016 IEEE Virtual Reality (VR). IEEE, 245–246.
[27]
Tabitha C. Peck, Henry Fuchs, and Mary C. Whitton. 2011. An evaluation of navigational ability comparing Redirected Free Exploration with Distractors to Walking-in-Place and joystick locomotio interfaces. In 2011 IEEE Virtual Reality Conference. IEEE. https://doi.org/10.1109/vr.2011.5759437
[28]
Herbert L. Pick, David H. Warren, and John C. Hay. 1969. Sensory conflict in judgments of spatial direction. Perception & Psychophysics 6, 4 (jul 1969), 203–205. https://doi.org/10.3758/bf03207017
[29]
Michael I Posner, Mary J Nissen, and Raymond M Klein. 1976. Visual dominance: an information-processing account of its origins and significance.Psychological review 83, 2 (1976), 157.
[30]
Joseph L. Price. 2008. Multisensory Convergence in the Orbital and Ventrolateral Prefrontal Cortex. Chemosensory Perception 1, 2 (apr 2008), 103–109. https://doi.org/10.1007/s12078-008-9013-5
[31]
Sharif Razzaque, Zachariah Kohn, and Mary C. Whitton. 2001. Redirected Walking. https://doi.org/10.2312/EGS.20011036
[32]
Nicholas Rewkowski, Atul Rungta, Mary Whitton, and Ming Lin. 2019. Evaluating the Effectiveness of Redirected Walking with Auditory Distractors for Navigation in Virtual Environments. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE. https://doi.org/10.1109/vr.2019.8798286
[33]
Michael Rietzler, Martin Deubzer, Thomas Dreja, and Enrico Rukzio. 2020. Telewalk: Towards Free and Endless Walking in Room-Scale Virtual Reality. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. ACM. https://doi.org/10.1145/3313831.3376821
[34]
Michael Rietzler, Jan Gugenheimer, Teresa Hirzle, Martin Deubzer, Eike Langbehn, and Enrico Rukzio. 2018. Rethinking Redirected Walking: On the Use of Curvature Gains Beyond Perceptual Limitations and Revisiting Bending Gains. In 2018 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE. https://doi.org/10.1109/ismar.2018.00041
[35]
Roy A. Ruddle and Simon Lessels. 2006. For Efficient Navigational Search, Humans Require Full Physical Movement, but Not a Rich Visual Scene. Psychological Science 17, 6 (jun 2006), 460–465. https://doi.org/10.1111/j.1467-9280.2006.01728.x
[36]
Stefania Serafin, Niels C Nilsson, Erik Sikstrom, Amalia De Goetzen, and Rolf Nordahl. 2013. Estimation of detection thresholds for acoustic based redirected walking techniques. In 2013 IEEE Virtual Reality (VR). IEEE, 161–162.
[37]
Frank Steinicke, Gerd Bruder, Jason Jerald, Harald Frenz, and Markus Lappe. 2008. Analyses of human sensitivity to redirected walking. In Proceedings of the 2008 ACM symposium on Virtual reality software and technology - VRST '08. ACM Press. https://doi.org/10.1145/1450579.1450611
[38]
F. Steinicke, G. Bruder, J. Jerald, H. Frenz, and M. Lappe. 2010. Estimation of Detection Thresholds for Redirected Walking Techniques. IEEE Transactions on Visualization and Computer Graphics 16, 1 (jan 2010), 17–27. https://doi.org/10.1109/tvcg.2009.62
[39]
Evan A. Suma, Gerd Bruder, Frank Steinicke, David M. Krum, and Mark Bolas. 2012. A taxonomy for deploying redirection techniques in immersive virtual environments. In 2012 IEEE Virtual Reality (VR). IEEE. https://doi.org/10.1109/vr.2012.6180877
[40]
Sam Tregillus and Eelke Folmer. 2016. Vr-step: Walking-in-place using inertial sensing for hands free navigation in mobile vr environments. In Proceedings of the 2016 chi conference on human factors in computing systems. 1250–1255.
[41]
Martin Usoh, Kevin Arthur, Mary C. Whitton, Rui Bastos, Anthony Steed, Mel Slater, and Frederick P. Brooks. 1999. Walking > walking-in-place > flying, in virtual environments. In Proceedings of the 26th annual conference on Computer graphics and interactive techniques - SIGGRAPH '99. ACM Press. https://doi.org/10.1145/311535.311589
[42]
Rene Weller, Benjamin Brennecke, and Gabriel Zachmann. 2022. Redirected walking in virtual reality with auditory step feedback. The Visual Computer 38, 9-10 (jul 2022), 3475–3486. https://doi.org/10.1007/s00371-022-02565-4
[43]
Felix A. Wichmann and N. Jeremy Hill. 2001. The psychometric function: I. Fitting, sampling, and goodness of fit. Perception & Psychophysics 63, 8 (nov 2001), 1293–1313. https://doi.org/10.3758/bf03194544
[44]
Wen Zhang, Parasanga Samarasinghe, Hanchi Chen, and Thushara Abhayapala. 2017. Surround by Sound: A Review of Spatial Audio Recording and Reproduction. Applied Sciences 7, 5 (may 2017), 532. https://doi.org/10.3390/app7050532

Cited By

View all
  • (2024)Towards Accessible Musical Performances in Virtual Reality: Designing a Conceptual Framework for Omnidirectional Audio DescriptionsProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3675618(1-17)Online publication date: 27-Oct-2024

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
CHI '24: Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems
May 2024
18961 pages
ISBN:9798400703300
DOI:10.1145/3613904
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 May 2024

Permissions

Request permissions for this article.

Check for updates

Badges

Author Tags

  1. curvature gains
  2. redirected walking
  3. spatial audio
  4. virtual reality

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

CHI '24

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025
ACM CHI Conference on Human Factors in Computing Systems
April 26 - May 1, 2025
Yokohama , Japan

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)660
  • Downloads (Last 6 weeks)57
Reflects downloads up to 17 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Towards Accessible Musical Performances in Virtual Reality: Designing a Conceptual Framework for Omnidirectional Audio DescriptionsProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3675618(1-17)Online publication date: 27-Oct-2024

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Full Text

View this article in Full Text.

Full Text

HTML Format

View this article in HTML Format.

HTML Format

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media