skip to main content
10.1145/3180308.3180360acmconferencesArticle/Chapter ViewAbstractPublication PagesiuiConference Proceedingsconference-collections
poster

Using Spatialized Audio to Improve Human Spatial Knowledge Acquisition in Virtual Reality

Published: 05 March 2018 Publication History

Abstract

Picture schematization, the construction of spatial object maps from images, has useful applications ranging from indoor exploration to augmented reality. Since using human spatial knowledge improves schematization, crowdsourcing workflows are introduced for extracting spatial information from pictures. As 360° pictures are now available in virtual reality (VR), crowdsourced 360° picture schematization also becomes essential. Yet, the vergence-accommodation conflict (VAC) in head-mounted displays (HMDs) causes inaccurate spatial perception in VR. We propose integration of spatial audio in VR as a cost-effective and intuitive feature to support spatial perception. This study indicates spatial audio cues in VR are naturally incorporated by humans to significantly improve human spatial knowledge accuracy and, subsequently, crowdsourcing schematization.

References

[1]
G. Kramida and A. Varshney. 2016. Resolving the Vergence-Accommodation Conflict in Head-Mounted Displays. IEEE Transactions on Visualization and Computer Graphics 22, 7 (January 2016), 1912--1931.
[2]
H. Couclelis, R. G. Golledge, N. Gale, and W. Tobler. 1987. Exploring the anchor-point hypothesis of spatial cognition. Journal of Environmental Psychology 7, 2 (June 1987), 99--122.
[3]
H. Rao. 2015. Towards a Crowd-based Picture Schematization System. In Proceedings of the 20th International Conference on Intelligent User Interfaces Companion (IUI Companion '15). ACM, New York, NY, USA, 101--104.
[4]
H. Q. Dinh, Neff Walker, Larry F. Hodges, Chang Song, and Akira Kobayashi. 1999. Evaluating the importance of multi-sensory input on memory and the sense of presence in virtual environments. Proceedings IEEE Virtual Reality (March 1999), 222--228.
[5]
S. Fuhrmann, F. Langguth, N. Moehrle, M. Waechter, and M. Goesele. 2015. MVE-An image-based reconstruction environment. Comput. Graph. 53, PA (December 2015), 44--53.

Cited By

View all
  • (2024)SoundHapticVR: Head-Based Spatial Haptic Feedback for Accessible Sounds in Virtual Reality for Deaf and Hard of Hearing UsersProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3675639(1-17)Online publication date: 27-Oct-2024
  • (2024)MIMOSA: Human-AI Co-Creation of Computational Spatial Audio Effects on VideosProceedings of the 16th Conference on Creativity & Cognition10.1145/3635636.3656189(156-169)Online publication date: 23-Jun-2024
  • (2021)Using Audio Reverberation to Compensate Distance Compression in Virtual RealityACM Symposium on Applied Perception 202110.1145/3474451.3476236(1-10)Online publication date: 16-Sep-2021
  • Show More Cited By

Index Terms

  1. Using Spatialized Audio to Improve Human Spatial Knowledge Acquisition in Virtual Reality

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      IUI '18 Companion: Companion Proceedings of the 23rd International Conference on Intelligent User Interfaces
      March 2018
      141 pages
      ISBN:9781450355711
      DOI:10.1145/3180308
      Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 05 March 2018

      Check for updates

      Author Tags

      1. Spatial memory
      2. crowdsourcing
      3. picture schematization
      4. spatial audio
      5. virtual reality

      Qualifiers

      • Poster
      • Research
      • Refereed limited

      Funding Sources

      • Ministry of Science and Technology, Taiwan
      • National Taiwan University

      Conference

      IUI'18
      Sponsor:

      Acceptance Rates

      IUI '18 Companion Paper Acceptance Rate 63 of 127 submissions, 50%;
      Overall Acceptance Rate 746 of 2,811 submissions, 27%

      Upcoming Conference

      IUI '25

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)21
      • Downloads (Last 6 weeks)1
      Reflects downloads up to 14 Feb 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)SoundHapticVR: Head-Based Spatial Haptic Feedback for Accessible Sounds in Virtual Reality for Deaf and Hard of Hearing UsersProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3675639(1-17)Online publication date: 27-Oct-2024
      • (2024)MIMOSA: Human-AI Co-Creation of Computational Spatial Audio Effects on VideosProceedings of the 16th Conference on Creativity & Cognition10.1145/3635636.3656189(156-169)Online publication date: 23-Jun-2024
      • (2021)Using Audio Reverberation to Compensate Distance Compression in Virtual RealityACM Symposium on Applied Perception 202110.1145/3474451.3476236(1-10)Online publication date: 16-Sep-2021
      • (2020)EarVR: Using Ear Haptics in Virtual Reality for Deaf and Hard-of-Hearing PeopleIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2020.297344126:5(2084-2093)Online publication date: May-2020
      • (2020)Spatialized Audio in a Custom-Built OpenGL-Based Ear Training Virtual EnvironmentIEEE Computer Graphics and Applications10.1109/MCG.2020.301343940:5(67-81)Online publication date: 1-Sep-2020
      • (2019)VARI-SOUNDProceedings of the 2019 CHI Conference on Human Factors in Computing Systems10.1145/3290605.3300713(1-14)Online publication date: 2-May-2019

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media