skip to main content
10.1145/3491101.3519824acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
poster

Towards Balancing Real-World Awareness and VR Immersion in Mobile VR

Published: 28 April 2022 Publication History

Abstract

Virtual Reality (VR) can be used to create immersive infotainment experiences for car passengers. However, not much is known about how to best incorporate the essentials of their surroundings for balancing real-world awareness and immersion. To address this gap, we explored 2D and 3D visual cues of the rear-seat space to notify passengers about different real-world tasks (lower armrest, take cup, close window, and hold handle) during a first-person game in VR. Results from our pilot study (n = 19) show that users perceive a lower workload in the task hold handle than all other tasks. They also feel more immersed in VR after completing this task, compared to take cup and close window. Based on our findings, we propose real-world task types, synchronous visual cues, and various input and transition approaches as promising future research directions.

Supplementary Material

MP4 File (3491101.3519824-video-figure.mp4)
Video Figure

References

[1]
Audi. 2019. holoride: Virtual Reality meets the real world. https://www.audi.com/en/experience-audi/mobility-and-trends/digitalization/holoride-virtual-reality-meets-the-real-world.html Accessed: 2022-3-2.
[2]
Laura Bajorunaite, Stephen Brewster, and Julie R Williamson. 2021. Virtual Reality in transit: how acceptable is VR use on public transport?. In 2021 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW). IEEE, Lisbon, Portugal, 432–433.
[3]
Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qual. Res. Psychol. 3, 2 (Jan. 2006), 77–101. https://doi.org/10.1191/1478088706qp063oa
[4]
John Brooke 1996. SUS-A quick and dirty usability scale. Usability evaluation in industry 189, 194 (1996), 4–7.
[5]
Peter Fröhlich, Clemens Schartmüller, Philipp Wintersberger, Andreas Riener, Andrew L Kun, Stephen Brewster, Orit Shaer, and Matthias Baldauf. 2021. AutoWork 2021: Workshop on the Future of Work and Well-Being with Automated Vehicles. In 13th International Conference on Automotive User Interfaces and Interactive Vehicular Applications. Association for Computing Machinery, New York, NY, USA, 164–166.
[6]
Ceenu George, Patrick Tamunjoh, and Heinrich Hussmann. 2020. Invisible Boundaries for VR: Auditory and Haptic Signals as Indicators for Real World Boundaries. IEEE Transactions on Visualization and Computer Graphics 26, 12(2020), 3414–3422.
[7]
Ceenu George, An Ngo Tien, and Heinrich Hussmann. 2020. Seamless, Bi-directional Transitions along the Reality-Virtuality Continuum: A Conceptualization and Prototype Exploration. In 2020 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE, Porto de Galinhas, Brazil, 412–424.
[8]
Sarthak Ghosh, Lauren Winston, Nishant Panchal, Philippe Kimura-Thollander, Jeff Hotnog, Douglas Cheong, Gabriel Reyes, and Gregory D Abowd. 2018. NotifiVR: exploring interruptions and notifications in virtual reality. IEEE transactions on visualization and computer graphics 24, 4(2018), 1447–1456.
[9]
Philipp Hock, Sebastian Benedikter, Jan Gugenheimer, and Enrico Rukzio. 2017. CarVR: Enabling In-Car Virtual Reality Entertainment. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). Association for Computing Machinery, New York, NY, USA, 4034–4044. https://doi.org/10.1145/3025453.3025665
[10]
Pascal Knierim and Albrecht Schmidt. 2020. The Virtual Office of the Future: Are Centralized Workplaces Obsolete? (August 2020). https://www.microsoft.com/en-us/research/publication/the-virtual-office-of-the-future-are-centralized-workplaces-obsolete/
[11]
Yoshiki Kudo, Anthony Tang, Kazuyuki Fujita, Isamu Endo, Kazuki Takashima, and Yoshifumi Kitamura. 2021. Towards Balancing VR Immersion and Bystander Awareness. Proceedings of the ACM on Human-Computer Interaction 5, ISS(2021), 1–22.
[12]
Matthew Lakier, Lennart E. Nacke, Takeo Igarashi, and Daniel Vogel. 2019. Cross-Car, Multiplayer Games for Semi-Autonomous Driving. In Proceedings of the Annual Symposium on Computer-Human Interaction in Play (Barcelona, Spain) (CHI PLAY ’19). Association for Computing Machinery, New York, NY, USA, 467–480. https://doi.org/10.1145/3311350.3347166
[13]
Bettina Laugwitz, Theo Held, and Martin Schrepp. 2008. Construction and evaluation of a user experience questionnaire. In Symposium of the Austrian HCI and usability engineering group. Springer, Berlin, Heidelberg, 63–76. https://doi.org/10.1007/978-3-540-89350-9_6
[14]
Jingyi Li, Ceenu George, Andrea Ngao, Kai Holländer, Stefan Mayer, and Andreas Butz. 2020. An Exploration of Users’ Thoughts on Rear-Seat Productivity in Virtual Reality. In 12th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Virtual Event, DC, USA) (AutomotiveUI ’20). Association for Computing Machinery, New York, NY, USA, 92–95. https://doi.org/10.1145/3409251.3411732
[15]
Jingyi Li, Ceenu George, Andrea Ngao, Kai Holländer, Stefan Mayer, and Andreas Butz. 2021. Rear-Seat Productivity in Virtual Reality: Investigating VR Interaction in the Confined Space of a Car. Multimodal Technologies and Interaction 5, 4 (2021), 15.
[16]
Jingyi Li and Linda Hirsch. 2021. Multi-Modal Transition and Traces in Everyday Mobile Virtual Reality. In ISS’21 Workshop Proceedings: ”Transitional Interfaces in Mixed and Cross-Reality: A new frontier?”, Hans-Christian Jetter, Jan-Henrik Schröder, Jan Gugenheimer, Mark Billinghurst, Christoph Anthes, Mohamed Khamis, and Tiare Feuchtner (Eds.). Association for Computing Machinery, New York, NY, USA. https://doi.org/10.18148/kops/352-2-1dhqpjucpo75v9
[17]
Jingyi Li, Yong Ma, Puzhen Li, and Andreas Butz. 2021. A Journey Through Nature: Exploring Virtual Restorative Environments as a Means to Relax in Confined Spaces. In Creativity and Cognition (Virtual Event, Italy) (C&C’21). Association for Computing Machinery, New York, NY, USA, Article 22, 9 pages. https://doi.org/10.1145/3450741.3465248
[18]
Jingyi Li, Agnes Reda, and Andreas Butz. 2021. Queasy Rider: How Head Movements Influence Motion Sickness in Passenger Use of Head-Mounted Displays. In 13th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Leeds, United Kingdom) (AutomotiveUI ’21). Association for Computing Machinery, New York, NY, USA, 28–38. https://doi.org/10.1145/3409118.3475137
[19]
Mark McGill and Stephen Brewster. 2019. Virtual Reality Passenger Experiences. In Proceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications: Adjunct Proceedings (Utrecht, Netherlands) (AutomotiveUI ’19). Association for Computing Machinery, New York, NY, USA, 434–441. https://doi.org/10.1145/3349263.3351330
[20]
Mark McGill, Roderick Murray-Smith, Daniel Boland, and Stephen A. Brewster. 2015. A Dose of Reality: Overcoming Usability Challenges in VR Head-Mounted Displays. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems (Seoul, Republic of Korea) (CHI EA ’15). Association for Computing Machinery, New York, NY, USA, 177. https://doi.org/10.1145/2702613.2732491
[21]
Mark McGill, Alexander Ng, and Stephen Brewster. 2017. I Am The Passenger: How Visual Motion Cues Can Influence Sickness For In-Car VR. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). Association for Computing Machinery, New York, NY, USA, 5655–5668. https://doi.org/10.1145/3025453.3026046
[22]
Mark McGill, Julie Williamson, Alexander Ng, Frank Pollick, and Stephen Brewster. 2020. Challenges in passenger use of mixed reality headsets in cars and other transportation. Virtual Reality 24, 4 (2020), 583–603.
[23]
Daniel Medeiros, Rafael dos Anjos, Nadia Pantidi, Kun Huang, Maurício Sousa, Craig Anslow, and Joaquim Jorge. 2021. Promoting reality awareness in virtual reality through proxemics. In 2021 IEEE Virtual Reality and 3D User Interfaces (VR). IEEE, Lisboa, Portugal, 21–30.
[24]
Benedikt Merz, Alexandre N. Tuch, and Klaus Opwis. 2016. Perceived User Experience of Animated Transitions in Mobile User Interfaces. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems (San Jose, California, USA) (CHI EA ’16). Association for Computing Machinery, New York, NY, USA, 3152–3158. https://doi.org/10.1145/2851581.2892489
[25]
Metaverse. 2019. Oculus. https://www.oculus.com/ Accessed: 2022-3-2.
[26]
VR Oculus. 2021. Mixed Reality with Passthrough. https://developer.oculus.com/blog/mixed-reality-with-passthrough/ Accessed: 2022-3-2.
[27]
Joseph O’Hagan and Julie R Williamson. 2020. Reality aware VR headsets. In Proceedings of the 9TH ACM International Symposium on Pervasive Displays (Manchester, United Kingdom) (PerDis ’20). Association for Computing Machinery, New York, NY, USA, 9–17. https://doi.org/10.1145/3393712.3395334
[28]
Pablo E Paredes, Stephanie Balters, Kyle Qian, Elizabeth L Murnane, Francisco Ordóñez, Wendy Ju, and James A Landay. 2018. Driving with the fishes: Towards calming and mindful virtual reality experiences for the car. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 2, 4 (2018), 1–21.
[29]
Sylvia Rothe, Alexander Schmidt, Mario Montagud, Daniel Buschek, and Heinrich Hußmann. 2021. Social viewing in cinematic virtual reality: a design space for social movie applications. Virtual Reality 25, 3 (2021), 613–630.
[30]
Thomas W Schubert. 2003. The sense of presence in virtual environments: A three-component scale measuring spatial presence, involvement, and realness.Z. für Medienpsychologie 15, 2 (2003), 69–71.
[31]
Adalberto L. Simeone, Eduardo Velloso, and Hans Gellersen. 2015. Substitutional Reality: Using the Physical Environment to Design Virtual Reality Experiences. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (Seoul, Republic of Korea) (CHI ’15). Association for Computing Machinery, New York, NY, USA, 3307–3316. https://doi.org/10.1145/2702123.2702389
[32]
Robert Stone, Charlotte Small, James Knight, Cheng Qian, and Vishant Shingari. 2014. Virtual natural environments for restoration and rehabilitation in healthcare. In Virtual, Augmented Reality and Serious Games for Healthcare 1. Springer, Berlin, Heidelberg, 497–521. https://doi.org/10.1007/978-3-642-54816-1_24
[33]
Julius von Willich, Markus Funk, Florian Müller, Karola Marky, Jan Riemann, and Max Mühlhäuser. 2019. You Invaded My Tracking Space! Using Augmented Virtuality for Spotting Passersby in Room-Scale Virtual Reality. In Proceedings of the 2019 on Designing Interactive Systems Conference (San Diego, CA, USA) (DIS ’19). Association for Computing Machinery, New York, NY, USA, 487–496. https://doi.org/10.1145/3322276.3322334
[34]
Julie R. Williamson, Mark McGill, and Khari Outram. 2019. PlaneVR: Social Acceptability of Virtual Reality for Aeroplane Passengers. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–14. https://doi.org/10.1145/3290605.3300310
[35]
Jacob O. Wobbrock, Leah Findlater, Darren Gergle, and James J. Higgins. 2011. The Aligned Rank Transform for Nonparametric Factorial Analyses Using Only Anova Procedures. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Vancouver, BC, Canada) (CHI ’11). Association for Computing Machinery, New York, NY, USA, 143–146. https://doi.org/10.1145/1978942.1978963

Cited By

View all
  • (2023)Location-Aware Virtual Reality for Situational Awareness On the RoadProceedings of the 2023 ACM Symposium on Spatial User Interaction10.1145/3607822.3614530(1-12)Online publication date: 13-Oct-2023
  • (2023)Co-Speculating on Dark Scenarios and Unintended Consequences of a Ubiquitous(ly) Augmented RealityProceedings of the 2023 ACM Designing Interactive Systems Conference10.1145/3563657.3596073(2392-2407)Online publication date: 10-Jul-2023
  • (2023)Visual Metaphors for Notification into Virtual Environments2023 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)10.1109/ISMAR-Adjunct60411.2023.00020(60-64)Online publication date: 16-Oct-2023
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
CHI EA '22: Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems
April 2022
3066 pages
ISBN:9781450391566
DOI:10.1145/3491101
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 April 2022

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. HMD
  2. everyday mobile VR
  3. passenger
  4. transitional interfaces

Qualifiers

  • Poster
  • Research
  • Refereed limited

Funding Sources

Conference

CHI '22
Sponsor:
CHI '22: CHI Conference on Human Factors in Computing Systems
April 29 - May 5, 2022
LA, New Orleans, USA

Acceptance Rates

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Upcoming Conference

CHI 2025
ACM CHI Conference on Human Factors in Computing Systems
April 26 - May 1, 2025
Yokohama , Japan

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)120
  • Downloads (Last 6 weeks)8
Reflects downloads up to 20 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2023)Location-Aware Virtual Reality for Situational Awareness On the RoadProceedings of the 2023 ACM Symposium on Spatial User Interaction10.1145/3607822.3614530(1-12)Online publication date: 13-Oct-2023
  • (2023)Co-Speculating on Dark Scenarios and Unintended Consequences of a Ubiquitous(ly) Augmented RealityProceedings of the 2023 ACM Designing Interactive Systems Conference10.1145/3563657.3596073(2392-2407)Online publication date: 10-Jul-2023
  • (2023)Visual Metaphors for Notification into Virtual Environments2023 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)10.1109/ISMAR-Adjunct60411.2023.00020(60-64)Online publication date: 16-Oct-2023
  • (2023)Balancing Real-world Interaction and VR Immersion with AI Vision Robotic Arm2023 IEEE International Conference on Mechatronics and Automation (ICMA)10.1109/ICMA57826.2023.10215826(2051-2057)Online publication date: 6-Aug-2023
  • (2022)Designing Mobile MR WorkspacesProceedings of the ACM on Human-Computer Interaction10.1145/35467166:MHCI(1-17)Online publication date: 20-Sep-2022
  • (2022)A Touch of Realities: Car-Interior-Based Haptic Interaction Supports In-Car VR Recovery from InterruptionsProceedings of Mensch und Computer 202210.1145/3543758.3543768(229-239)Online publication date: 4-Sep-2022

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media