skip to main content
10.1145/3334480.3383035acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
abstract
Public Access

MazeRunVR: An Open Benchmark for VR Locomotion Performance, Preference and Sickness in the Wild

Authors Info & Claims
Published:25 April 2020Publication History

ABSTRACT

Locomotion in virtual reality (VR) is one of the biggest problems for large scale adoption of VR applications. Yet, to our knowledge, there are few studies conducted in-the-wild to understand performance metrics and general user preference for different mechanics. In this paper, we present the first steps towards an open framework to create a VR locomotion benchmark. As a viability study, we investigate how well the users move in VR when using three different locomotion mechanics. It was played in over 124 sessions across 10 countries in a period of three weeks. The included prototype locomotion mechanics are arm swing,walk-in-place and trackpad movement. We found that over-all, users performed significantly faster using arm swing and trackpad when compared to walk-in-place. For subjective preference, arm swing was significantly more preferred over the other two methods. Finally for induced sickness, walk-in-place was the overall most sickness-inducing locomotion method.

References

  1. Alan Chamberlain, Andy Crabtree, Tom Rodden, Matt Jones, and Yvonne Rogers. 2012. Research in the Wild: Understanding 'in the Wild' Approaches to Design and Development. In Proceedings of the Designing Interactive Systems Conference (DIS '12). ACM, New York, NY, USA, 795--796. DOI: http://dx.doi.org/10.1145/2317956.2318078Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Sandy Claes, Niels Wouters, Karin Slegers, and Andrew Vande Moere. 2015. Controlling In-the-Wild Evaluation Studies of Public Displays. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 81--84. DOI: http://dx.doi.org/10.1145/2702123.2702353Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Games Cloudhead. 2015. VR Navigation. (2015). http://cloudheadgames.com/cloudhead/vr-navigation/Google ScholarGoogle Scholar
  4. Rose Johnson, Yvonne Rogers, Janet van der Linden, and Nadia Bianchi-Berthouze. 2012. Being in the Thick of In-the-wild Studies: The Challenges and Insights of Researcher Participation. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). ACM, New York, NY, USA, 1135--1144. DOI: http://dx.doi.org/10.1145/2207676.2208561Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Joe Marshall and Paul Tennent. 2017. Touchomatic: Interpersonal Touch Gaming In The Wild. In Proceedings of the 2017 Conference on Designing Interactive Systems (DIS '17). ACM, New York, NY, USA, 417--428. DOI: http://dx.doi.org/10.1145/3064663.3064727Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Aske Mottelson and Kasper Hornbæk. 2017. Virtual reality studies outside the laboratory. In Proceedings of the 23rd ACM symposium on virtual reality software and technology. ACM, 9.Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Yun Suen Pai, Zikun Chen, Liwei Chan, Megumi Isogai, Hideaki Kimata, and Kai Kunze. 2018. Pinchmove: Improved Accuracy of User Mobility for Near-field Navigation in Virtual Environments. In Proceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '18). ACM, New York, NY, USA, Article 7, 11 pages. DOI: http://dx.doi.org/10.1145/3229434.3229470Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Yun Suen Pai and Kai Kunze. 2017. Armswing: Using Arm Swings for Accessible and Immersive Navigation in AR/VR Spaces. In Proceedings of the 16th International Conference on Mobile and Ubiquitous Multimedia (MUM '17). ACM, New York, NY, USA, 189--198. DOI: http://dx.doi.org/10.1145/3152832.3152864Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Anthony Steed, Sebastian Frlston, Maria Murcia Lopez, Jason Drummond, Ye Pan, and David Swapp. 2016. An ?in the wild'experiment on presence and embodiment using consumer virtual reality equipment. IEEE transactions on visualization and computer graphics 22, 4 (2016), 1406--1414.Google ScholarGoogle Scholar
  10. Sam Tregillus and Eelke Folmer. 2016. VR-STEP: Walking-in-Place Using Inertial Sensing for Hands Free Navigation in Mobile VR Environments. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 1250--1255. DOI: http://dx.doi.org/10.1145/2858036.2858084Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Chenglei Wu, Zhihao Tan, Zhi Wang, and Shiqiang Yang. 2017. A dataset for exploring user behaviors in VR spherical video streaming. In Proceedings of the 8th ACM on Multimedia Systems Conference. ACM, 193--198.Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Jackie Junrui Yang, Christian Holz, Eyal Ofek, and Andrew D Wilson. 2019. DreamWalker: Substituting Real-World Walking Experiences with a Virtual Reality. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology. ACM, 1093--1107.Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. MazeRunVR: An Open Benchmark for VR Locomotion Performance, Preference and Sickness in the Wild

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Conferences
        CHI EA '20: Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems
        April 2020
        4474 pages
        ISBN:9781450368193
        DOI:10.1145/3334480

        Copyright © 2020 Owner/Author

        Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 25 April 2020

        Check for updates

        Qualifiers

        • abstract

        Acceptance Rates

        Overall Acceptance Rate4,785of17,176submissions,28%

        Upcoming Conference

        CHI '24
        CHI Conference on Human Factors in Computing Systems
        May 11 - 16, 2024
        Honolulu , HI , USA

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      HTML Format

      View this article in HTML Format .

      View HTML Format