skip to main content
research-article

PAWS: Personalized Arm and Wrist Movements With Sensitivity Mappings for Controller-Free Locomotion in Virtual Reality

Published:13 September 2023Publication History
Skip Abstract Section

Abstract

Virtual Reality (VR) headsets equipped with multiple cameras enable hands-only teleportation techniques without requiring any physical controller. Hands-only teleportation is an effective alternative to controllers for navigation tasks in virtual reality - allowing users to move from one point to another instantaneously. However, the current implementation of hands-only techniques does not consider users' physical attributes (e.g., arm's reach). Thus, a hands-only teleportation technique can lead to different user experiences based on physical attributes. We propose PAWS, a personalized arm and wrist-based teleportation technique that incorporates users' physical attributes for improved teleportation experiences. We first evaluate different degrees of teleportation personalization with no-, partial, and full personalization. We find that full personalization offers faster locomotion - but at the cost of degraded performances with distant targets due to increased sensitivity. We hence further explore different combinations of mapping functions (e.g., sigmoid, quadratic) to personalize motor movements and find that asymmetric functions result in improved performance. Overall, our results show that PAWS helps users to navigate quickly in virtual environments.

Skip Supplemental Material Section

Supplemental Material

v7mhci217.mp4

mp4

46.9 MB

References

  1. Ofer Arazy, Oded Nov, and Nanda Kumar. 2015. Personalityzation: UI personalization, theoretical grounding in HCI and design research. AIS Transactions on Human-Computer Interaction 7, 2 (2015), 43--69.Google ScholarGoogle ScholarCross RefCross Ref
  2. Tomislav Bezmalinovic. 2022. Cambria: Meta's high-end headset launches without Controller - Report. (2022). Retrieved September 15, 2022 from https://mixed-news.com/en/cambria-metas-high-end-headset-launches-without-controllerreport/.Google ScholarGoogle Scholar
  3. Costas Boletsis and Jarl Erik Cedergren. 2019. VR locomotion in the new era of virtual reality: an empirical comparison of prevalent techniques. Advances in Human-Computer Interaction 2019 (2019).Google ScholarGoogle Scholar
  4. Benjamin Bolte, Frank Steinicke, and Gerd Bruder. 2011. The jumper metaphor: an effective navigation technique for immersive display setups. In Proceedings of Virtual Reality International Conference, Vol. 1.Google ScholarGoogle Scholar
  5. Evren Bozgeyikli, Andrew Raij, Srinivas Katkoori, and Rajiv Dubey. 2016a. Locomotion in virtual reality for individuals with autism spectrum disorder. In Proceedings of the 2016 Symposium on Spatial User Interaction. 33--42.Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Evren Bozgeyikli, Andrew Raij, Srinivas Katkoori, and Rajiv Dubey. 2016b. Point & Teleport Locomotion Technique for Virtual Reality. In Proceedings of the 2016 Annual Symposium on Computer-Human Interaction in Play (CHI PLAY '16). Association for Computing Machinery, New York, NY, USA, 205--216. DOI:http://dx.doi.org/10.1145/2967934.2968105Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. W. Broll, I. Lindt, J. Ohlenburg, I. Herbst, M. Wittkamper, and T. Novotny. 2005. An infrastructure for realizing custom-tailored augmented reality user interfaces. IEEE Transactions on Visualization and Computer Graphics 11, 6 (2005), 722--733. DOI:http://dx.doi.org/10.1109/TVCG.2005.90Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Kelly Caine. 2016. Local Standards for Sample Size at CHI (CHI '16). Association for Computing Machinery, New York, NY, USA. DOI:http://dx.doi.org/10.1145/2858036.2858498Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Jeff Chastine, Nicole Kosoris, and Joshua Skelton. 2013. A study of gesture-based first person control. In Proceedings of CGAMES'2013 USA. IEEE, 79--86.Google ScholarGoogle ScholarCross RefCross Ref
  10. Heni Cherni, Natacha Métayer, and Nicolas Souliman. 2020. Literature review of locomotion techniques in virtual reality. International Journal of Virtual Reality (2020).Google ScholarGoogle ScholarCross RefCross Ref
  11. Sohan Chowdhury, A K M Amanat Ullah, Nathan Bruce Pelmore, Pourang Irani, and Khalad Hasan. 2022. WriArm: Leveraging Wrist Movement to Design WristArm Based Teleportation in VR. In 2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 317--325. DOI:http://dx.doi.org/10.1109/ISMAR55827.2022.00047Google ScholarGoogle ScholarCross RefCross Ref
  12. Chris G Christou and Poppy Aristidou. 2017. Steering versus teleport locomotion for head mounted displays. In International conference on augmented reality, virtual reality and computer graphics. Springer, 431--446.Google ScholarGoogle ScholarCross RefCross Ref
  13. Jacob Cohen and others. 1965. Some statistical issues in psychological research. Handbook of clinical psychology (1965), 95--121.Google ScholarGoogle Scholar
  14. NCD Risk Factor Collaboration and others. 2016. A century of trends in adult human height. Elife 5 (2016), e13410.Google ScholarGoogle ScholarCross RefCross Ref
  15. Noah Coomer, Sadler Bullard, William Clinton, and Betsy Williams-Sanders. 2018. Evaluating the Effects of Four VR Locomotion Methods: Joystick, Arm-Cycling, Point-Tugging, and Teleporting. In Proceedings of the 15th ACM Symposium on Applied Perception (SAP '18). Association for Computing Machinery, New York, NY, USA, Article 7, 8 pages. DOI:http://dx.doi.org/10.1145/3225153.3225175Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Andrea Ferracani, Daniele Pezzatini, Jacopo Bianchini, Gianmarco Biscini, and Alberto Del Bimbo. 2016. Locomotion by Natural Gestures for Immersive Virtual Environments. In Proceedings of the 1st International Workshop on Multimedia Alternate Realities (AltMM '16). Association for Computing Machinery, New York, NY, USA, 21--24. DOI:http://dx.doi. org/10.1145/2983298.2983307Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Eelke Folmer, Isayas Berhe Adhanom, and Aniruddha Prithul. 2021. Teleportation in Virtual Reality; A Mini-Review. Frontiers in Virtual Reality (2021), 138.Google ScholarGoogle Scholar
  18. Julian Frommel, Sven Sonntag, and MichaelWeber. 2017. Effects of Controller-Based Locomotion on Player Experience in a Virtual Reality Exploration Game. In Proceedings of the 12th International Conference on the Foundations of Digital Games (FDG '17). Association for Computing Machinery, New York, NY, USA, Article 30, 6 pages. DOI: http://dx.doi.org/10.1145/3102071.3102082Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Markus Funk, Florian Müller, Marco Fendrich, Megan Shene, Moritz Kolvenbach, Niclas Dobbertin, Sebastian Günther, and Max Mühlhäuser. 2019. Assessing the Accuracy of Point & Teleport Locomotion with Orientation Indication for Virtual Reality Using Curved Trajectories. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). Association for Computing Machinery, New York, NY, USA, 1--12. DOI:http://dx.doi.org/10.1145/ 3290605.3300377Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Martin Gonzalez-Rodriguez, Jorge Manrubia, Agueda Vidau, and Marcos Gonzalez-Gallego. 2009. Improving accessibility with user-tailored interfaces. Applied Intelligence 30, 1 (2009), 65--71. DOI:http://dx.doi.org/10.1007/s10489-007- 0098--3Google ScholarGoogle ScholarCross RefCross Ref
  21. Martín González Rodríguez, J Ramón Pérez Pérez, and M Paule Ruíz. 2004. Designing user interfaces tailored to the current user's requirements in real time. In International Conference on Computers for Handicapped Persons. Springer, 69--75.Google ScholarGoogle Scholar
  22. Khalad Hasan, David Ahlström, and Pourang Irani. 2013. Ad-binning: leveraging around device space for storing, browsing and retrieving mobile device content. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 899--908.Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Khalad Hasan, David Ahlström, Junhyeok Kim, and Pourang Irani. 2017. Airpanes: Two-handed around-device interaction for pane switching on smartphones. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. 679--691.Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Juan David Hincapié-Ramos, Xiang Guo, Paymahn Moghadasian, and Pourang Irani. 2014. Consumed Endurance: A Metric to Quantify Arm Fatigue of Mid-Air Interactions (CHI '14). Association for Computing Machinery, New York, NY, USA, 1063--1072. DOI:http://dx.doi.org/10.1145/2556288.2557130Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Errol R Hoffmann, Colin G Drury, and Carol J Romanowski. 2011. Performance in one-, two-and three-dimensional terminal aiming tasks. Ergonomics 54, 12 (2011), 1175--1185.Google ScholarGoogle ScholarCross RefCross Ref
  26. Juan Pablo Hourcade, Christopher M Nguyen, Keith B Perry, and Natalie L Denburg. 2010. Pointassist for older adults: analyzing sub-movement characteristics to aid in pointing tasks. In Proceedings of the sigchi conference on human factors in computing systems. 1115--1124.Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Rachel Huang, Carisa Harris-Adamson, Dan Odell, and David Rempel. 2019. Design of finger gestures for locomotion in virtual reality. Virtual Reality & Intelligent Hardware 1, 1 (2019), 1--9.Google ScholarGoogle ScholarCross RefCross Ref
  28. Maryam Khademi, Hossein Mousavi Hondori, Alison McKenzie, Lucy Dodakian, Cristina Videira Lopes, and Steven C Cramer. 2014. Free-hand interaction with leap motion controller for stroke rehabilitation. In CHI'14 Extended Abstracts on Human Factors in Computing Systems. 1663--1668.Google ScholarGoogle Scholar
  29. Mohamed Khamis, Daniel Buschek, Tobias Thieron, Florian Alt, and Andreas Bulling. 2018. EyePACT: Eye-Based Parallax Correction on Touch-Enabled Interactive Displays. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 1, 4, Article 146 (jan 2018), 18 pages. DOI:http://dx.doi.org/10.1145/3161168Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Chaowanan Khundam. 2015. First person movement control with palm normal and hand gesture interaction in virtual reality. In 2015 12th International Joint Conference on Computer Science and Software Engineering (JCSSE). IEEE, 325--330.Google ScholarGoogle ScholarCross RefCross Ref
  31. Alexander Kulik, André Kunert, and Bernd Froehlich. 2020. On motor performance in virtual 3d object manipulation. IEEE transactions on visualization and computer graphics 26, 5 (2020), 2041--2050.Google ScholarGoogle ScholarCross RefCross Ref
  32. Aqueasha Martin-Hammond, Abdullah Ali, Catherine Hornback, and Amy K. Hurst. 2015. Understanding Design Considerations for Adaptive User Interfaces for Accessible Pointing with Older and Younger Adults. In Proceedings of the 12th International Web for All Conference (W4A '15). Association for Computing Machinery, New York, NY, USA, Article 19, 10 pages. DOI:http://dx.doi.org/10.1145/2745555.2746645Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. Aqueasha Martin-Hammond, Foad Hamidi, Tejas Bhalerao, Christian Ortega, Abdullah Ali, Catherine Hornback, Casey Means, and Amy Hurst. 2018. Designing an adaptive web navigation interface for users with variable pointing performance. In Proceedings of the 15th International Web for All Conference (W4A '18). Association for Computing Machinery, New York, NY, USA, Article 31, 10 pages. DOI:http://dx.doi.org/10.1145/3192714.3192818Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. Andrii Matviienko, Florian Müller, Martin Schmitz, Marco Fendrich, and Max Mühlhäuser. 2022. SkyPort: Investigating 3D Teleportation Methods in Virtual Environments. In CHI Conference on Human Factors in Computing Systems (CHI '22). Association for Computing Machinery, New York, NY, USA, Article 516, 11 pages. DOI:http://dx.doi.org/10.1145/ 3491102.3501983Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. Mark R Mine. 1995. Virtual environment interaction techniques. UNC Chapel Hill CS Dept (1995).Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. MRTK2. 2022. MRTK2-Unity Developer Documentation - MRTK 2. (2022). Retrieved September 15, 2022 from https://docs.microsoft.com/en-us/windows/mixed-reality/mrtk-unity/mrtk2/?view=mrtkunity-2022-05.Google ScholarGoogle Scholar
  37. Oculus. 2022. Oculus Developer Center. (2022). Retrieved September 15, 2022 from https://developer.oculus.com/.Google ScholarGoogle Scholar
  38. Yun Suen Pai and Kai Kunze. 2017. Armswing: Using arm swings for accessible and immersive navigation in ar/vr spaces. In Proceedings of the 16th International Conference on Mobile and Ubiquitous Multimedia. 189--198.Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. Laxmi Pandey, Khalad Hasan, and Ahmed Sabbir Arif. 2021. Acceptability of Speech and Silent Speech Input Methods in Private and Public. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1--13.Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. Octavian Postolache, Luís Teixeira, João Cordeiro, Luísa Lima, Patrícia Arriaga, Mariana Rodrigues, and Pedro Girão. 2019. Tailored Virtual Reality for Smart Physiotherapy. In 2019 11th International Symposium on Advanced Topics in Electrical Engineering (ATEE). 1--6. DOI:http://dx.doi.org/10.1109/ATEE.2019.8724903Google ScholarGoogle Scholar
  41. Mahfuz Rahman, Sean Gustafson, Pourang Irani, and Sriram Subramanian. 2009. Tilt Techniques: Investigating the Dexterity ofWrist-Based Input. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '09). Association for Computing Machinery, New York, NY, USA, 1943--1952. DOI:http://dx.doi.org/10.1145/1518701.1518997Google ScholarGoogle ScholarDigital LibraryDigital Library
  42. SL Reeves, C Varakamin, and CJ Henry. 1996. The relationship between arm-span measurement and height with special reference to gender and ethnicity. European journal of clinical nutrition 50, 6 (June 1996), 398-400. http: //europepmc.org/abstract/MED/8793422Google ScholarGoogle Scholar
  43. RogPodge. 2022. Teleport system - MRTK 2. (2022). Retrieved September 15, 2022 from https://docs.microsoft.com/enus/ windows/mixed-reality/mrtk-unity/mrtk2/features/teleport-system/teleport-system?view=mrtkunity-2022-05.Google ScholarGoogle Scholar
  44. Alexander Schäfer, Gerd Reis, and Didier Stricker. 2021. Controlling teleportation-based locomotion in virtual reality with hand gestures: a comparative evaluation of two-handed and one-handed techniques. Electronics 10, 6 (2021), 715.Google ScholarGoogle ScholarCross RefCross Ref
  45. Martin Usoh, Kevin Arthur, Mary C. Whitton, Rui Bastos, Anthony Steed, Mel Slater, and Frederick P. Brooks. 1999. Walking > Walking-in-Place > Flying, in Virtual Environments. In Proceedings of the 26th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '99). ACM Press/Addison-Wesley Publishing Co., USA, 359--364. DOI:http://dx.doi.org/10.1145/311535.311589Google ScholarGoogle ScholarDigital LibraryDigital Library
  46. Valve. 2022a. Half-Life: Alyx on Steam. (2022). Retrieved September 15, 2022 from https://store.steampowered.com/app/546560/HalfLife_Alyx/.Google ScholarGoogle Scholar
  47. Valve. 2022b. SDK Installation - Valve Developer Community. (2022). Retrieved September 15, 2022 from https://developer.valvesoftware.com/wiki/SDK_Installation.Google ScholarGoogle Scholar
  48. VIVE. 2022. VIVE Focus 3 - VR Headset for Metaverse Solutions. (2022). Retrieved September 15, 2022 from https://www.vive.com/us/product/vive-focus3/overview/.Google ScholarGoogle Scholar
  49. Julius von Willich, Martin Schmitz, Florian Müller, Daniel Schmitt, and Max Mühlhäuser. 2020. Podoportation: Foot-Based Locomotion in Virtual Reality. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI '20). Association for Computing Machinery, New York, NY, USA, 1--14. DOI:http://dx.doi.org/10.1145/3313831.3376626Google ScholarGoogle ScholarDigital LibraryDigital Library
  50. Dennis Wolf, Jan Gugenheimer, Marco Combosch, and Enrico Rukzio. 2020. Understanding the Heisenberg Effect of Spatial Interaction: A Selection Induced Error for Spatially Tracked Input Devices. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI '20). Association for Computing Machinery, New York, NY, USA, 1--10. DOI:http://dx.doi.org/10.1145/3313831.3376876Google ScholarGoogle ScholarDigital LibraryDigital Library
  51. Fan Zhang, Shaowei Chu, Ruifang Pan, Naye Ji, and Lian Xi. 2017. Double hand-gesture interaction for walk-through in VR environment. In 2017 IEEE/ACIS 16th International Conference on Computer and Information Science (ICIS). IEEE, 539--544.Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. PAWS: Personalized Arm and Wrist Movements With Sensitivity Mappings for Controller-Free Locomotion in Virtual Reality

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in

        Full Access

        • Published in

          cover image Proceedings of the ACM on Human-Computer Interaction
          Proceedings of the ACM on Human-Computer Interaction  Volume 7, Issue MHCI
          MHCI
          September 2023
          1017 pages
          EISSN:2573-0142
          DOI:10.1145/3624512
          Issue’s Table of Contents

          Copyright © 2023 ACM

          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 13 September 2023
          Published in pacmhci Volume 7, Issue MHCI

          Permissions

          Request permissions about this article.

          Request Permissions

          Check for updates

          Qualifiers

          • research-article
        • Article Metrics

          • Downloads (Last 12 months)143
          • Downloads (Last 6 weeks)11

          Other Metrics

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader