skip to main content
10.1145/3562939.3565635acmconferencesArticle/Chapter ViewAbstractPublication PagesvrstConference Proceedingsconference-collections
research-article

Understanding Perspectives for Single- and Multi-Limb Movement Guidance in Virtual 3D Environments

Published: 29 November 2022 Publication History

Abstract

Movement guidance in virtual reality has many applications ranging from physical therapy, assistive systems to sport learning. These movements range from simple single-limb to complex multi-limb movements. While VR supports many perspectives – e.g., first person and third person – it remains unclear how accurate these perspectives communicate different movements. In a user study (N=18), we investigated the influence of perspective, feedback, and movement properties on the accuracy of movement guidance. Participants had on average an angle error of 6.2° for single arm movements, 7.4° for synchronous two arm movements, and 10.3° for synchronous two arm and leg movements. Furthermore, the results show that the two variants of third-person perspectives outperform a first-person perspective for movement guidance (19.9% and 24.3% reduction in angle errors). Qualitative feedback confirms the quantitative data and shows users have a clear preference for third-person perspectives. Through our findings we provide guidance for designers and developers of future VR movement guidance systems.

Supplementary Material

MP4 File (finalvideo.mp4)
Supplementary Video

References

[1]
Christopher Ackad, Andrew Clayphan, Martin Tomitsch, and Judy Kay. 2015. An In-the-Wild Study of Learning Mid-Air Gestures to Browse Hierarchical Information at a Large Interactive Public Display. In Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing (Osaka, Japan) (UbiComp ’15). Association for Computing Machinery, New York, NY, USA, 1227–1238. https://doi.org/10.1145/2750858.2807532
[2]
Fraser Anderson, Tovi Grossman, Justin Matejka, and George Fitzmaurice. 2013. YouMove: Enhancing Movement Training with an Augmented Reality Mirror. In Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology (St. Andrews, Scotland, United Kingdom) (UIST ’13). Association for Computing Machinery, New York, NY, USA, 311–320. https://doi.org/10.1145/2501988.2502045
[3]
Lorna Brown, Stephen Brewster, and Helen Purchase. 2006. Multidimensional tactons for non-visual information presentation in mobile devices. ACM International Conference Proceeding Series 159, 231–238. https://doi.org/10.1145/1152215.1152265
[4]
Christopher Clarke, Doga Cavdir, Patrick Chiu, Laurent Denoue, and Don Kimber. 2020. Reactive Video: Adaptive Video Playback Based on User Motion for Supporting Physical Activity. Association for Computing Machinery, New York, NY, USA, 196–208. https://doi.org/10.1145/3379337.3415591
[5]
Iwan de Kok, Julian Hough, Felix Hülsmann, Mario Botsch, David Schlangen, and Stefan Kopp. 2015. A Multimodal System for Real-Time Action Instruction in Motor Skill Learning. In Proceedings of the 2015 ACM on International Conference on Multimodal Interaction (Seattle, Washington, USA) (ICMI ’15). Association for Computing Machinery, New York, NY, USA, 355–362. https://doi.org/10.1145/2818346.2820746
[6]
William Delamare, Thomas Janssoone, Céline Coutrix, and Laurence Nigay. 2016. Designing 3D Gesture Guidance: Visual Feedback and Feedforward Design Options. 152–159. https://doi.org/10.1145/2909132.2909260
[7]
Maximilian Dürr, Rebecca Weber, Ulrike Pfeil, and Harald Reiterer. 2020. EGuide: Investigating Different Visual Appearances and Guidance Techniques for Egocentric Guidance Visualizations. In Proceedings of the Fourteenth International Conference on Tangible, Embedded, and Embodied Interaction (Sydney NSW, Australia) (TEI ’20). Association for Computing Machinery, New York, NY, USA, 311–322. https://doi.org/10.1145/3374920.3374945
[8]
Lisa A. Elkin, Matthew Kay, James J. Higgins, and Jacob O. Wobbrock. 2021. An Aligned Rank Transform Procedure for Multifactor Contrast Tests. In The 34th Annual ACM Symposium on User Interface Software and Technology (Virtual Event, USA) (UIST ’21). Association for Computing Machinery, New York, NY, USA, 754–768. https://doi.org/10.1145/3472749.3474784
[9]
Hesham Elsayed, Philipp Hoffmann, Sebastian Günther, Martin Schmitz, Martin Weigel, Max Mühlhäuser, and Florian Müller. 2021. CameraReady: Assessing the Influence of Display Types and Visualizations on Posture Guidance. In Designing Interactive Systems Conference 2021(Virtual Event, USA) (DIS ’21). Association for Computing Machinery, New York, NY, USA, 1046–1055. https://doi.org/10.1145/3461778.3462026
[10]
Sebastian Günther, Florian Müller, Markus Funk, Jan Kirchner, Niloofar Dezfuli, and Max Mühlhäuser. 2018. TactileGlove: Assistive Spatial Guidance in 3D Space through Vibrotactile Navigation. In Proceedings of the 11th PErvasive Technologies Related to Assistive Environments Conference (Corfu, Greece) (PETRA ’18). Association for Computing Machinery, New York, NY, USA, 273–280. https://doi.org/10.1145/3197768.3197785
[11]
Ping-Hsuan Han, Kuan-Wen Chen, Chen-Hsin Hsieh, Yu-Jie Huang, and Yi-Ping Hung. 2016. AR-Arm: Augmented Visualization for Guiding Arm Movement in the First-Person Perspective. In Proceedings of the 7th Augmented Human International Conference 2016 (Geneva, Switzerland) (AH ’16). Association for Computing Machinery, New York, NY, USA, Article 31, 4 pages. https://doi.org/10.1145/2875194.2875237
[12]
Thuong N. Hoang, Martin Reinoso, Frank Vetere, and Egemen Tanin. 2016. Onebody: Remote Posture Guidance System Using First Person View in Virtual Environment. In Proceedings of the 9th Nordic Conference on Human-Computer Interaction (Gothenburg, Sweden) (NordiCHI ’16). Association for Computing Machinery, New York, NY, USA, Article 25, 10 pages. https://doi.org/10.1145/2971485.2971521
[13]
Felix Hülsmann, Cornelia Frank, Irene Senna, Marc O. Ernst, Thomas Schack, and Mario Botsch. 2019. Superimposed Skilled Performance in a Virtual Mirror Improves Motor Performance and Cognitive Representation of a Full Body Motor Action. Frontiers in Robotics and AI 6 (2019). https://doi.org/10.3389/frobt.2019.00043
[14]
Felix Hülsmann, Jan Göpfert, Barbara Hammer, Stefan Kopp, and Mario Botsch. 2018. Classification of motor errors to provide real-time feedback for sports coaching in virtual reality — A case study in squats and Tai Chi pushes. Computers & Graphics 76 (08 2018). https://doi.org/10.1016/j.cag.2018.08.003
[15]
Charles Shea and Rebecca Lewthwaite. 2010. Motor skill learning and performance: A review of influential factors. Medical education 44 (01 2010), 75–84. https://doi.org/10.1111/j.1365-2923.2009.03421.x
[16]
Rajinder Sodhi, Hrvoje Benko, and Andrew Wilson. 2012. LightGuide: Projected Visualizations for Hand Movement Guidance. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Austin, Texas, USA) (CHI ’12). Association for Computing Machinery, New York, NY, USA, 179–188. https://doi.org/10.1145/2207676.2207702
[17]
Richard Tang, Xing-Dong Yang, Scott Bateman, Joaquim Jorge, and Anthony Tang. 2015. Physio@Home: Exploring Visual Guidance and Feedback Techniques for Physiotherapy Exercises. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (Seoul, Republic of Korea) (CHI ’15). Association for Computing Machinery, New York, NY, USA, 4123–4132. https://doi.org/10.1145/2702123.2702401
[18]
Robert Walter, Gilles Bailly, and Jörg Müller. 2013. StrikeAPose: Revealing Mid-Air Gestures on Public Displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Paris, France) (CHI ’13). Association for Computing Machinery, New York, NY, USA, 841–850. https://doi.org/10.1145/2470654.2470774
[19]
Jacob O. Wobbrock, Leah Findlater, Darren Gergle, and James J. Higgins. 2011. The Aligned Rank Transform for Nonparametric Factorial Analyses Using Only Anova Procedures. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Vancouver, BC, Canada) (CHI ’11). Association for Computing Machinery, New York, NY, USA, 143–146. https://doi.org/10.1145/1978942.1978963
[20]
Kirk Woolford. 2015. Defining Accuracy in the Use of Kinect v2 for Exercise Monitoring(MOCO ’15). Association for Computing Machinery, New York, NY, USA, 112–119. https://doi.org/10.1145/2790994.2791002
[21]
Xingyao Yu, Katrin Angerbauer, Peter Mohr, Denis Kalkofen, and Michael Sedlmair. 2020. Perspective Matters: Design Implications for Motion Guidance in Mixed Reality. In 2020 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 577–587. https://doi.org/10.1109/ISMAR50242.2020.00085

Cited By

View all
  • (2024)Design Space of Visual Feedforward And Corrective Feedback in XR-Based Motion Guidance SystemsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642143(1-15)Online publication date: 11-May-2024
  • (2023)Tactile Vectors for Omnidirectional Arm GuidanceProceedings of the Augmented Humans International Conference 202310.1145/3582700.3582701(35-45)Online publication date: 12-Mar-2023

Index Terms

  1. Understanding Perspectives for Single- and Multi-Limb Movement Guidance in Virtual 3D Environments

        Recommendations

        Comments

        Information & Contributors

        Information

        Published In

        cover image ACM Conferences
        VRST '22: Proceedings of the 28th ACM Symposium on Virtual Reality Software and Technology
        November 2022
        466 pages
        ISBN:9781450398893
        DOI:10.1145/3562939
        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

        Sponsors

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        Published: 29 November 2022

        Permissions

        Request permissions for this article.

        Check for updates

        Author Tags

        1. Movement guidance
        2. body visualization
        3. virtual reality

        Qualifiers

        • Research-article
        • Research
        • Refereed limited

        Funding Sources

        • German Federal Ministry of Education and Research

        Conference

        VRST '22

        Acceptance Rates

        Overall Acceptance Rate 66 of 254 submissions, 26%

        Contributors

        Other Metrics

        Bibliometrics & Citations

        Bibliometrics

        Article Metrics

        • Downloads (Last 12 months)115
        • Downloads (Last 6 weeks)11
        Reflects downloads up to 17 Feb 2025

        Other Metrics

        Citations

        Cited By

        View all
        • (2024)Design Space of Visual Feedforward And Corrective Feedback in XR-Based Motion Guidance SystemsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642143(1-15)Online publication date: 11-May-2024
        • (2023)Tactile Vectors for Omnidirectional Arm GuidanceProceedings of the Augmented Humans International Conference 202310.1145/3582700.3582701(35-45)Online publication date: 12-Mar-2023

        View Options

        Login options

        View options

        PDF

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        HTML Format

        View this article in HTML Format.

        HTML Format

        Figures

        Tables

        Media

        Share

        Share

        Share this Publication link

        Share on social media