skip to main content
10.1145/2971485.2971521acmotherconferencesArticle/Chapter ViewAbstractPublication PagesnordichiConference Proceedingsconference-collections
research-article

Onebody: Remote Posture Guidance System using First Person View in Virtual Environment

Published: 23 October 2016 Publication History

Abstract

We present Onebody, a virtual reality system for remote posture guidance during sports or physical activity training, such as martial arts, yoga or dance, using first person perspective. The system uses skeletal tracking of the instructor and the students, rendered as virtual avatars. Using a virtual reality headset, the student can visualise the movement of the instructor's avatar, rendered in place of their own body. Onebody provides a first person perspective of the movement instruction, allowing the student to step into the instructor's body. We conducted a study to compare the performance of Onebody in terms of posture matching accuracy and user's preference, with existing techniques of delivering movement instructions, including pre-recorded video, video conferencing and third person view virtual reality. The result indicated that Onebody offers better posture accuracy in delivering movement instructions.

References

[1]
Anderson, F, Grossman, T, Matejka, J, and Fitzmaurice, G, YouMove: enhancing movement training with an augmented reality mirror, in Proceedings of the 26th annual ACM symposium on User interface software and technology. 2013, ACM: St. Andrews, Scotland, United Kingdom. p. 311--320.
[2]
Bailenson, J, Patel, K, Nielsen, A, Bajscy, R, Jung, S-H, and Kurillo, G, The Effect of Interactivity on Learning Physical Actions in Virtual Reality. Media Psychology, 2008. 11(3): p. 354--376.
[3]
Chan, JCP, Leung, H, Tang, JKT, and Komura, T, A Virtual Reality Dance Training System Using Motion Capture Technology. IEEE Transactions on Learning Technologies, 2011. 4(2): p. 187--195.
[4]
Chinthammit, W, Merritt, T, Pedersen, S, Williams, A, Visentin, D, Rowe, R, and Furness, T, Ghostman: augmented reality application for telerehabilitation and remote instruction of a novel motor skill. BioMed research international, 2014. 2014.
[5]
Covaci, A, Olivier, A-H, and Multon, F, Third person view and guidance for more natural motor behaviour in immersive basketball playing, in Proceedings of the 20th ACM Symposium on Virtual Reality Software and Technology. 2014, ACM: Edinburgh, Scotland. p. 55--64.
[6]
Holden, MK, Virtual Environments for Motor Rehabilitation: Review. CyberPsychology & Behavior, 2005. 8(3): p. 187--211.
[7]
Jung, S-H and Bajcsy, R, A framework for constructing real-time immersive environments for training physical activities. Journal of Multimedia, 2006. 1(7): p. 9--17.
[8]
Kallmann, M, Camporesi, C, and Han, J, VR-Assisted Physical Rehabilitation: Adapting to the Needs of Therapists and Patients, in Virtual Realities. 2015, Springer. p. 147--168.
[9]
Kurillo, G, Bajcsy, R, Nahrsted, K, and Kreylos, O, Immersive 3D Environment for Remote Collaboration and Training of Physical Activities, in Virtual Reality Conference, 2008. VR '08. IEEE. 2008. p. 269--270.
[10]
Pfister, A, West, AM, Bronner, S, and Noah, JA, Comparative abilities of Microsoft Kinect and Vicon 3D motion capture for gait analysis. Journal of Medical Engineering & Technology, 2014. 38(5): p. 274--280.
[11]
Philo Tan, C, Crivella, R, Daly, B, Ning, H, Schaaf, R, Ventura, D, Camill, T, Hodgins, J, and Pausch, R, Training for physical tasks in virtual environments: Tai Chi, in Virtual Reality, 2003. Proceedings. IEEE. 2003. p. 87--94.
[12]
Schmidt, RA and Wulf, G, Continuous concurrent feedback degrades skill learning: Implications for training and simulation. Human factors, 1997. 39(4): p. 509.
[13]
Sigrist, R, Rauter, G, Riener, R, and Wolf, P, Augmented visual, auditory, haptic, and multimodal feedback in motor learning: a review. Psychonomic bulletin & review, 2013. 20(1): p. 21--53.
[14]
Tang, R, Yang, X-D, Bateman, S, Jorge, J, and Tang, A, Physio@ Home: Exploring visual guidance and feedback techniques for physiotherapy exercises, in Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. 2015, ACM. p. 4123--4132.
[15]
Tao, G, Archambault, PS, and Levin, M, Evaluation of Kinect skeletal tracking in a virtual reality rehabilitation system for upper limb hemiparesis, in Virtual Rehabilitation (ICVR), 2013 International Conference on. 2013, IEEE. p. 164--165.
[16]
Todorov, E, Shadmehr, R, and Bizzi, E, Augmented Feedback Presented in a Virtual Environment Accelerates Learning of a Difficult Motor Task. Journal of Motor Behavior, 1997. 29(2): p. 147--158.
[17]
Wulf, G, Shea, C, and Lewthwaite, R, Motor skill learning and performance: a review of influential factors. Medical Education, 2010. 44(1): p. 75--84.
[18]
Wulf, G and Shea, CH, Principles derived from the study of simple skills do not generalize to complex skill learning. Psychonomic Bulletin & Review, 2002. 9(2): p. 185--211.
[19]
Wulf, G and Shea, CH, Understanding the role of augmented feedback. Skill acquisition in sport: Research, theory and practice, 2004: p. 121--144.
[20]
Wulf, G and Weigelt, C, Instructions about physical principles in learning a complex motor skill: To tell or not to tell.... Research quarterly for exercise and sport, 1997. 68(4): p. 362--367.
[21]
Yang, U and Kim, GJ, Implementation and Evaluation of "Just Follow Me": An Immersive, VR-Based, Motion-Training System. Presence: Teleoperators and Virtual Environments, 2002. 11(3): p. 304--323.

Cited By

View all
  • (2025)SkillAR: omnipresent in-situ feedback for motor skill training using ARVirtual Reality10.1007/s10055-025-01108-129:1Online publication date: 4-Feb-2025
  • (2024)Multimodal Drumming Education Tool in Mixed RealityMultimodal Technologies and Interaction10.3390/mti80800708:8(70)Online publication date: 5-Aug-2024
  • (2024)Immersive virtual reality for learning exoskeleton-like virtual walking: a feasibility studyJournal of NeuroEngineering and Rehabilitation10.1186/s12984-024-01482-y21:1Online publication date: 1-Nov-2024
  • Show More Cited By

Index Terms

  1. Onebody: Remote Posture Guidance System using First Person View in Virtual Environment

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Other conferences
      NordiCHI '16: Proceedings of the 9th Nordic Conference on Human-Computer Interaction
      October 2016
      1045 pages
      ISBN:9781450347631
      DOI:10.1145/2971485
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      In-Cooperation

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 23 October 2016

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. Virtual reality
      2. first person view
      3. posture guidance

      Qualifiers

      • Research-article
      • Research
      • Refereed limited

      Conference

      NordiCHI '16

      Acceptance Rates

      NordiCHI '16 Paper Acceptance Rate 58 of 231 submissions, 25%;
      Overall Acceptance Rate 379 of 1,572 submissions, 24%

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)134
      • Downloads (Last 6 weeks)9
      Reflects downloads up to 15 Feb 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2025)SkillAR: omnipresent in-situ feedback for motor skill training using ARVirtual Reality10.1007/s10055-025-01108-129:1Online publication date: 4-Feb-2025
      • (2024)Multimodal Drumming Education Tool in Mixed RealityMultimodal Technologies and Interaction10.3390/mti80800708:8(70)Online publication date: 5-Aug-2024
      • (2024)Immersive virtual reality for learning exoskeleton-like virtual walking: a feasibility studyJournal of NeuroEngineering and Rehabilitation10.1186/s12984-024-01482-y21:1Online publication date: 1-Nov-2024
      • (2024)AudioMove: Applying the Spatial Audio to Multi-Directional Limb Exercise GuidanceProceedings of the ACM on Human-Computer Interaction10.1145/36764898:MHCI(1-26)Online publication date: 24-Sep-2024
      • (2024)avaTTAR: Table Tennis Stroke Training with Embodied and Detached Visualization in Augmented RealityProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676400(1-16)Online publication date: 13-Oct-2024
      • (2024)UbiPhysioProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36435528:1(1-27)Online publication date: 6-Mar-2024
      • (2024)Design Space of Visual Feedforward And Corrective Feedback in XR-Based Motion Guidance SystemsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642143(1-15)Online publication date: 11-May-2024
      • (2024)Augmented Coach: Volumetric Motion Annotation and Visualization for Immersive Sports Coaching2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR58804.2024.00037(137-146)Online publication date: 16-Mar-2024
      • (2024)Visual Cue Based Corrective Feedback for Motor Skill Training in Mixed Reality: A SurveyIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2022.322799930:7(3121-3134)Online publication date: Jul-2024
      • (2024)Extended Reality as a Training Approach for Visual Real-Time Feedback in GolfIEEE Transactions on Learning Technologies10.1109/TLT.2023.332266017(642-652)Online publication date: 1-Jan-2024
      • Show More Cited By

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media