ABSTRACT
We present Onebody, a virtual reality system for remote posture guidance during sports or physical activity training, such as martial arts, yoga or dance, using first person perspective. The system uses skeletal tracking of the instructor and the students, rendered as virtual avatars. Using a virtual reality headset, the student can visualise the movement of the instructor's avatar, rendered in place of their own body. Onebody provides a first person perspective of the movement instruction, allowing the student to step into the instructor's body. We conducted a study to compare the performance of Onebody in terms of posture matching accuracy and user's preference, with existing techniques of delivering movement instructions, including pre-recorded video, video conferencing and third person view virtual reality. The result indicated that Onebody offers better posture accuracy in delivering movement instructions.
- Anderson, F, Grossman, T, Matejka, J, and Fitzmaurice, G, YouMove: enhancing movement training with an augmented reality mirror, in Proceedings of the 26th annual ACM symposium on User interface software and technology. 2013, ACM: St. Andrews, Scotland, United Kingdom. p. 311--320. Google ScholarDigital Library
- Bailenson, J, Patel, K, Nielsen, A, Bajscy, R, Jung, S-H, and Kurillo, G, The Effect of Interactivity on Learning Physical Actions in Virtual Reality. Media Psychology, 2008. 11(3): p. 354--376.Google Scholar
- Chan, JCP, Leung, H, Tang, JKT, and Komura, T, A Virtual Reality Dance Training System Using Motion Capture Technology. IEEE Transactions on Learning Technologies, 2011. 4(2): p. 187--195. Google ScholarDigital Library
- Chinthammit, W, Merritt, T, Pedersen, S, Williams, A, Visentin, D, Rowe, R, and Furness, T, Ghostman: augmented reality application for telerehabilitation and remote instruction of a novel motor skill. BioMed research international, 2014. 2014.Google Scholar
- Covaci, A, Olivier, A-H, and Multon, F, Third person view and guidance for more natural motor behaviour in immersive basketball playing, in Proceedings of the 20th ACM Symposium on Virtual Reality Software and Technology. 2014, ACM: Edinburgh, Scotland. p. 55--64. Google ScholarDigital Library
- Holden, MK, Virtual Environments for Motor Rehabilitation: Review. CyberPsychology & Behavior, 2005. 8(3): p. 187--211.Google Scholar
- Jung, S-H and Bajcsy, R, A framework for constructing real-time immersive environments for training physical activities. Journal of Multimedia, 2006. 1(7): p. 9--17.Google Scholar
- Kallmann, M, Camporesi, C, and Han, J, VR-Assisted Physical Rehabilitation: Adapting to the Needs of Therapists and Patients, in Virtual Realities. 2015, Springer. p. 147--168.Google Scholar
- Kurillo, G, Bajcsy, R, Nahrsted, K, and Kreylos, O, Immersive 3D Environment for Remote Collaboration and Training of Physical Activities, in Virtual Reality Conference, 2008. VR '08. IEEE. 2008. p. 269--270.Google ScholarCross Ref
- Pfister, A, West, AM, Bronner, S, and Noah, JA, Comparative abilities of Microsoft Kinect and Vicon 3D motion capture for gait analysis. Journal of Medical Engineering & Technology, 2014. 38(5): p. 274--280.Google Scholar
- Philo Tan, C, Crivella, R, Daly, B, Ning, H, Schaaf, R, Ventura, D, Camill, T, Hodgins, J, and Pausch, R, Training for physical tasks in virtual environments: Tai Chi, in Virtual Reality, 2003. Proceedings. IEEE. 2003. p. 87--94. Google ScholarDigital Library
- Schmidt, RA and Wulf, G, Continuous concurrent feedback degrades skill learning: Implications for training and simulation. Human factors, 1997. 39(4): p. 509.Google Scholar
- Sigrist, R, Rauter, G, Riener, R, and Wolf, P, Augmented visual, auditory, haptic, and multimodal feedback in motor learning: a review. Psychonomic bulletin & review, 2013. 20(1): p. 21--53.Google Scholar
- Tang, R, Yang, X-D, Bateman, S, Jorge, J, and Tang, A, Physio@ Home: Exploring visual guidance and feedback techniques for physiotherapy exercises, in Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. 2015, ACM. p. 4123--4132. Google ScholarDigital Library
- Tao, G, Archambault, PS, and Levin, M, Evaluation of Kinect skeletal tracking in a virtual reality rehabilitation system for upper limb hemiparesis, in Virtual Rehabilitation (ICVR), 2013 International Conference on. 2013, IEEE. p. 164--165.Google ScholarCross Ref
- Todorov, E, Shadmehr, R, and Bizzi, E, Augmented Feedback Presented in a Virtual Environment Accelerates Learning of a Difficult Motor Task. Journal of Motor Behavior, 1997. 29(2): p. 147--158.Google Scholar
- Wulf, G, Shea, C, and Lewthwaite, R, Motor skill learning and performance: a review of influential factors. Medical Education, 2010. 44(1): p. 75--84.Google Scholar
- Wulf, G and Shea, CH, Principles derived from the study of simple skills do not generalize to complex skill learning. Psychonomic Bulletin & Review, 2002. 9(2): p. 185--211.Google Scholar
- Wulf, G and Shea, CH, Understanding the role of augmented feedback. Skill acquisition in sport: Research, theory and practice, 2004: p. 121--144.Google Scholar
- Wulf, G and Weigelt, C, Instructions about physical principles in learning a complex motor skill: To tell or not to tell.... Research quarterly for exercise and sport, 1997. 68(4): p. 362--367.Google Scholar
- Yang, U and Kim, GJ, Implementation and Evaluation of "Just Follow Me": An Immersive, VR-Based, Motion-Training System. Presence: Teleoperators and Virtual Environments, 2002. 11(3): p. 304--323. Google ScholarDigital Library
Index Terms
- Onebody: Remote Posture Guidance System using First Person View in Virtual Environment
Recommendations
MetaSpace: Full-body Tracking for Immersive Multiperson Virtual Reality
UIST '15 Adjunct: Adjunct Proceedings of the 28th Annual ACM Symposium on User Interface Software & TechnologyMost current virtual reality (VR) interactions are mediated by hand-held input devices or hand gestures and they usually display only a partial representation of the user in the synthetic environment. We believe, representing the user as a full avatar ...
A vibrotactile feedback approach to posture guidance
HAPTIC '10: Proceedings of the 2010 IEEE Haptics SymposiumIn this paper, we explore the use of vibrotactile haptic feedback to improve performance of a sensory-motor task. Our specific application is seated posture guidance. Poor sitting postures, over time, can lead to health concerns such as low back pain. ...
Haptic around: multiple tactile sensations for immersive environment and interaction in virtual reality
VRST '18: Proceedings of the 24th ACM Symposium on Virtual Reality Software and TechnologyIn this paper, we present Haptic Around, a hybrid-haptic feedback system, which utilizes fan, hot air blower, mist creator and heat light to recreate multiple tactile sensations in virtual reality for enhancing the immersive environment and interaction. ...
Comments