Juyoung Lee
ABSTRACT
We investigate the effects of different ways of visualizing the virtual gait of the avatar in the context of Walk-in-Place (WIP) based navigation in a virtual environment (VE). In Study 1, participants navigated through a VE using the WIP method while inhabiting an avatar. We varied the visualization of the avatar’s leg motion while performing the WIP gesture: (1) Fixed Body: the legs stood still; (2) Pre-recorded Animation: the legs moved in a fixed predetermined pace (plausible but not in accordance to that of the user in general); (3) Synchronized Motion the legs moved according (synchronized) to those of the user. Our results indicated that the sense of presence and body ownership improved significantly when the leg motion was rendered synchronized to that of the user (Synchronized Motion). In addition, we developed a deep neural network (DNN) that predicted the users’ leg postures only with the head position tracking, eliminating the need for any external sensors. We carried out Study 2, to assess the effects of different gait visualizations, under two new factors: (1) virtual gait seen directly by the user looking down, or already visible by one’s shadow (i.e., no need to look down); and (2) playing a pre-recorded animation, or pre-recorded animation whose playback speed was adjusted to match with pace of the users’ actual leg motions as predicted by the DNN. The results of Study 2 showed that the virtual gait temporally synchronized with that of the user greatly improved the sense of body ownership, whether it was witnessed directly or indirectly with the shadow. However, the effect of virtual gait on presence was less marked when indirectly observed. We discuss our findings and the implications for representing the avatar locomotion in immersive virtual environments.
Supplemental Material
- Martín Abadi, Paul Barham, Jianmin Chen, Zhifeng Chen, Andy Davis, Jeffrey Dean, Matthieu Devin, Sanjay Ghemawat, Geoffrey Irving, Michael Isard, 2016. Tensorflow: A system for large-scale machine learning. In 12th {USENIX} symposium on operating systems design and implementation ({OSDI} 16). 265–283.Google Scholar
- Parastoo Abtahi, Mar Gonzalez-Franco, Eyal Ofek, and Anthony Steed. 2019. I’m a giant: Walking in large virtual environments at high speed gains. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1–13.Google ScholarDigital Library
- Jakki O. Bailey, Jeremy N. Bailenson, and Daniel Casasanto. 2016. When does virtual embodiment change our minds?Presence: Teleoperators and Virtual Environments 25, 3(2016), 222–233.Google ScholarDigital Library
- Matthew Botvinick and Jonathan Cohen. 1998. Rubber hands ‘feel’touch that eyes see. Nature 391, 6669 (1998), 756.Google Scholar
- Laroussi Bouguila, Florian Evequoz, Michele Courant, and Beat Hirsbrunner. 2004. Walking-pad: a step-in-place locomotion interface for virtual environments. In Proceedings of the 6th international conference on Multimodal interfaces (ICMI). ACM, 77–81.Google ScholarDigital Library
- Luís Bruno, Maurício Sousa, Alfredo Ferreira, João Madeiras Pereira, and Joaquim Jorge. 2017. Hip-directed walking-in-place using a single depth camera. International Journal of Human-Computer Studies 105 (2017), 1–11.Google ScholarCross Ref
- Zhe Cao, Gines Hidalgo, Tomas Simon, Shih-En Wei, and Yaser Sheikh. 2018. OpenPose: realtime multi-person 2D pose estimation using Part Affinity Fields. arXiv preprint arXiv:1812.08008(2018).Google Scholar
- Changyeol Choi, Joohee Jun, Jiwoong Heo, and Kwanguk Kim. 2019. Effects of virtual-avatar motion-synchrony levels on full-body interaction. In Proceedings of the 34th ACM/SIGAPP Symposium on Applied Computing. 701–708.Google ScholarDigital Library
- Youjin Choi, Jeongmi Lee, and Sung-Hee Lee. 2020. Effects of Locomotion Style and Body Visibility of a Telepresence Avatar. In 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, 1–9.Google ScholarCross Ref
- Guillaume Cortes, Ferran Argelaguet, Eric Marchand, and Anatole Lécuyer. 2018. Virtual shadows for real humans in a CAVE: influence on virtual embodiment and 3D interaction. In Proceedings of the 15th ACM Symposium on Applied Perception. 1–8.Google ScholarDigital Library
- Jeff Feasel, Mary C. Whitton, and Jeremy D. Wendt. 2008. LLCM-WIP: Low-latency, continuous-motion walking-in-place. In 2008 IEEE Symposium on 3D User Interfaces (3DUI). IEEE, 97–104.Google ScholarDigital Library
- Yarin Gal and Zoubin Ghahramani. 2016. Dropout as a bayesian approximation: Representing model uncertainty in deep learning. In international conference on machine learning. 1050–1059.Google ScholarDigital Library
- Sara Hanson, Richard A. Paris, Haley A. Adams, and Bobby Bodenheimer. 2019. Improving Walking in Place Methods with Individualization and Deep Networks. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, 367–376.Google Scholar
- Beverly K. Jaeger and Ronald R. Mourant. 2001. Comparison of simulator sickness using static and dynamic walking simulators. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting, Vol. 45. SAGE Publications Sage CA: Los Angeles, CA, 1896–1900.Google Scholar
- Robert S. Kennedy, Norman E. Lane, Kevin S. Berbaum, and Michael G. Lilienthal. 1993. Simulator sickness questionnaire: An enhanced method for quantifying simulator sickness. The international journal of aviation psychology 3, 3 (1993), 203–220.Google Scholar
- Konstantina Kilteni, Antonella Maselli, Konrad P. Kording, and Mel Slater. 2015. Over my fake body: body ownership illusions for studying the multisensory basis of own-body perception. Frontiers in Human Neuroscience 9 (2015), 141.Google ScholarCross Ref
- Elena Kokkinara and Mel Slater. 2014. Measuring the effects through time of the influence of visuomotor and visuotactile synchronous stimulation on a virtual body ownership illusion. Perception 43, 1 (2014), 43–58.Google ScholarCross Ref
- Juyoung Lee, Sang C. Ahn, and Jae-In Hwang. 2018. A walking-in-place method for virtual reality using position and orientation tracking. Sensors 18, 9 (2018), 2832.Google ScholarCross Ref
- Juyoung Lee, Myungho Lee, Gerard Jounghyun Kim, and Jae-In Hwang. 2020. Effects of Virtual Gait Visualization in Walk-in-Place on Body Ownership and Presence. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems. 1–7.Google Scholar
- Juyoung Lee, Andreas Pastor, Jae-In Hwang, and Gerard J. Kim. 2019. Predicting the Torso Direction from HMD Movements for Walk-in-Place Navigation through Deep Learning. In 25th ACM Symposium on Virtual Reality Software and Technology. ACM, 84.Google ScholarDigital Library
- Niels Christian Nilsson, Tabitha Peck, Gerd Bruder, Eri Hodgson, Stefania Serafin, Mary Whitton, Frank Steinicke, and Evan Suma Rosenberg. 2018. 15 years of research on redirected walking in immersive virtual environments. IEEE computer graphics and applications 38, 2 (2018), 44–56.Google ScholarDigital Library
- Niels C. Nilsson, Stefania Serafin, Morten H. Laursen, Kasper S. Pedersen, Erik Sikström, and Rolf Nordahl. 2013. Tapping-in-place: Increasing the naturalness of immersive walking-in-place locomotion through novel gestural input. In 2013 IEEE Symposium on 3D User Interfaces (3DUI). IEEE, 31–38.Google ScholarCross Ref
- Niels C. Nilsson, Stefania Serafin, and Rolf Nordahl. 2013. Unintended positional drift and its potential solutions. In 2013 IEEE Virtual Reality. IEEE, 121–122.Google Scholar
- Niels C. Nilsson, Stefania Serafin, and Rolf Nordahl. 2016. Walking in place through virtual worlds. In International Conference on Human-Computer Interaction (HCII). Springer, 37–48.Google ScholarDigital Library
- Niels C. Nilsson, Stefania Serafin, Frank Steinicke, and Rolf Nordahl. 2018. Natural walking in virtual reality: A review. Computers in Entertainment (CIE) 16, 2 (2018), 8.Google ScholarDigital Library
- Ye Pan and Anthony Steed. 2019. How foot tracking matters: The impact of an animated self-avatar on interaction, embodiment and presence in shared virtual environments. Frontiers in Robotics and AI 6 (2019), 104.Google ScholarCross Ref
- Fabian Pedregosa, Gaël Varoquaux, Alexandre Gramfort, Vincent Michel, Bertrand Thirion, Olivier Grisel, Mathieu Blondel, Peter Prettenhofer, Ron Weiss, Vincent Dubourg, 2011. Scikit-learn: Machine learning in Python. the Journal of machine Learning research 12 (2011), 2825–2830.Google Scholar
- Waseem Rawat and Zenghui Wang. 2017. Deep convolutional neural networks for image classification: A comprehensive review. Neural computation 29, 9 (2017), 2352–2449.Google Scholar
- Sharif Razzaque, David Swapp, Mel Slater, Mary C. Whitton, and Anthony Steed. 2002. Redirected walking in place. In EGVE, Vol. 2. 123–130.Google Scholar
- Martin Schwaiger, Thomas Thuimmel, and Heinz Ulbrich. 2007. Cyberwalk: An advanced prototype of a belt array platform. In 2007 IEEE International Workshop on Haptic, Audio and Visual Environments and Games. IEEE, 50–55.Google ScholarCross Ref
- Sotaro Shimada, Kensuke Fukuda, and Kazuo Hiraki. 2009. Rubber hand illusion under delayed visual feedback. PloS one 4, 7 (2009), e6185.Google ScholarCross Ref
- Mel Slater, Daniel Pérez-Marcos, Henrik Ehrsson, and Maria V. Sanchez-Vives. 2009. Inducing illusory ownership of a virtual body. Frontiers in neuroscience 3 (2009), 29.Google Scholar
- Mel Slater, Martin Usoh, and Yiorgos Chrysanthou. 1995. The influence of dynamic shadows on presence in immersive virtual environments. In Virtual environments’ 95. Springer, 8–21.Google Scholar
- Mel Slater, Martin Usoh, and Anthony Steed. 1995. Taking steps: the influence of a walking technique on presence in virtual reality. ACM Transactions on Computer-Human Interaction (TOCHI) 2, 3(1995), 201–219.Google ScholarDigital Library
- James N. Templeman, Patricia S. Denbrook, and Linda E. Sibert. 1999. Virtual locomotion: Walking in place through virtual environments. Presence 8, 6 (1999), 598–617.Google ScholarDigital Library
- Jonathan J. Tompson, Arjun Jain, Yann LeCun, and Christoph Bregler. 2014. Joint training of a convolutional network and a graphical model for human pose estimation. In Advances in neural information processing systems. 1799–1807.Google Scholar
- Alexander Toshev and Christian Szegedy. 2014. Deeppose: Human pose estimation via deep neural networks. In Proceedings of the IEEE conference on computer vision and pattern recognition. 1653–1660.Google ScholarDigital Library
- Sam Tregillus and Eelke Folmer. 2016. Vr-step: Walking-in-place using inertial sensing for hands free navigation in mobile vr environments. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 1250–1255.Google ScholarDigital Library
- Terry T. Um, Franz MJ Pfister, Daniel Pichler, Satoshi Endo, Muriel Lang, Sandra Hirche, Urban Fietzek, and Dana Kulić. 2017. Data augmentation of wearable sensor data for parkinson’s disease monitoring using convolutional neural networks. In Proceedings of the 19th ACM International Conference on Multimodal Interaction. 216–220.Google ScholarDigital Library
- Martin Usoh, Kevin Arthur, Mary C. Whitton, Rui Bastos, Anthony Steed, Mel Slater, and Frederick P. Brooks Jr. 1999. Walking> walking-in-place> flying, in virtual environments. In Proceedings of the 26th annual conference on Computer graphics and interactive techniques. 359–364.Google ScholarDigital Library
- Jeremy D. Wendt, Mary C. Whitton, and Frederick P. Brooks. 2010. Gud wip: Gait-understanding-driven walking-in-place. In 2010 IEEE Virtual Reality. IEEE, 51–58.Google Scholar
- Betsy Williams, Stephen Bailey, Gayathri Narasimham, Muqun Li, and Bobby Bodenheimer. 2011. Evaluation of walking in place on a wii balance board to explore a virtual environment. ACM Transactions on Applied Perception (TAP) 8, 3 (2011), 1–14.Google ScholarDigital Library
- Preston Tunnell Wilson, Kevin Nguyen, Alyssa Harris, and Betsy Williams. 2014. Walking in place using the Microsoft Kinect to explore a large VE. In Proceedings of the 13th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry. 27–33.Google ScholarDigital Library
Recommendations
Effects of Virtual Gait Visualization in Walk-in-Place on Body Ownership and Presence
CHI EA '20: Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing SystemsWe investigate the effects of different ways of visualizing the virtual gait of the avatar in the context of Walk-in-Place (WIP) based navigation in a virtual environment (VE). In our study, participants navigated through a VE using the WIP method while ...
Body ownership illusion through virtual reality as modulator variable for limbs rehabilitation after stroke: a systematic review
AbstractStroke is the leading cause of motor impairments and generates distortion of body representation. Hence, stroke can modulate the sense of embodiment, namely the feeling of being inside the body (ownership), in the place where the body is located (...
Exploring the Relative Effects of Body Position and Locomotion Method on Presence and Cybersickness when Navigating a Virtual Environment
The primary goals of this research are to strengthen the understanding of the mechanisms underlying presence and cybersickness in relation to the body position and locomotion method when navigating a virtual environment (VE). In this regard, we compared ...
Comments