ABSTRACT
This paper reports preliminary investigations into the extent to which future directional intention might be reliably inferred from head pose and eye gaze during locomotion. Such findings could help inform the more effective implementation of realistic detailed animation for dynamic virtual agents in interactive first-person crowd simulations in VR, as well as the design of more efficient predictive controllers for redirected walking. In three different studies, with a total of 19 participants, we placed people at the base of a T-shaped virtual hallway environment and collected head position, head orientation, and gaze direction data as they set out to perform a hidden target search task across two rooms situated at right angles to the end of the hallway. Subjects wore an nVisorST50 HMD equipped with an Arrington Research ViewPoint eye tracker; positional data were tracked using a 12-camera Vicon MX40 motion capture system. The hidden target search task was used to blind participants to the actual focus of our study, which was to gain insight into how effectively head position, head orientation and gaze direction data might predict people's eventual choice of which room to search first. Our results suggest that eye gaze data does have the potential to provide additional predictive value over the use of 6DOF head tracked data alone, despite the relatively limited field-of-view of the display we used.
- Anderson, A. T. 2002. On the human figure in architectural representation. Journal of Architecture Education, 55, 4, 238--246.Google ScholarCross Ref
- Bernadin, D., Kadone, H., Bennequin, D., Sugar, T., Zaoui, M., Berthoz, A. 2012. Gaze anticipation during human locomotion., Experimental Brain Research, 223, 1, 65--78.Google ScholarCross Ref
- Glaholt, M. G. and Reingold, E. M. 2009. The time course of gaze bias in visual decision tasks. Visual Cognition, 17, 8, 1228--1243.Google ScholarCross Ref
- Goldfeather, J. and Interrante, V. 2012. Adaptive redirected walking in a virtual world. IEEE Virtual Reality Workshop on Perceptual Illusions in Virtual Environments, 17--20.Google Scholar
- Hodgson, E. and Bachmann, E. 2013. Comparing four approaches to generalized redirected walking: simulation and live user data. IEEE Transactions on Visualization and Computer Graphics, 19, 4, 634--643. Google ScholarDigital Library
- Hollands, M. A., Patla, A. E., Vickers, J. N. 2002 "Look where you're going!": gaze behavior associated with maintaining and changing the direction of locomotion. Exp. Brain Research, 142, 2, 221--230.Google ScholarCross Ref
- Interrante, V., Ries, B., Anderson, L. 2007. Seven league boots: a new metaphor for augmented locomotion through moderately large scale immersive virtual environments. IEEE Symposium on 3D User Interfaces, 167--170.Google ScholarCross Ref
- Karamouzas, I., Skinner, R. and Guy, S. J. 2014. Universal power law governing pedestrian interactions. Physical Review Letters, 113, 23, 238701.Google ScholarCross Ref
- Land, M. F. and Lee, D. N. 1994. Where we look when we steer. Nature, 369, 742--744.Google ScholarCross Ref
- Nescher, T. and Kunz, A. 2012. Analysis of short term path prediction of human locomotion for augmented and virtual reality applications. International Conference on Cyberworlds, 15--22. Google ScholarDigital Library
- Nitzsche, N., Hanebeck, U. D., Schmidt, G. 2004 Motion compression for telepresent walking in large target environments. Presence: Teleoperators and Virtual Environments, 13, 1, 44--60. Google ScholarDigital Library
- Nummenmaa, L., Hyönä J., Hietanen J. K. 2009. I'll walk this way: eyes reveal the direction of locomotion and make passersby look and go the other way. Psychological Science, 20, 12, 1454--1458.Google ScholarCross Ref
- Orquin, J. L. and Loose, S. M. 2013. Attention and choice: a review on eye movements in decision making. Acta Psychologica, 144, 1, 190--206.Google ScholarCross Ref
- Patla, A. 2004. Gaze behaviors during adaptive human locomotion: insights into how vision is used to regulate locomotion. Chapter 17 in Optic Flow and Beyond, Vaina, L. M., Beardsley, S. A., Rushton, S. K., eds., Springer, 383--399. Google ScholarDigital Library
- Pelz, J., Purington, J. Herbert, A. 2009. Travel gaze? Re-examining gaze behavior during locomotion. Journal of Vision, 9, 8, 422.Google Scholar
- Razzaque, S., Kohn, Z., Whitton, M. C. 2001 Redirected Walking. Eurographics (short paper presentation).Google Scholar
- Ruhland, K., Andrist, S., Badler, J., Peters, C., Badler, N., Gleicher, M., Mutlu, B., McDonnell, R. 2014. Look me in the eyes: a survey of eye and gaze animation for virtual agents and artificial systems. Eurographics State of the Art Report, 69--91.Google Scholar
- Shimojo, S., Simion, C., Shimijo, E., Scheier, C. 2003. Gaze bias both reflects and influences preference. Nature Neurosci., 6, 12, 1317--1322.Google Scholar
- Tatler, B., Hayhoe, M. M., Land, M. F., Ballard D. H. 2011. Eye guidance in natural vision: reinterpreting salience. Journal of Vision, 11, 5, 5, 1--23.Google ScholarCross Ref
- Wilkie, R. M., Kountouriotis, G. K., Merat, N., Wann, J. P. 2010. Using vision to control locomotion: looking where you want to go. Experimental Brain Research, 204, 4, 539--547.Google ScholarCross Ref
- Williams, B., Narasimham, G., Rump, B., McNamara, T. P., Carr, T. H., Rieser, J. J., Bodenheimer, B. 2007. Exploring large virtual environments with an HMD when physical space is limited. ACM/SIGGRAPH Symposium on Applied Perception in Graphics and Visualization, 41--48. Google ScholarDigital Library
- Zank, M. and Kunz A. 2015. Using locomotion models for estimating walking targets in immersive virtual environments. International Conference on Cyberworlds, 229--236. Google ScholarDigital Library
- Zank, M. and Kunz A. 2016. Eye tracking for locomotion prediction in redirected walking. IEEE Symposium on 3D User Interfaces, 49--58.Google Scholar
- Zmuda, M. A., Wonser, J. L., Bachmann, E. R., Hodgson, E. 2013. Optimizing constrained-environment redirected walking instructions using search techniques. IEEE Transactions on Visualization and Computer Graphics, 19, 11, 1872--1884. Google ScholarDigital Library
Index Terms
- Predicting destination using head orientation and gaze direction during locomotion in VR
Recommendations
Evaluation of Locomotion Techniques for Room-Scale VR: Joystick, Teleportation, and Redirected Walking
VRIC '18: Proceedings of the Virtual Reality International Conference - Laval VirtualDue to its multimodal nature virtual reality technology imposes new challenges, for example, when it comes to navigating through a virtual environment. Joystick-based controls and teleportation techniques support only limited self-motion experiences, ...
Head orientation and gaze direction in meetings
CHI EA '02: CHI '02 Extended Abstracts on Human Factors in Computing SystemsDetecting who is looking at whom during multiparty interaction is useful for various tasks such as meeting analysis. There are two contributing factors in the formation of where a person is looking at : head orientation and eye orientation. In this ...
Swaying Locomotion: A VR-based Locomotion System through Head Movements
VRST '21: Proceedings of the 27th ACM Symposium on Virtual Reality Software and TechnologyLocomotion systems used in virtual reality (VR) content have a significant impact on the content user experience. One of the most important factors of a walking system in VR is whether it can provide a plausible walking sensation because it is ...
Comments