Jun'ichi Murakami
ABSTRACT
This paper proposes a novel system to simultaneously capture gaze behavior and the whole body motion of a person experiencing 6-DOF VR contents. This system consists of a VR goggle, eye-trackers attached to the goggle, and multiple Kinects. Measurements of those devices are all described in the consistent global coordinate system. Since the Kinects are robustly calibrated, whichever position and pose a user is located, his/her whole body pose as well as gaze directions is correctly measured. Using this system, we can easily capture gaze behaviors as well as body motion of people under any VR scenes, which is helpful for physiological researches.
- Y. Fang, M. Emoto, R. Nakashima, K. Matsumiya, I. Kuriki, S. Shioiri, "Eye-position distribution depending on head orientation when observing movies on ultrahigh-definition television," ITE Transactions on Media Technology and Applications, Vol.3, No.2, pp.149--154, 2015.Google Scholar
Cross Ref
- Y. Fang, R. Nakashima, K. Matsumiya, I. Kuriki, S. Shioiri, "Eye-head coordination for visual cognitive processing," PLoS ONE, Vol.10, No.3, e0121035, 2015.Google Scholar
- Y. Yagi, I. Mitsugami, S. Shioiri, H. Habe, "Behavior Understanding Based on Intention-Gait Model," Human-Harmonized Information Technology, Vol.2, Springer, 2017.Google Scholar
- T. Okada, H. Yamazoe, I. Mitsugami, Y. Yagi, "Preliminaly analysis of gait changes that correspond to gaze direcions," 2nd IAPR Asian Conference on Pattern Recognition, pp.788--792, 2013. pp. 788--792, Nov. 2013. Google ScholarDigital Library
- J. Steen, "Vestibulo-Ocular Reflex (VOR)," Encyclopedia of Neuroscience, pp.4224--4228, 2009.Google ScholarCross Ref
- I. Mitsugami, Y. Okinaka, Y. Yagi, "Gaze Estimation Based on Eyeball-Head Dynamics," The 1st International Workshop on Human Activity Analysis with Highly Diverse Cameras, 2017.Google Scholar
- S. Baluja, D. Pomerleau, "Non-intrusive gaze tracking using artificial neural networks," Technical report, DTIC Document, 1994. Google ScholarDigital Library
- K.-H. Tan, D. J. Kriegman, N. Ahuja, "Appearance-based eye gaze estimation," In Proc. WACV, pp.191--195, 2002. Google ScholarDigital Library
- O. Williams, A. Blake, R. Cipolla, "Sparse and semisupervised visual mapping with the S3GP," In Proc. CVPR, pp.230--237, 2006. Google ScholarDigital Library
- W. Sewell, O. Komogortsev, "Real-time eye gaze tracking with an unmodified commodity webcam employing a neural network," In Ext. Abstracts CHI, pp.3739--3744, 2010. Google ScholarDigital Library
- F. Lu, Y. Sugano, T. Okabe, Y. Sato, "Adaptive linear regression for appearance-based gaze estimation," IEEE Trans.PAMI, Vol.36, No.10, pp.2033--2046, 2014.Google ScholarCross Ref
- https://www.ergoneers.com/en/hardware/dikablis-glasses/Google Scholar
- http://www.driver4vr.com/Google Scholar
- https://www.vive.com/Google Scholar
- https://pupil-labs.com/Google Scholar
Index Terms
- Gaze and body capture system under VR experiences
Recommendations
Shifts in reported gaze position due to changes in pupil size: ground truth and compensation
ETRA '12: Proceedings of the Symposium on Eye Tracking Research and ApplicationsCamera-based eye trackers are the mainstay of today's eye movement research and countless practical applications of eye tracking. Recently, a significant impact of changes in pupil size on the accuracy of camera-based eye trackers during fixation has ...
A pivotable head mounted camera system that is aligned by three-dimensional eye movements
ETRA '06: Proceedings of the 2006 symposium on Eye tracking research & applicationsThe first proof of concept of an eye movement driven head camera system was recently presented. This innovative device utilized voluntary and reflexive eye movements, which were registered by video-oculography and computed online, as signals to drive ...
Authoring directed gaze for full-body motion capture
We present an approach for adding directed gaze movements to characters animated using full-body motion capture. Our approach provides a comprehensive authoring solution that automatically infers plausible directed gaze from the captured body motion, ...
Comments