Christopher McMurrough
Vangelis Metsis
ABSTRACT
In this paper, we present a low-cost solution for real-time tracking of a human user's head position with respect to a video display source for eye gaze estimation in an assistive setting. The solution utilizes a wearable headset equipped with sensors found in commercially available off-the-shelf video gaming devices in order to minimize hardware complexity and expense. A pair of Nintendo Wiimote imaging sensors are used to create a stereo camera for 6DOF position tracking of the headset, while a modified Playstation Eye monocular camera is used to track the pupil position. The resulting tracking hardware is able to measure the 3D position of four infrared LEDs mounted at known locations on the video display using triangulation of the stereo camera data. Integration of the head tracking estimate with a computer vision based pupil tracking solution in order to compute the user's point of gaze is also described.
- K. S. Arun, T. S. Huang, and S. D. Blostein. Least-squares fitting of two 3-d point sets. Pattern Analysis and Machine Intelligence, IEEE Transactions on, PAMI-9(5):698--700, sept. 1987. Google Scholar
Digital Library
- J. S. Babcock and J. B. Pelz. Building a lightweight eyetracking headgear. In Proceedings of the 2004 symposium on Eye tracking research & applications, ETRA '04, pages 109--114, New York, NY, USA, 2004. ACM. Google ScholarDigital Library
- S. Birchfield. Elliptical head tracking using intensity gradients and color histograms. In Computer Vision and Pattern Recognition, 1998. Proceedings. 1998 IEEE Computer Society Conference on, pages 232--237, jun 1998. Google ScholarDigital Library
- J.-Y. Bouguet. Camera Calibration Toolbox for Matlab. http://www.vision.caltech.edu/bouguetj/calib doc/, 2007.Google Scholar
- A. Boyali and M. Kavakli. 3d and 6 dof user input platform for computer vision applications and virtual reality. In Innovations in Intelligent Systems and Applications (INISTA), 2011 International Symposium on, pages 258--263, june 2011.Google ScholarCross Ref
- M. Cascia, S. Sclaroff, and V. Athitsos. Fast, reliable head tracking under varying illumination: an approach based on registration of texture-mapped 3d models. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 22(4):322--336, apr 2000. Google ScholarDigital Library
- Z. Eveland. Wii Remote IR sensitivity. http://wiicanetouchgraphic.blogspot.com/, 2009.Google Scholar
- EyeWriter Initiative. The EyeWriter. http://www.eyewriter.org/, 2009.Google Scholar
- S. Kohlbecher, K. Bartl, S. Bardins, and E. Schneider. Low-latency combined eye and head tracking system for teleoperating a robotic head in real-time. In Proceedings of the 2010 Symposium on Eye-Tracking Research & Applications, ETRA '10, pages 117--120, New York, NY, USA, 2010. ACM. Google ScholarDigital Library
- J. C. Lee. Hacking the nintendo wii remote. IEEE Pervasive Computing, 7:39--45, July 2008. Google ScholarDigital Library
- D. Li, J. Babcock, and D. J. Parkhurst. openeyes: a low-cost head-mounted eye-tracking solution. In Proceedings of the 2006 symposium on Eye tracking research & applications, ETRA '06, pages 95--100, New York, NY, USA, 2006. ACM. Google ScholarDigital Library
- D. Li, D. Winfield, and D. Parkhurst. Starburst: A hybrid algorithm for video-based eye tracking combining feature-based and model-based approaches. In Computer Vision and Pattern Recognition - Workshops, 2005. CVPR Workshops. IEEE Computer Society Conference on, page 79, june 2005. Google ScholarDigital Library
- S. M. Munn and J. B. Pelz. 3d point-of-regard, position and head orientation from a portable monocular video-based eye tracker. In Proceedings of the 2008 symposium on Eye tracking research & applications, ETRA '08, pages 181--188, New York, NY, USA, 2008. ACM. Google ScholarDigital Library
- D. Scherfgen and R. Herpers. 3d tracking using multiple nintendo wii remotes: a simple consumer hardware tracking approach. In Proceedings of the 2009 Conference on Future Play on @ GDC Canada, Future Play '09, pages 31--32, New York, NY, USA, 2009. ACM. Google ScholarDigital Library
- J.-G. Wang and E. Sung. Study on eye gaze estimation. Systems, Man, and Cybernetics, Part B: Cybernetics, IEEE Transactions on, 32(3):332--350, jun 2002. Google ScholarDigital Library
Index Terms
- Low-cost head position tracking for gaze point estimation
Recommendations
An eye tracking dataset for point of gaze detection
ETRA '12: Proceedings of the Symposium on Eye Tracking Research and ApplicationsThis paper presents a new, publicly available eye tracking dataset, aimed to be used as a benchmark for Point of Gaze (PoG) detection algorithms. The dataset consists of a set of videos recording the eye motion of human test subjects as they were ...
Eye, Head and Torso Coordination During Gaze Shifts in Virtual Reality
Humans perform gaze shifts naturally through a combination of eye, head and body movements. Although gaze has been long studied as input modality for interaction, this has previously ignored the coordination of the eyes, head and body. This article ...
One-point calibration gaze tracking based on eyeball kinematics using stereo cameras
ETRA '08: Proceedings of the 2008 symposium on Eye tracking research & applicationsThis paper presents a one-point calibration gaze tracking method based on eyeball kinematics using stereo cameras. By using two cameras and two light sources, the optic axis of the eye can be estimated. One-point calibration is required to estimate the ...
Comments