Skip to main content
SpringerLink
Log in

Improving Head Movement Tolerance of Cross-Ratio Based Eye Trackers

  • Published:
International Journal of Computer Vision Aims and scope Submit manuscript

Abstract

When first introduced, the cross-ratio (CR) based remote eye tracking method offered many attractive features for natural human gaze-based interaction, such as simple camera setup, no user calibration, and invariance to head motion. However, due to many simplification assumptions, current CR-based methods are still sensitive to head movements. In this paper, we revisit the CR-based method and introduce two new extensions to improve the robustness of the method to head motion. The first method dynamically compensates for scale changes in the corneal reflection pattern, and the second method estimates true coplanar eye features so that the cross-ratio can be applied. We present real-time implementations of both systems, and compare the performance of these new methods using simulations and user experiments. Our results show a significant improvement in robustness to head motion and, for the user experiments in particular, an average reduction of up to 40 % in gaze estimation error was observed.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20
Fig. 21
Fig. 22
Fig. 23
Fig. 24

Similar content being viewed by others

References

  • Cerrolaza, J. J., Villanueva, A., & Cabeza, R. (2008). Taxonomic study of polynomial regressions applied to the calibration of video-oculographic systems. In Proceedings of the 2008 symposium on eye tracking research & applications, ETRA ’08 (pp. 259–266). New York: ACM Press.

    Chapter  Google Scholar 

  • Chen, J., Tong, Y., Gray, W., & Ji, Q. (2008). A robust 3d eye gaze tracking system using noise reduction. In ETRA ’08: proceedings of the 2008 symposium on eye tracking research & applications (pp. 189–196). New York: ACM Press.

    Chapter  Google Scholar 

  • Coutinho, F., & Morimoto, C. (2006). Free head motion eye gaze tracking using a single camera and multiple light sources. In 19th Brazilian symposium on computer graphics and image processing, 2006, SIBGRAPI ’06 (pp. 171–178).

    Chapter  Google Scholar 

  • Duchowski, A. T. (2003). Eye tracking methodology: theory and practice. Berlin: Springer.

    MATH  Google Scholar 

  • Ebisawa, Y. (1995). Unconstrained pupil detection technique using two light sources and the image difference method. In Visualization and intelligent design in engineering and architecture (pp. 79–89.

    Google Scholar 

  • Emanuele Trucco, A. V. (1998). Introductory techniques for 3-D computer vision. New York: Prentice Hall.

    Google Scholar 

  • Guestrin, E., & Eizenman, M. (2006). General theory of remote gaze estimation using the pupil center and corneal reflections. IEEE Transactions on Biomedical Engineering, 53(6), 1124–1133.

    Article  Google Scholar 

  • Guestrin, E. D., & Eizenman, M. (2008). Remote point-of-gaze estimation requiring a single-point calibration for applications with infants. In ETRA ’08: proceedings of the 2008 symposium on eye tracking research & applications (pp. 267–274). New York: ACM Press.

    Chapter  Google Scholar 

  • Guestrin, E. D., & Eizenman, M. (2010). Listing’s and Donders’ laws and the estimation of the point-of-gaze. In Proceedings of the 2010 symposium on eye-tracking research & applications, ETRA ’10 (pp. 199–202). New York: ACM Press.

    Chapter  Google Scholar 

  • Guestrin, E. D., Eizenman, M., Kang, J. J., & Eizenman, E. (2008). Analysis of subject-dependent point-of-gaze estimation bias in the cross-ratios method. In Proceedings of the 2008 symposium on eye tracking research & applications, ETRA ’08 (pp. 237–244). New York: ACM Press.

    Chapter  Google Scholar 

  • Hansen, D. W., Agustin, J. S., & Villanueva, A. (2010). Homography normalization for robust gaze estimation in uncalibrated setups. In Proceedings of the 2010 symposium on eye-tracking research & applications, ETRA ’10 (pp. 13–20). New York: ACM Press.

    Chapter  Google Scholar 

  • Hansen, D. W., & Ji, Q. (2010). In the eye of the beholder: A survey of models for eyes and gaze. IEEE Transactions on Pattern Analysis and Machine Intelligence, 32, 478–500.

    Article  Google Scholar 

  • Hartley, R., & Zisserman, A. (2000). Multiple view geometry in computer vision. Cambridge: Cambridge University Press. ISBN: 0521623049.

    MATH  Google Scholar 

  • Hennessey, C., Noureddin, B., & Lawrence, P. (2006). A single camera eye-gaze tracking system with free head motion. In Proc. of the ETRA 2006 (pp. 87–94). San Diego, CA.

    Google Scholar 

  • Kang, J. J., Guestrin, E. D., Maclean, W. J., & Eizenman, M. (2007). Simplifying the cross-ratios method of point-of-gaze estimation. In 30th Canadian medical and biological engineering conference (CMBEC30).

    Google Scholar 

  • Kaufman, A., Bandopadhay, A., & Shaviv, B. (1993). An eye tracking computer user interface. In Proc. of the research frontier in virtual reality workshop (pp. 78–84).

    Google Scholar 

  • Model, D., & Eizenman, M. (2010). User-calibration-free remote gaze estimation system. In Proceedings of the 2010 symposium on eye-tracking research & applications, ETRA ’10 (pp. 29–36). New York: ACM Press.

    Chapter  Google Scholar 

  • Morimoto, C. H., & Mimica, M. R. M. (2005). Eye gaze tracking techniques for interactive applications. Computer Vision and Image Understanding, 98(1), 4–24.

    Article  Google Scholar 

  • Morimoto, C. H., Koons, D., Amir, A., & Flickner, M. (1999). Frame-rate pupil detector and gaze tracker. In Proceedings of the IEEE ICCV’99 frame-rate computer vision applications workshop.

    Google Scholar 

  • Nagamatsu, T., Kamahara, J., Iko, T., & Tanaka, N. (2008). One-point calibration gaze tracking based on eyeball kinematics using stereo cameras. In ETRA’08 (pp. 95–98).

    Google Scholar 

  • Nagamatsu, T., Iwamoto, Y., Kamahara, J., Tanaka, N., & Yamamoto, M. (2010a). Gaze estimation method based on an aspherical model of the cornea: surface of revolution about the optical axis of the eye. In Proceedings of the 2010 symposium on eye-tracking research & applications, ETRA ’10 (pp. 255–258). New York: ACM Press.

    Chapter  Google Scholar 

  • Nagamatsu, T., Sugano, R., Iwamoto, Y., Kamahara, J., & Tanaka, N. (2010b). User-calibration-free gaze tracking with estimation of the horizontal angles between the visual and the optical axes of both eyes. In Proceedings of the 2010 symposium on eye-tracking research & applications, ETRA ’10 (pp. 251–254). New York: ACM Press.

    Chapter  Google Scholar 

  • Robinson, D. A. (1963). A method of measuring eye movements using a scleral search coil in a magnetic field. IEEE Transactions on Biomedical Engineering, 10, 137–145.

    Google Scholar 

  • Shih, S., & Liu, J. (2003). A novel approach to 3d gaze tracking using stereo cameras. IEEE Transactions on Systems, Man and Cybernetics Part B Cybernetics, 1–12 (2003).

  • Villanueva, A., Cabeza, R., Porta, S., Bohme, M., Droege, D., & Mulvey, F. (2008) Report on new approaches to eye tracking, summary of new algorithms. In Communication by gaze interaction (COGAIN), IST-2003-511598: Deliverable 5.6 (2008).

    Google Scholar 

  • Wang, J. G., & Sung, E. (2002). Study on eye gaze estimation. IEEE Transactions on Systems, Man and Cybernetics Part B Cybernetics, 32(3), 332–350.

    Article  Google Scholar 

  • Yoo, D. H., & Chung, M. J. (2005). A novel non-intrusive eye gaze estimation using cross-ratio under large head motion. Computer Vision and Image Understanding, 98(1), 25–51, Special Issue on Eye Detection and Tracking.

    Article  Google Scholar 

  • Yoo, D. H., Kim, J. H., Lee, B. R., & Chung, M. J. (2002). Non-contact eye gaze tracking system by mapping of corneal reflections. In Proceedings fifth IEEE international conference on automatic face and gesture recognition, 2002 (pp. 94–99).

    Google Scholar 

Download references

Acknowledgements

The authors would like to thank Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES), Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP) and IBM for their financial support.

Author information

Authors and Affiliations

  1. Department of Computer Science, University of São Paulo, São Paulo, Brazil

    Flavio L. Coutinho & Carlos H. Morimoto

Authors
  1. Flavio L. Coutinho
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Carlos H. Morimoto
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Flavio L. Coutinho.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Coutinho, F.L., Morimoto, C.H. Improving Head Movement Tolerance of Cross-Ratio Based Eye Trackers. Int J Comput Vis 101, 459–481 (2013). https://doi.org/10.1007/s11263-012-0541-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11263-012-0541-8

Keywords

Search

Navigation