Skip to main content
Log in

A geometric approach to remote eye tracking

  • Long Paper
  • Published:
Universal Access in the Information Society Aims and scope Submit manuscript

Abstract

This paper presents a principled analysis of various combinations of image features to determine their suitability for remote eye tracking. It begins by reviewing the basic theory underlying the connection between eye image and gaze direction. Then a set of approaches is proposed based on different combinations of well-known features and their behaviour is evaluated, taking into account various additional criteria such as free head movement, and minimum hardware and calibration requirements. The paper proposes a final method based on multiple glints and the pupil centre; the method is evaluated experimentally. Future trends in eye tracking technology are also discussed.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

References

  1. Babcock, J.S., Pelz, J.B.: Building a lightweight eyetracking headgear. In: Proceedings of the Eye Tracking Research and Applications symposium, pp. 109–114. ACM Press (2004)

  2. Barth, E., Dorr, M., Böhme, M., Gegenfurtner, K.R., Martinetz, T.: Guiding the mind’s eye: improving communication and vision by external control of the scanpath. In: Rogowitz, B.E., Pappas, T.N., Daly, S.J. (eds.) Human Vision and Electronic Imaging, Proceeddings of SPIE, 2006, vol. 6057. Invited Contribution for a Special Session on Eye Movements, Visual Search, and Attention: a Tribute to Larry Stark

  3. Beymer, D., Flickner, M.: Eye gaze tracking using an active stereo head. In: Proceedings of Computer Vision and Pattern Recognition (CVPR), vol. 2, pp. 451–458 (2003)

  4. Brolly, X.L.C., Mulligan, J.B.: Implicit calibration of a remote gaze tracker. In: Proceedings of the 2004 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW 2004), vol. 8, p. 134 (2004)

  5. COGAIN: D3.1 user requirements report, with observations of difficulties users are experiencing. Technical report, European Union Network of Excellence COGAIN (contract no. IST-2003-511598) of the 6th Framework Programme, 2005. http://www.cogain.org/results/reports/COGAIN-D3.1.pdf (2005)

  6. COGAIN: D3.2 report on features of the different systems and development needs. Technical report, European Union Network of Excellence COGAIN (contract no. IST2 003-511598) of the 6th Framework Programme, 2006. http://www.cogain.org/results/reports/COGAIN-D3.2.pdf (2006)

  7. Crane, H., Steele, C.: Accurate three-dimensional eye tracker. J. Opt. Soc. Am. 17(5), 691–705 (1978)

    Google Scholar 

  8. CSEM: SwissRanger SR-3000, CSEM SA, Zurich, Switzerland. http://www.swissranger.ch (2006)

  9. Duchowski, A.T.: Eye tracking methodology, theory and practice. Springer, London (2003)

    MATH  Google Scholar 

  10. Ebisawa, Y.: Unconstrained pupil detection technique using two light sources and the image difference method. In: Visualization and Intelligent Design in Engineering, pp. 79–89 (1989)

  11. Guestrin, E.D., Eizenman, M.: General theory of remote gaze estimation using the pupil center and corneal reflections. IEEE Trans. Biomed. Eng. 53(6), 1124–1133 (2006)

    Article  Google Scholar 

  12. Hansen, D.W., Pece, A.E.C.: Eye tracking in the wild. Comput. Vis. Image. Underst. 98(1), 155–181 (2005)

    Article  Google Scholar 

  13. Hennessey, C., Noureddin, B., Lawrence, P.: A single camera eye-gaze tracking system with free head motion. In: Proceedings of Eye Tracking Research and Applications (ETRA), pp. 87–94 (2006)

  14. Hutchinson, T.E.: Human-computer interaction using eye-gaze input. IEEE Trans. Syst. Man Cybern. 19(6) (1989)

  15. Ji, Q., Yang, X.: Real time visual cues extraction for monitoring driver vigilance. In: ICVS: Second International Workshop on Computer Vision Systems, Vancouver, Canada (2001)

  16. Karmali, F., Shelhamer, M.: Compensating for camera translation in video eye movement recordings by tracking a landmark selected automatically by a genetic algorithm. In: Annual International Conference of the IEEE Engineering in Medicine and Biology Proceedings, pp. 5298–5301 (2006)

  17. Kolakowski, S.M., Pelz, J.B.: Compensating for eye tracker camera movement. In: ETRA 2006: Proceedings of the 2006 symposium on Eye Tracking Research and Applications, pp. 79–85 (2006)

  18. Li, D., Winfield, D., Parkhurst, D.J.: Starburst: a hybrid algorithm for video-based eye tracking combining feature-based and model-based approaches. In: Proceedings of the IEEE Vision for Human-Computer Interaction Workshop at CVPR, pp. 1–8 (2005)

  19. Marquardt, D.: An algorithm for least-squares estimation of nonlinear parameters. SIAM J. Appl. Math. 11, 431–441 (1963)

    Article  MATH  MathSciNet  Google Scholar 

  20. Meyer, A., Böhme, M., Martinetz, T., Barth, E.: A single-camera remote eye tracker. In: Perception and Interactive Technologies. Lecture Notes in Artificial Intelligence, vol. 4021, pp. 208–211. Springer, New York (2006)

  21. Morimoto, C.H., Koons, D., Amir, A., Flickner, M.: Pupil detection and tracking using multiple light sources. IVC 18(4), 331–335 (2000)

    Google Scholar 

  22. Morimoto, C.H., Mimica, M.R.M.: Eye gaze tracking techniques for interactive applications. Comput. Vis. Image. Underst. 98(1), 4–24 (2005)

    Article  Google Scholar 

  23. Müller, P., Cavegn, D., d’Ydewalle, G., Groner, R.: A comparison of a new limbus tracker, corneal reflection technique, purkinje eye tracking and electro-oculography. In: d’Ydewalle, G., Rensbergen, J.V., (eds.) Perception and Cognition, pp. 393–401. Elsevier, Amsterdam (1993)

  24. Newman, R., Matsumoto, Y., Rougeaux, S., Zelinsky, A.: Real-time stereo tracking for head pose and gaze estimation. In: International Conference on Automatic Face and Gesture Recognition, pp. 122–128 (2000)

  25. Ohno, T., Mukawa, N.: A free-head, simple calibration, gaze tracking system that enables gaze-based interaction. In: Eye Tracking Research and Applications (ETRA), pp. 115–122 (2004)

  26. Pomerleau, D.A., Baluja, S.: Non-intrusive gaze tracking using artificial neural networks. In: CMU-CS-TR (1994)

  27. Rabbetts, R.B.: Bennett and Rabbetts clinical visual optics, 3rd edn. Butterworth-Heinemann, Elsevier, Edinburgh (1998)

  28. Shih, S.W., Liu, J.: A novel approach to 3-D gaze tracking using stereo cameras. IEEE Trans. Syst. Man Cybern. B. 34(1), 234–245 (2004)

    Article  Google Scholar 

  29. Shih, S.-W., Wu, Y.-T., Liu, J.: A calibration-free gaze tracking technique. In: Proceedings of the 15th International Conference on Pattern Recognition, pp. 201–204 (2000)

  30. Tan, K.-H., Kriegman, D.J., Ahuja, N.: Appearance-based eye gaze estimation. In: IEEE Workshop on Applications of Computer Vision, pp. 191–195 (2002)

  31. Tobii: Tobii 1750 eye tracker, Tobii Technology AB, Stockholm, Sweden. http://www.tobii.se (2002)

  32. Villanueva, A., Cabeza, R., Porta, S.: Eye tracking: pupil orientation geometrical modeling. Image Vis. Comput. 24(7), 663–679 (2006)

    Article  Google Scholar 

  33. Wyszecki, G., Stiles, W.S.: Color science: concepts and methods, quantitative data and formulae, 2nd edn. Wiley, New York (1982)

    Google Scholar 

  34. Yoo, D.H., Chung, M.J.: A novel non-instrusive eye gaze estimation using cross-ratio under large head motion. Comput. Vis. Image Underst. 98, 25–51 (2005)

    Article  Google Scholar 

  35. Young, L., Sheena, D.: Methods & designs: survey of eye movement recording methods. Behav. Res. Methods Instrum. 7(5), 397–429 (1975)

    Google Scholar 

Download references

Acknowledgments

Our research has received funding from the European Commission within the Network of Excellence COGAIN (contract no. IST-2003-511598) of the 6th Framework Programme. Additionally, research at the University of Lübeck has received funding from the European Commission within the project GazeCom (contract no. IST-C-033816) of the 6th FP. All views expressed herein are those of the authors alone; the European Community is not liable for any use made of the information.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Arantxa Villanueva.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Villanueva, A., Daunys, G., Hansen, D.W. et al. A geometric approach to remote eye tracking. Univ Access Inf Soc 8, 241–257 (2009). https://doi.org/10.1007/s10209-009-0149-0

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10209-009-0149-0

Keywords

Navigation