Skip to main content
SpringerLink
Log in

Gaze estimation using a webcam for region of interest detection

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

In this paper, a real-time gaze estimation system using a webcam is proposed, in which variation of head pose is tracked. At first, variation of head position and pose are estimated by using facial features. Then, an iterative iris center detection method is proposed for tracking iris in eye image. Finally, gaze is estimated by using estimated head pose and position, and iris center position. The proposed gaze estimation system is applied to four different applications. Experimental results show that the proposed iterative iris center detection method has a higher accuracy than conventional ones. Also, the proposed gaze estimation system shows about 98 % accuracy using \(640\times 480\) resolution webcam and 42-inch monitor that are 0.75 m apart.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

References

  1. Lee, H.C., Luong, D.T., Cho, C.W., Park, K.R.: Gaze tracking system at a distance for controlling IPTV. IEEE Trans. Consum. Electron. 56, 2577–2583 (2010)

    Article  Google Scholar 

  2. Hansen, D.W., Ji, Q.: In the eye of beholder: a survey of models for eyes and gaze. IEEE Trans. Pattern Anal. Mach. Intell. 32, 478–500 (2010)

    Article  Google Scholar 

  3. Sugano, Y., Matsushita, Y., Sato, Y.: Appearance-based gaze estimation using visual saliency. IEEE Trans. Pattern Anal. Mach. Intell. 35, 329–341 (2013)

    Article  Google Scholar 

  4. Ebisawa, Y.: A noncontact eye gaze point detection method used on support system for the disabled. In: Proceedings of IEEE Conference on Engineering in Medicine and Biology Society, pp. 1168–1170. Paris, France (1992)

  5. Handa, S., Ebisawa, Y.: Development of head-mounted display with eye-gaze detection function for the severely disabled. In: Proceedings of IEEE Conference on Virtual Environment, Human Computer Interfaces, and Measurement Systems, pp. 140–144. Istanbul, Turkey (2008)

  6. Nakazawa, A., Nitschke, C.: Point of gaze estimation through corneal surface reflection in an active illumination environment. In: Proceedings of European Conference on Computer Vision, pp. 159–172. Florence, Italy (2008)

  7. Cho, D., Yap, W., Lee, G., Lee, I., Kim, W.: Long range eye gaze tracking system for a large screen. IEEE Trans. Consum. Electron. 58, 1119–1128 (2012)

    Article  Google Scholar 

  8. Zhu, Z., Ji, Q.: Novel eye gaze tracking techniques under natural head movement. IEEE Trans. Biomed. Eng. 54, 2246–2260 (2007)

    Article  Google Scholar 

  9. Morimoto, C.H., Mimica, M.R.M.: Eye gaze tracking techniques for interactive applications. Comput. Vis. Image Underst. 98, 4–24 (2005)

    Article  Google Scholar 

  10. Mora, K. A. F., Odobez, J. M.: Person independent 3D gaze estimation form remote RGB-D camera. In: Proceedings of IEEE Conference on Image Processing, pp. 2787–2791. Melbourne, Victoria, Australia (2013)

  11. Asthana, A., Zafeiriou, S., Cheng, S., Pantic, M.: Incremental face alignment in the wild. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 1859–1866. Columbus, OH, USA (2014)

  12. Lablack, A., Maquet, F., Djeraba, C.: Determination of the visual field of persons in a scene. In: Proceedings of International Conference on Computer Vision Theory and Applications, pp. 313–316. Funchal, Portugal (2008)

  13. Valenti, R., Sebe, N., Gevers, T.: Combining head pose and eye location information for gaze estimation. IEEE Trans. Image Process. 21, 802–815 (2012)

    Article  MathSciNet  Google Scholar 

  14. Model, D., Eizenman, M.: An automatic personal calibration procedure for advanced gaze estimation systems. IEEE Trans. Biomed. Eng. 57, 1031–1039 (2010)

    Article  Google Scholar 

  15. Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 511–518. Kauai, HI, USA (2001)

  16. Murphy-Chutorian, E., Trivedi, M.M.: Head pose estimation in computer vision: a survey. IEEE Trans. Pattern Anal. Mach. Intell. 31, 607–626 (2009)

    Article  Google Scholar 

  17. Heo, J., Savvides, M.: Generic 3D face pose estimation using facial shapes. In: Proceedings of IEEE International Joint Conference on Biometrics, pp. 1–8. Washington D. C., USA (2011)

  18. Gee, A., Cipolla, R.: Determining the gaze of faces in images. Image Vis. Comput. 12, 639–648 (1994)

    Article  Google Scholar 

  19. Zhou, Z.H., Geng, X.: Projection function for eye detection. Pattern Recognit. 37, 1049–1056 (2004)

    Article  MATH  Google Scholar 

  20. Zheng, Z., Yang, J., Yang, L.: A robust method for eye features extraction on color image. Pattern Recognit. Lett. 26, 2252–2261 (2005)

    Article  Google Scholar 

  21. Baek, B., Lee, H., Kim, Y., Kim, T.: Mirrorless interchangeable-lens light field digital photography camera system. In: Proceedings of IEEE International Conference on Consumer Electronics, pp. 226–227. Las Vegas, NY, USA (2013)

  22. Chen, C. C., Lu, Y. C., Su, M. S.: Light field based digital refocusing using a DSLR camera with a pinhole array mask. In: Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing, pp. 754–757. Dallas, TX, USA (2010)

  23. Heo, H., Lee, E.C., Park, K.R., Kim, C.J., Whang, M.: A realistic game system using multi-modal user interfaces. IEEE Trans. Consum. Electron. 56, 1364–1372 (2010)

    Article  Google Scholar 

  24. Valenti, R., Gevers, T.: Accurate eye center location through invariant isocentric patterns. IEEE Trans. Pattern Anal. Mach. Intell. 34, 1785–1798 (2012)

    Article  Google Scholar 

  25. Timm, F., Barth, E.: Accurate eye centre localisation by means of gradients. In: Proceedings of International Conference on Computer Vision Theory and Applications, pp. 125–130. Vilamoura, Algarve, Portugal (2011)

Download references

Acknowledgments

This work was supported in part by the Brain Korea 21 Plus Project.

Author information

Authors and Affiliations

  1. Department of Electronic Engineering, School of Engineering, Sogang University, 35 Baekbeom-ro (Sinsu-dong), Mapo-gu, Seoul, 121-742, Korea

    H.-I. Kim, J.-B. Kim, J.-E. Lee, T.-Y. Lee & R.-H. Park

Authors
  1. H.-I. Kim
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. J.-B. Kim
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. J.-E. Lee
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. T.-Y. Lee
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. R.-H. Park
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to R.-H. Park.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kim, HI., Kim, JB., Lee, JE. et al. Gaze estimation using a webcam for region of interest detection. SIViP 10, 895–902 (2016). https://doi.org/10.1007/s11760-015-0837-6

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11760-015-0837-6

Keywords

Search

Navigation