Abstract
In this paper, a real-time gaze estimation system using a webcam is proposed, in which variation of head pose is tracked. At first, variation of head position and pose are estimated by using facial features. Then, an iterative iris center detection method is proposed for tracking iris in eye image. Finally, gaze is estimated by using estimated head pose and position, and iris center position. The proposed gaze estimation system is applied to four different applications. Experimental results show that the proposed iterative iris center detection method has a higher accuracy than conventional ones. Also, the proposed gaze estimation system shows about 98 % accuracy using \(640\times 480\) resolution webcam and 42-inch monitor that are 0.75 m apart.








Similar content being viewed by others
References
Lee, H.C., Luong, D.T., Cho, C.W., Park, K.R.: Gaze tracking system at a distance for controlling IPTV. IEEE Trans. Consum. Electron. 56, 2577–2583 (2010)
Hansen, D.W., Ji, Q.: In the eye of beholder: a survey of models for eyes and gaze. IEEE Trans. Pattern Anal. Mach. Intell. 32, 478–500 (2010)
Sugano, Y., Matsushita, Y., Sato, Y.: Appearance-based gaze estimation using visual saliency. IEEE Trans. Pattern Anal. Mach. Intell. 35, 329–341 (2013)
Ebisawa, Y.: A noncontact eye gaze point detection method used on support system for the disabled. In: Proceedings of IEEE Conference on Engineering in Medicine and Biology Society, pp. 1168–1170. Paris, France (1992)
Handa, S., Ebisawa, Y.: Development of head-mounted display with eye-gaze detection function for the severely disabled. In: Proceedings of IEEE Conference on Virtual Environment, Human Computer Interfaces, and Measurement Systems, pp. 140–144. Istanbul, Turkey (2008)
Nakazawa, A., Nitschke, C.: Point of gaze estimation through corneal surface reflection in an active illumination environment. In: Proceedings of European Conference on Computer Vision, pp. 159–172. Florence, Italy (2008)
Cho, D., Yap, W., Lee, G., Lee, I., Kim, W.: Long range eye gaze tracking system for a large screen. IEEE Trans. Consum. Electron. 58, 1119–1128 (2012)
Zhu, Z., Ji, Q.: Novel eye gaze tracking techniques under natural head movement. IEEE Trans. Biomed. Eng. 54, 2246–2260 (2007)
Morimoto, C.H., Mimica, M.R.M.: Eye gaze tracking techniques for interactive applications. Comput. Vis. Image Underst. 98, 4–24 (2005)
Mora, K. A. F., Odobez, J. M.: Person independent 3D gaze estimation form remote RGB-D camera. In: Proceedings of IEEE Conference on Image Processing, pp. 2787–2791. Melbourne, Victoria, Australia (2013)
Asthana, A., Zafeiriou, S., Cheng, S., Pantic, M.: Incremental face alignment in the wild. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 1859–1866. Columbus, OH, USA (2014)
Lablack, A., Maquet, F., Djeraba, C.: Determination of the visual field of persons in a scene. In: Proceedings of International Conference on Computer Vision Theory and Applications, pp. 313–316. Funchal, Portugal (2008)
Valenti, R., Sebe, N., Gevers, T.: Combining head pose and eye location information for gaze estimation. IEEE Trans. Image Process. 21, 802–815 (2012)
Model, D., Eizenman, M.: An automatic personal calibration procedure for advanced gaze estimation systems. IEEE Trans. Biomed. Eng. 57, 1031–1039 (2010)
Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 511–518. Kauai, HI, USA (2001)
Murphy-Chutorian, E., Trivedi, M.M.: Head pose estimation in computer vision: a survey. IEEE Trans. Pattern Anal. Mach. Intell. 31, 607–626 (2009)
Heo, J., Savvides, M.: Generic 3D face pose estimation using facial shapes. In: Proceedings of IEEE International Joint Conference on Biometrics, pp. 1–8. Washington D. C., USA (2011)
Gee, A., Cipolla, R.: Determining the gaze of faces in images. Image Vis. Comput. 12, 639–648 (1994)
Zhou, Z.H., Geng, X.: Projection function for eye detection. Pattern Recognit. 37, 1049–1056 (2004)
Zheng, Z., Yang, J., Yang, L.: A robust method for eye features extraction on color image. Pattern Recognit. Lett. 26, 2252–2261 (2005)
Baek, B., Lee, H., Kim, Y., Kim, T.: Mirrorless interchangeable-lens light field digital photography camera system. In: Proceedings of IEEE International Conference on Consumer Electronics, pp. 226–227. Las Vegas, NY, USA (2013)
Chen, C. C., Lu, Y. C., Su, M. S.: Light field based digital refocusing using a DSLR camera with a pinhole array mask. In: Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing, pp. 754–757. Dallas, TX, USA (2010)
Heo, H., Lee, E.C., Park, K.R., Kim, C.J., Whang, M.: A realistic game system using multi-modal user interfaces. IEEE Trans. Consum. Electron. 56, 1364–1372 (2010)
Valenti, R., Gevers, T.: Accurate eye center location through invariant isocentric patterns. IEEE Trans. Pattern Anal. Mach. Intell. 34, 1785–1798 (2012)
Timm, F., Barth, E.: Accurate eye centre localisation by means of gradients. In: Proceedings of International Conference on Computer Vision Theory and Applications, pp. 125–130. Vilamoura, Algarve, Portugal (2011)
Acknowledgments
This work was supported in part by the Brain Korea 21 Plus Project.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Kim, HI., Kim, JB., Lee, JE. et al. Gaze estimation using a webcam for region of interest detection. SIViP 10, 895–902 (2016). https://doi.org/10.1007/s11760-015-0837-6
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11760-015-0837-6