Skip to main content

Gaze Detection by Dual Camera and Dual IR-LED Illuminators

  • Conference paper
  • 1537 Accesses

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 2972))

Abstract

Gaze detection is to locate the position (on a monitor) of where a user is looking. This paper presents a new and practical method for detecting the monitor position where the user is looking. In general, the user tends to move both his head and eyes in order to gaze at certain monitor position. Previous researches use one wide-view camera, which can capture a whole user’s face. However, the image resolution is too low with such a camera and the fine movements of user’s eye cannot be exactly detected. So, we implement the gaze detection system with dual camera system(a wide and a narrow-view camera). In order to locate the user’s eye position accurately, the narrow-view camera has the functionalities of auto focusing/pan/tilting based on the detected 3D facial feature positions from the wide-view camera. In addition, we use IR-LED illuminator in order to detect facial features and especially eye features. To overcome the problem of specular reflection on a glasses, we use dual IR-LED illuminators and detect the accurate eye position with escaping the glasses specular reflection. From experimental results, we implement the real-time gaze detection system and obtain the gaze position accuracy between the computed positions and the real ones is about 3.44 cm of RMS error.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Azarbayejani, A.: Visually Controlled Graphics. IEEE Trans. PAMI 15(6), 602–605 (1993)

    Google Scholar 

  2. Park, K.R., et al.: Gaze Point Detection by Computing the 3D Positions and 3D Motions of Face. IEICE Trans. Inf.&Syst. E.83-D(4), 884–894 (2000)

    Google Scholar 

  3. Park, K.R., et al.: Gaze Detection by Estimating the Depth and 3D Motions of Facial Features in Monocular Images. IEICE Trans. Fundamentals E.82-A(10), 2274–2284 (1999)

    Google Scholar 

  4. Ohmura, K., et al.: Pointing Operation Using Detection of Face Direction from a Single View. IEICE Trans. Inf.&Syst. J72-D-II(9), 1441–1447 (1989)

    Google Scholar 

  5. Ballard, P., et al.: Controlling a Computer via Facial Aspect. IEEE Trans. on SMC 25(4), 669–677 (1995)

    Google Scholar 

  6. Gee, A., et al.: Fast visual tracking by temporal consensus. Image and Vision Computing 14, 105–114 (1996)

    Article  Google Scholar 

  7. Heinzmann, J., et al.: 3D Facial Pose and Gaze Point Estimation using a Robust Real-Time Tracking Paradigm. In: Proceedings of ICAFGR, pp. 142–147 (1998)

    Google Scholar 

  8. Rikert, T.: Gaze Estimation using Morphable Models. In: ICAFGR, pp. 436–441 (1998)

    Google Scholar 

  9. Ali-A-L, A., et al.: Man-machine interface through eyeball direction of gaze. In: Proc. of the Southeastern Symposium on System Theory, pp. 478–482 (1997)

    Google Scholar 

  10. Tomono, A., et al.: Eye Tracking Method Using an Image Pickup Apparatus. In: European Patent Specification-94101635 (1994)

    Google Scholar 

  11. Eyemark Recorder Model EMR-NC, NAC Image Technology Cooperation

    Google Scholar 

  12. Porrill, J., et al.: Robust and optimal use of information in stereo vision. Nature 397(6714), 63–66 (1999)

    Article  Google Scholar 

  13. Varchmin, A.C., et al.: Image based recognition of gaze direction using adaptive methods. In: Gesture and Sign Language in Human-Computer Interaction. Int. Gesture Workshop Proc., Berlin, Germany, pp. 245–257 (1998)

    Google Scholar 

  14. Heinzmann, J., et al.: Robust real-time face tracking and gesture recognition. In: Proc. of the IJCAI, vol. 2, pp. 1525–1530 (1997)

    Google Scholar 

  15. Matsumoto, Y., et al.: An algorithm for real-time stereo vision implementation of head pose and gaze direction measurement. In: Proc. the ICAFGR, pp. 499–504 (2000)

    Google Scholar 

  16. Newman, R., et al.: Real-time stereo tracking for head pose and gaze estimation. In: Proceedings the 4th ICAFGR 2000, pp. 122–128 (2000)

    Google Scholar 

  17. Betke, M., et al.: Gaze detection via self-organizing gray-scale units. In: Proc. Int. Workshop on Recog., Analy., and Tracking of Faces and Gestures in Real-Time System, pp. 70–76 (1999)

    Google Scholar 

  18. Park, K.R., et al.: Intelligent Process Control via Gaze Detection Technology. EAAI 13(5), 577–587 (2000)

    Google Scholar 

  19. Park, K.R., et al.: Facial and Eye Gaze detection. In: Bülthoff, H.H., Lee, S.-W., Poggio, T.A., Wallraven, C. (eds.) BMCV 2002. LNCS, vol. 2525, pp. 368–376. Springer, Heidelberg (2002)

    Chapter  Google Scholar 

  20. Park, K.R., et al.: Gaze Position Detection by Computing the 3 Dimensional Facial Positions and Motions. Pattern Recognition 35(11), 2559–2569 (2002)

    Article  MATH  Google Scholar 

  21. Wang, J., Sung, E.: Study on Eye Gaze Estimation. IEEE Trans. on SMC 32(3), 332–350 (2002)

    Google Scholar 

  22. http://www.is.cs.cmu.edu/mie/modelgaze-tracking.html

  23. Matsumoto, Y.: An Algorithm for Real-time Stereo Vision Implementation of Head Pose and Gaze Direction Measurement. In: ICFGR, pp. 499–505 (2000)

    Google Scholar 

  24. http://www.iscaninc.com

  25. http://www.seeingmachines.com

  26. Wolfe, B., Eichmann, D.: A neural network approach to tracking eye position. International Journal Human Computer Interaction 9(1), 59–79 (1997)

    Article  Google Scholar 

  27. Beymer, D., Flickner, M.: Eye Gaze Tracking Using an Active Stereo Head. IEEE Computer Vision and Pattern Recognition (2003)

    Google Scholar 

  28. Zhu, J., et al.: Subpixel eye gaze tracking. In: International Conference on Face and Gesture Recognition (2002)

    Google Scholar 

  29. Stiefelhagen, R., Yang, J., Waibel, A.: Tracking eyes and monitoring eye gaze. In: Proceedings of Workshop on Perceptual User Interfaces, pp. 98–100 (1997)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2004 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Park, K.R., Kim, J. (2004). Gaze Detection by Dual Camera and Dual IR-LED Illuminators. In: Monroy, R., Arroyo-Figueroa, G., Sucar, L.E., Sossa, H. (eds) MICAI 2004: Advances in Artificial Intelligence. MICAI 2004. Lecture Notes in Computer Science(), vol 2972. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-24694-7_64

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-24694-7_64

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-21459-5

  • Online ISBN: 978-3-540-24694-7

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics