Skip to main content

Eye Tracking Using Neural Network and Mean-Shift

  • Conference paper
Computational Science and Its Applications - ICCSA 2006 (ICCSA 2006)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 3982))

Included in the following conference series:

Abstract

In this paper, an eye tracking method is presented using a neural network (NN) and mean-shift algorithm that can accurately detect and track user’s eyes under the cluttered background. In the proposed method, to deal with the rigid head motion, the facial region is first obtained using skin-color model and connected-component analysis. Thereafter the eye regions are localized using neural network (NN)-based texture classifier that discriminates the facial region into eye class and non-eye class, which enables our method to accurately detect users’ eyes even if they put on glasses. Once the eye region is localized, they are continuously and correctly tracking by mean-shift algorithm. To assess the validity of the proposed method, it is applied to the interface system using eye movement and is tested with a group of 25 users through playing a ‘aligns games.’ The results show that the system process more than 30 frames/sec on PC for the 320×240 size input image and supply a user-friendly and convenient access to a computer in real-time operation.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 139.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Jacob, R.J.K.: Human-computer interaction: Input devices. ACM Computing Surveys 28(1) (1996)

    Google Scholar 

  2. Sharma, R., Pavlovic, V.I., Huang, T.S.: Toward multimodal human-computer interface. Proceedings of the IEEE 86(5), 853–869 (1998)

    Article  Google Scholar 

  3. Kaufman, A.E., Bandopadhay, A., Shaviv, B.D.: An Eye Tracking Computer User Interface. Virtual Reality. In: Proceedings of IEEE 1993 Symposium on Research Frontiers in, pp. 25–26 (1993)

    Google Scholar 

  4. Scassellati, B.: Eye finding via face detection for a foveated, active vision system. American Association for Artificial Intelligence (1998)

    Google Scholar 

  5. Kurata, T., Okuma, T., Kourogi, M., Sakaue, K.: The Hand Mouse: GMM Hand-color Classification and Mean Shift Tracking. In: Proc. Second International Workshop on Recognition, Analysis and Tracking of Faces and Gestures in Real-time Systems (RATFG-RTS 2001) in conjunction with ICCV 2001, Vancouver, Canada, pp. 119–124 (2001)

    Google Scholar 

  6. Takami, N., Irie, K.C., Ishimatsu, T., Ochiai, T.: Computer interface to use head movement for handicapped people. In: TENCON 1996. Proceedings. 1996 IEEE TENCON. Digital Signal Processing Applications, 26-29 November, vol. 1, pp. 468–472 (1996)

    Google Scholar 

  7. Sako, H., Whitehouse, M., Smith, A., Sutherland, A.: Real-time facial-feature tracking based on matching techniques and its applications. In: Proceedings of the 12th IAPR International Conference on Pattern Recognition, Computer Vision & Image Processing 1994, vol. 2(9-13), pp. 320–324 (1994)

    Google Scholar 

  8. Kim, S.-H., Kim, H.-G., Tchah, K.-H.: Object oriented face detection using range and color information. Electronics Letters 34(10,14), 979–980 (1998)

    Article  Google Scholar 

  9. Schiele, B., Waibel, A.: Gaze Tracking Based on Face-Color. School of Computer Science, Carnegie Mello University (1995)

    Google Scholar 

  10. Yang, J., Waibel, A.: A real-time face tracker. Applications of Computer Vision. In: Proceedings 3rd IEEE Workshop on WACV 1996, vol. 2-4, pp. 142–147 (1996)

    Google Scholar 

  11. Betke, M., Gips, J., Fleming, P.: The camera mouse: visual tracking of body features to provide computer access for people with severe disabilities. Neural Systems and Rehabilitation Engineering, IEEE Transactions on [see also IEEE Trans. on Rehabilitation Engineering] 10(1), 1–10 (2002)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2006 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Kim, E.Y., Kang, S.K. (2006). Eye Tracking Using Neural Network and Mean-Shift. In: Gavrilova, M., et al. Computational Science and Its Applications - ICCSA 2006. ICCSA 2006. Lecture Notes in Computer Science, vol 3982. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11751595_126

Download citation

  • DOI: https://doi.org/10.1007/11751595_126

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-34075-1

  • Online ISBN: 978-3-540-34076-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics