Skip to main content
SpringerLink
Log in

Accurate iris center localization method using facial landmark, snakuscule, circle fitting and binary connected component

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Iris centers have been widely used in machine vision for face matching, gaze estimation, etc. However, in low resolution eye images, the iris and its surrounding region present a variety of appearance characteristics, which make it difficult to accurately locate the iris center. In this paper, we propose a robust, accurate and real-time iris center localization method by combining the facial landmark, snakuscule, circle fitting and binary connected component. Facial landmarks are used to extract an accurate eye Region of Interest (ROI). Thereafter, a fixed size circle-based active contour snakuscule is used to detect the iris center. Based on the snakuscule center and inner radius, a novel method is proposed to extract accurate iris edges for circle fitting. In addition, the quality of the detected iris center is evaluated by a circle-binary quality evaluation method. Binary connected component method is used to improve the accuracies in those unqualified images. The proposed method is tested on three publicly available databases BioID, GI4E and Talking Face Video. The result shows that it could achieve an accuracy of 94.35% on the BioID database when the normalized error is smaller than 0.05, which outperforms all state-of-the-art methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

References

  1. Ahuja K, Banerjee R, Nagar S, Dey K (2016) Eye center localization and detection using radial mapping. In: IEEE international conference on image processing (ICIP), pp 3121–3125

  2. BioID Face Database. https://www.bioid.com/About/BioID-Face-Database. Accessed 2016

  3. Cai H, Yu H, Zhou X, Liu H (2016) Robust gaze estimation via normalized iris center-eye corner vector. In: International conference on intelligent robotics and applications, pp 300–309

  4. Chan TF, Vese LA (2001) Active contours without edges. IEEE Trans Image Process 10(2):266–277

    Article  MATH  Google Scholar 

  5. Duchowski A (2007) Eye tracking methodology: theory and practice. Springer Science & Business Media, London

    MATH  Google Scholar 

  6. Garg S, Tripathi A, Cutrell E (2016) Accurate eye center localization using Snakuscule. In: IEEE winter conference on applications of computer vision (WACV), pp 1–8

  7. Gou C, Wu Y, Wang K, Wang FY, Ji Q (2016) Learning-by-synthesis for accurate eye detection. In: IEEE 23rd international conference on pattern recognition (ICPR), pp 3362–3367

  8. Han Z, Su T, Ou Z, Xu W (2014) Precise localization of eye centers with multiple cues. Multimedia Tools and Applications 68(3):931–945

    Article  Google Scholar 

  9. Hansen DW, Ji Q (2010) In the eye of the beholder: a survey of models for eyes and gaze. IEEE Trans Pattern Anal Mach Intell 32(3):478–500

    Article  Google Scholar 

  10. Hilal A, Daya B, Beauseroy P (2012) Hough transform and active contour for enhanced iris segmentation. International Journal of Computer Science Issues 9(6):1–10

    Google Scholar 

  11. Jesorsky O, Kirchberg KJ, Frischholz RW (2001) Robust face detection using the hausdorff distance. In: International conference on audio-and video-based biometric person authentication, pp 90–95

  12. Kazemi V, Sullivan J (2014) One millisecond face alignment with an ensemble of regression trees. In: 27th IEEE conference on computer vision and pattern recognition (CVPR), pp 1867–1874

  13. Kim KN, Ramakrishna RS (1999) Vision-based eye-gaze tracking for human computer interface. IEEE SMC’99 Conference on Systems, Man, and Cybernetics 2:324–329

    Google Scholar 

  14. Kim ST, Choi KA, Shin YG, Ko S (2015) A novel iris center localization based on circle fitting using radially sampled features. In: IEEE international symposium on consumer electronics (ISCE), pp 1–2

  15. King DE (2009) Dlib-ml: a machine learning toolkit. J Mach Learn Res 10 (Jul):1755–1758

    Google Scholar 

  16. Koh J, Govindaraju V, Chaudhary V (2010) A robust iris localization method using an active contour model and hough transform. In: 20th international conference on pattern recognition (ICPR), pp 2852–2856

  17. Kroon B, Maas S, Boughorbel S, Hanjalic A (2009) Eye localization in low and standard definition content with application to face matching. Comput Vis Image Underst 113(8):921–933

    Article  Google Scholar 

  18. Laddi A, Prakash NR (2016) An augmented image gradients based supervised regression technique for iris center localization. Multimed Tools Appl 76(5):1–11

    Google Scholar 

  19. Li D, Winfield D, Parkhurst DJ (2005) Starburst: a hybrid algorithm for video-based eye tracking combining feature-based and model-based approaches. In: IEEE computer society conference on computer vision and pattern recognition-workshops, pp 79–79

  20. Li Y, Xue F, Feng L, Qu Z (2017) A driving behavior detection system based on a smartphone’s built-in sensor. Int J Commun Syst 30:e3178. https://doi.org/10.1002/dac.3178

    Article  Google Scholar 

  21. Liu Y, Nie L, Han L, Zhang L, Rosenblum DS (2015) Action2activity: recognizing complex activities from sensor data. In: IJCAI, pp 1617–1623

  22. Liu L, Cheng L, Liu Y, Jia Y, Rosenblum DS (2016) Recognizing complex activities by a probabilistic Interval-Based model. In: AAAI, vol 30, pp 1266–1272

  23. Liu Y, Nie L, Liu L, Rosenblum DS (2016) From action to activity: sensor-based activity recognition. Neurocomputing 181:108–115

    Article  Google Scholar 

  24. Liu Y, Zheng Y, Liang Y, Liu S, Rosenblum DS (2016) Urban water quality prediction based on multi-task multi-view learning. In: Proceedings of the international joint conference on artificial intelligence. IJCAI, pp 2576–2582

  25. Lu Y, Wei Y, Liu L, Zhong J, Sun L, Liu Y (2017) Towards unsupervised physical activity recognition using smartphone accelerometers. Multimedia Tools and Applications 76(8):10701–10719

    Article  Google Scholar 

  26. Markuš N, Frljak M, Pandžić IS, Ahlberg J, Forchheimer R (2014) Eye pupil localization with an ensemble of randomized trees. Pattern Recogn 47(2):578–587

    Article  Google Scholar 

  27. Newman R, Matsumoto Y, Rougeaux S, Zelinsky A (2000) Real-time stereo tracking for head pose and gaze estimation. In: 4th IEEE international conference on automatic face and gesture recognition, pp 122–128

  28. Taghizadeh M, Mahzoun MR (2011) Bidirectional image thresholding algorithm using combined edge detection and P-tile algorithms. J Math Comput Sci 2(2):255–261

    Article  Google Scholar 

  29. Talking Face Video. http://www-prima.inrialpes.fr/FGnet/data/01-TalkingFace/talking_face.html. Accessed 2017

  30. Thévenaz P, Unser M (2008) Snakuscules. IEEE Trans Image Process 17 (4):585–593

    Article  MathSciNet  Google Scholar 

  31. Valenti R, Gevers T (2012) Accurate eye center location through invariant isocentric patterns. IEEE Trans Pattern Anal Mach Intell 34(9):1785–1798

    Article  Google Scholar 

  32. Venkateswarlu R (2003) Eye gaze estimation from a single image of one eye. In: 9th IEEE international conference on computer vision, pp 136–143

  33. Villanueva A, Ponz V, Sesma-Sanchez L, Ariz M, Porta S, Cabeza R (2013) Hybrid method based on topography for robust detection of iris center and eye corners. ACM Trans Multimed Comput Commun Appl (TOMM) 9(4):25

    Google Scholar 

  34. Viola P, Jones M (2001) Rapid object detection using a boosted cascade of simple features. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR) 1:I–I

    Google Scholar 

  35. Wojciechowski A, Fornalczyk K (2015) Single web camera robust interactive eye-gaze tracking method. Polska Akademia Nauk. Bull Acad Pol Sci 63(4):879

    Google Scholar 

  36. Xie X, Livermore C (2016) A pivot-hinged, multilayer SU-8 micro motion amplifier assembled by a self-aligned approach. In: Micro electro mechanical systems (MEMS) of IEEE international conference, pp 75–78

  37. Xie X, Livermore C (2017) Passively self-aligned assembly of compact barrel hinges for high-performance, out-of-plane mems actuators. In: Micro electro mechanical systems (MEMS) of IEEE international conference, pp 813–816

  38. Xie X, Zaitsev Y, Velásquez-García LF, Teller SJ, Livermore C (2014) Scalable, MEMS-enabled, vibrational tactile actuators for high resolution tactile displays. J Micromech Microeng 24(12):125014

    Article  Google Scholar 

  39. Xie X, Zaitsev Y, Velasquez-Garcia L, Teller S, Livermore C (2014) Compact, scalable, high-resolution, MEMS-enabled tactile displays. In: Proceedings of solid-state sensors, actuators, and microsystems workshop, pp 127–130

  40. Zhang W, Zhang TN, Chang SJ (2011) Eye gaze estimation from the elliptical features of one iris. Opt Eng 50(4):047003–047003-9

    Google Scholar 

  41. Zhang C, Sun X, Hu J, Deng W, Beauseroy P (2014) Precise eye localization by fast local linear SVM. In: IEEE international conference on multimedia and expo (ICME), pp 1–6

  42. Zhang W, Smith ML, Smith LN, Farooq A (2016) Eye center localization and gaze gesture recognition for human-computer interaction. JOSA A 33(3):314–325

    Article  Google Scholar 

  43. Zhao Y, Qu Z, Han H, Yuan L (2016) An effective and rapid localization algorithm of pupil center based on Starburst model. In: Advanced information management, communicates, electronic and automation control conference (IMCEC), pp 988–991

  44. Zhou M, Wang X, Wang H, Nam D (2015) Precise eye localization with improved sdm. In: IEEE international conference on image processing (ICIP), pp 4466–4470

Download references

Author information

Authors and Affiliations

  1. Institute of VLSI Design, Zhejiang University, Hangzhou, 310027, China

    Feng Xiao, Kejie Huang, Yue Qiu & Haibin Shen

Authors
  1. Feng Xiao
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Kejie Huang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yue Qiu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Haibin Shen
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Kejie Huang.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Xiao, F., Huang, K., Qiu, Y. et al. Accurate iris center localization method using facial landmark, snakuscule, circle fitting and binary connected component. Multimed Tools Appl 77, 25333–25353 (2018). https://doi.org/10.1007/s11042-018-5787-x

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-018-5787-x

Keywords

Search

Navigation