Skip to main content

A Monocular Reflection-Free Head-Mounted 3D Eye Tracking System

  • Conference paper
  • First Online:
Image and Graphics (ICIG 2021)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 12890))

Included in the following conference series:

Abstract

Head-mounted eye tracking has significant potential for gaze baesd application such as consumer attention monitoring, human-computer interaction, or virtual reality (VR). Existing methods, however, either use pupil center-corneal reflection (PCCR) vectors as gaze directions or require complex hardware setups and use average physiological parameters of the eye to obtain gaze directions. In view of this situation, we propose a novel method which uses only a single camera to obtain gaze direction by fitting a 3D eye model based on the motion trajectory of pupil contour. Then a 3D to 2D mapping model is proposed based on the fitting model, so the complex structure of hardware and the use of average parameters for the eyes are avoided. The experimental results show that the method can improve the gaze accuracy and simplify the hardware structure.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 99.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 129.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. van Reijmersdal, E.A., Rozendaal, E., Hudders, L., Vanwesenbeeck, I., Cauberghe, V., van Berlo, Z.M.: Effects of disclosing influencer marketing in videos: an eye tracking study among children in early adolescence. J. Interact. Market. 49, 94–106 (2020)

    Article  Google Scholar 

  2. Steindorf, L., Rummel, J.: Do your eyes give you away? A validation study of eye-movement measures used as indicators for mindless reading. Behav. Res. Methods 52(1), 162–176 (2020)

    Article  Google Scholar 

  3. Bergman, M.A., et al.: Is a negative attentional bias in individuals with autism spectrum disorder explained by comorbid depression? An eye-tracking study. J. Autism Dev. Disord. 1–14 (2021). https://doi.org/10.1007/s10803-021-04880-6

  4. Bozomitu, R.G., Păsărică, A., Tărniceriu, D., Rotariu, C.: Development of an eye tracking-based human-computer interface for real-time applications. Sensors 19(16), 3630 (2019)

    Article  Google Scholar 

  5. Rahal, R.M., Fiedler, S.: Understanding cognitive and affective mechanisms in social psychology through eye-tracking. J. Exp. Soc. Psychol. 85, 103842 (2019)

    Article  Google Scholar 

  6. Matthews, S., Uribe-Quevedo, A., Theodorou, A.: Rendering optimizations for virtual reality using eye-tracking. In: 2020 22nd Symposium on Virtual and Augmented Reality (SVR), pp. 398–405. IEEE (2020)

    Google Scholar 

  7. Pohl, D., Zhang, X., Bulling, A.: Combining eye tracking with optimizations for lens astigmatism in modern wide-angle HMDs. In: 2016 IEEE Virtual Reality (VR), pp. 269–270. IEEE (2016)

    Google Scholar 

  8. Mikhailenko, M., Kurushkin, M.: Eye-tracking in immersive virtual reality for education: a review of the current progress and applications (2021)

    Google Scholar 

  9. Takemura, K., Takahashi, K., Takamatsu, J., Ogasawara, T.: Estimating 3-D point-of-regard in a real environment using a head-mounted eye-tracking system. IEEE Trans. Hum. Mach. Syst. 44(4), 531–536 (2014)

    Article  Google Scholar 

  10. Morimoto, C.H., Mimica, M.R.: Eye gaze tracking techniques for interactive applications. Comput. Vis. Image Underst. 98(1), 4–24 (2005)

    Article  Google Scholar 

  11. Arar, N.M., Gao, H., Thiran, J.P.: Towards convenient calibration for cross-ratio based gaze estimation. In: 2015 IEEE Winter Conference on Applications of Computer Vision, pp. 642–648. IEEE (2015)

    Google Scholar 

  12. Shih, S.W., Liu, J.: A novel approach to 3-D gaze tracking using stereo cameras. IEEE Trans. Syst. Man Cybern. Part B (Cybern.) 34(1), 234–245 (2004)

    Google Scholar 

  13. Urano, R., Suzuki, R., Sasaki, T.: Eye gaze estimation based on ellipse fitting and three-dimensional model of eye for “intelligent poster”. In: 2014 IEEE/ASME International Conference on Advanced Intelligent Mechatronics, pp. 1157–1162. IEEE (2014)

    Google Scholar 

  14. Zhu, Z., Ji, Q.: Novel eye gaze tracking techniques under natural head movement. IEEE Trans. Biomed. Eng. 54(12), 2246–2260 (2007)

    Article  Google Scholar 

  15. Swirski, L., Dodgson, N.: A fully-automatic, temporal approach to single camera, glint-free 3D eye model fitting. In: Proceedings of PETMEI, pp. 1–11 (2013)

    Google Scholar 

  16. Li, Z., Miao, D., Liang, H., Zhang, H., Liu, J., He, Z.: Efficient and accurate iris detection and segmentation based on multi-scale optimized mask R-CNN. In: Zhao, Y., Barnes, N., Chen, B., Westermann, R., Kong, X., Lin, C. (eds.) ICIG 2019. LNCS, vol. 11902, pp. 715–726. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-34110-7_60

    Chapter  Google Scholar 

  17. Świrski, L., Bulling, A., Dodgson, N.: Robust real-time pupil tracking in highly off-axis images. In: Proceedings of the Symposium on Eye Tracking Research and Applications, pp. 173–176 (2012)

    Google Scholar 

  18. Santini, T., Fuhl, W., Kasneci, E.: Pure: robust pupil detection for real-time pervasive eye tracking. Comput. Vis. Image Understand. 170, 40–50 (2018)

    Article  Google Scholar 

  19. Safaee-Rad, R., Tchoukanov, I., Smith, K.C., Benhabib, B.: Three-dimensional location estimation of circular features for machine vision. IEEE Trans. Robot. Autom. 8(5), 624–640 (1992)

    Article  Google Scholar 

  20. Cerrolaza, J.J., Villanueva, A., Villanueva, M., Cabeza, R.: Error characterization and compensation in eye tracking systems. In: Proceedings of the Symposium on Eye Tracking Research and Applications, pp. 205–208 (2012)

    Google Scholar 

  21. Liu, M., Li, Y., Liu, H.: 3D gaze estimation for head-mounted eye tracking system with auto-calibration method. IEEE Access 8, 104207–104215 (2020)

    Article  Google Scholar 

  22. Wen, Q., Bradley, D., Beeler, T., Park, S., Xu, F.: Accurate real-time 3D gaze tracking using a lightweight eyeball calibration. Comput. Graph. Forum 39(2), 475–485 (2020)

    Article  Google Scholar 

Download references

Acknowledgment

This work was supported by the National Natural Science Foundation of China under Grants nos. 61871326, and Ningbo Natural Science Foundation under Grants nos. 202003N4367.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Xinbo Zhao .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Cao, S., Zhao, X., Qin, B., Li, J., Xiang, Z. (2021). A Monocular Reflection-Free Head-Mounted 3D Eye Tracking System. In: Peng, Y., Hu, SM., Gabbouj, M., Zhou, K., Elad, M., Xu, K. (eds) Image and Graphics. ICIG 2021. Lecture Notes in Computer Science(), vol 12890. Springer, Cham. https://doi.org/10.1007/978-3-030-87361-5_54

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-87361-5_54

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-87360-8

  • Online ISBN: 978-3-030-87361-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics