Skip to main content
SpringerLink
Log in

Device-Adaptive 2D Gaze Estimation: A Multi-Point Differential Framework

  • Conference paper
  • First Online:
Image and Graphics (ICIG 2021)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 12889))

Included in the following conference series:

Abstract

Eye tracking system on mobile devices is important for many interactive applications. However, since models are usually customized with limited types of devices and new devices have totally different physical parameters, it is hard to generalize over unseen devices. In this paper, we present a device-adaptive 2D gaze estimation algorithm based on differential prediction. We reformulate the gaze estimation as a relative position prediction problem between the input image and calibration images, which skips the estimation for camera parameters and makes models easily generalize over devices. To tackle the new challenge, this work proposes a framework which jointly trains a differential prediction module and an aggregation module for ensembling the predictions from multiple calibration points. Experiments show that the framework outperforms baseline models constantly on open datasets with only 3–5 calibration points.

Supported by National Natural Science Foundation of China(No.U20B2062); Beijing Municipal Science and Technology Project(No.Z191100007419001).

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 99.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 129.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Brousseau, B., Rose, J., Eizenman, M.: Accurate model-based point of gaze estimation on mobile devices. Vision 2(3), 35 (2018)

    Google Scholar 

  2. Chen, J., Ji, Q.: 3D gaze estimation with a single camera without ir illumination. In: 2008 19th International Conference on Pattern Recognition, pp. 1–4 (2008)

    Google Scholar 

  3. Chen, J., Ji, Q.: Probabilistic gaze estimation without active personal calibration. In: 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 609–616 (2011)

    Google Scholar 

  4. Cheng, Y., Lu, F., Zhang, X.: Appearance-based gaze estimation via evaluation-guided asymmetric regression. In: Proceedings of the European Conference on Computer Vision (ECCV), pp. 100–115 (2018)

    Google Scholar 

  5. Deng, H., Zhu, W.: Monocular free-head 3D gaze tracking with deep learning and geometry constraints. In: 2017 IEEE International Conference on Computer Vision (ICCV), pp. 3162–3171 (2017)

    Google Scholar 

  6. Guestrin, E., Eizenman, M.: General theory of remote gaze estimation using the pupil center and corneal reflections. Biomed. Eng. IEEE Trans. 53, 1124–1133 (2006)

    Google Scholar 

  7. Guo, T., et al.: A generalized and robust method towards practical gaze estimation on smart phone. International Conference on Computer Vision Workshop, ICCVW 2019 (2019)

    Google Scholar 

  8. He, J., et al.: On-device few-shot personalization for real-time gaze estimation. In: International Conference on Computer Vision Workshop, ICCVW 2019, pp. 1149–1158 (2019)

    Google Scholar 

  9. Holzman, P.: Eye-tracking dysfunctions in schizophrenic patients and their relatives. Arch. General Psychiatry 31, 143 (1974)

    Google Scholar 

  10. Huang, Q., Veeraraghavan, A., Sabharwal, A.: Tabletgaze: dataset and analysis for unconstrained appearance-based gaze estimation in mobile tablets. Mach. Vis. Appl. 28(5–6), 445–461 (2017)

    Article  Google Scholar 

  11. Jacob, R.J., Karn, K.S.: Eye tracking in human-computer interaction and usability research: ready to deliver the promises. In: The Mind’s Eye, pp. 573–605. Elsevier (2003)

    Google Scholar 

  12. Kingma, D., Ba, J.: Adam: a method for stochastic optimization. Computer Science (2014)

    Google Scholar 

  13. Krafka, K., et al.: Eye tracking for everyone. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2176–2184 (2016)

    Google Scholar 

  14. Lindén, E., Sjöstrand, J., Proutière, A.: Appearance-based 3d gaze estimation with personal calibration. CoRR abs/1807.00664 (2018)

    Google Scholar 

  15. Liu, G., Yu, Y., Mora, K.A.F., Odobez, J.M.: A differential approach for gaze estimation. IEEE Trans. Pattern Anal. Mach. Intell. 43(3), 1092–1099 (2021)

    Article  Google Scholar 

  16. Ogawa, T., Nakazawa, A., Nishida, T.: Point of gaze estimation using corneal surface reflection and omnidirectional camera image. IEICE Trans. Inform. Syst. 101, 1278–1287 (2018)

    Google Scholar 

  17. Paszke, A., et al.: Pytorch: an imperative style, high-performance deep learning library. In: Wallach, H., Larochelle, H., Beygelzimer, A., d’Alché-Buc, F., Fox, E., Garnett, R. (eds.) Advances in Neural Information Processing Systems, vol. 32, pp. 8024–8035. Curran Associates, Inc. (2019)

    Google Scholar 

  18. Sugano, Y., Matsushita, Y., Sato, Y.: Learning-by-synthesis for appearance-based 3D gaze estimation. In: 2014 IEEE Conference on Computer Vision and Pattern Recognition, pp. 1821–1828 (2014). https://doi.org/10.1109/CVPR.2014.235

  19. Valenti, R., Sebe, N., Gevers, T.: Combining head pose and eye location information for gaze estimation. IEEE Trans. Image Process. 21(2), 802–815 (2012)

    Article  MathSciNet  Google Scholar 

  20. Yu, Y., Liu, G., Odobez, J.: Improving few-shot user-specific gaze adaptation via gaze redirection synthesis. In: 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 11929–11938 (2019)

    Google Scholar 

  21. Zhang, X., Sugano, Y., Fritz, M., Bulling, A.: Appearance-based gaze estimation in the wild. In: 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 4511–4520 (2015)

    Google Scholar 

  22. Zhang, X., Sugano, Y., Fritz, M., Bulling, A.: It’s written all over your face: full-face appearance-based gaze estimation. In: 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 2299–2308 (2017)

    Google Scholar 

  23. Zhang, X., Huang, M.X., Sugano, Y., Bulling, A.: Training person-specific gaze estimators from user interactions with multiple devices. In: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, pp. 1–12. Association for Computing Machinery (2018)

    Google Scholar 

  24. Zhang, X., Sugano, Y., Fritz, M., Bulling, A.: Mpiigaze: real-world dataset and deep appearance-based gaze estimation. IEEE Trans. Pattern Anal. Mach. Intell. 41(1), 162–175 (2017)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Tsinghua University, Beijing, 100084, China

    Runtong Li

  2. University of Science and Technology Beijing, Beijing, 100083, China

    Huimin Ma, Rongquan Wang & Jiawei Ding

Authors
  1. Runtong Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Huimin Ma
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Rongquan Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jiawei Ding
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Huimin Ma .

Editor information

Editors and Affiliations

  1. Peking University, Beijing, China

    Yuxin Peng

  2. Tsinghua University, Beijing, China

    Shi-Min Hu

  3. Tampere University, Tampere, Finland

    Moncef Gabbouj

  4. Zhejiang University, Hangzhou, China

    Kun Zhou

  5. Technion – Israel Institute of Technology, Haifa, Israel

    Michael Elad

  6. Tsinghua University, Beijing, China

    Kun Xu

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Li, R., Ma, H., Wang, R., Ding, J. (2021). Device-Adaptive 2D Gaze Estimation: A Multi-Point Differential Framework. In: Peng, Y., Hu, SM., Gabbouj, M., Zhou, K., Elad, M., Xu, K. (eds) Image and Graphics. ICIG 2021. Lecture Notes in Computer Science(), vol 12889. Springer, Cham. https://doi.org/10.1007/978-3-030-87358-5_39

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-87358-5_39

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-87357-8

  • Online ISBN: 978-3-030-87358-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation