short-paper

Estimating Point-of-Gaze using Smooth Pursuit Eye Movements without Implicit and Explicit User-Calibration

Authors:

Kentaro TakemuraAuthors Info & Claims

ETRA '20 Short Papers: ACM Symposium on Eye Tracking Research and Applications

Article No.: 3, Pages 1 - 4

https://doi.org/10.1145/3379156.3391343

Published: 02 June 2020 Publication History

Abstract

Detecting the point-of-gaze in the real world is a challenging problem in eye-tracking applications. The point-of-gaze is estimated using geometry constraints, and user-calibration is required. In addition, the distances of the focused targets are variable and large in the real world. Therefore, a calibration-free approach without geometry constraints is needed to estimate the point-of-gaze. Recent studies have investigated smooth pursuit eye movements (smooth pursuits) for human-computer interaction applications, and we consider that these smooth pursuits can also be employed in eye tracking. Therefore, we developed a method for estimating the point-of-gaze using smooth pursuits without any requirement for implicit and explicit user-calibration. In this method, interest points are extracted from the scene image, and the point-of-gaze is detected using these points, which are strongly correlated with eye movements. We performed a comparative experiment in a real environment and demonstrated the feasibility of the proposed method.

References

[1]

Yasmeen Abdrabou, Mariam Mostafa, Mohamed Khamis, and Amr Elmougy. 2019. Calibration-free text entry using smooth pursuit eye movements. In Proceedings of the 11th ACM Symposium on Eye Tracking Research & Applications. ACM, 35.

Digital Library

[2]

Marcel Breitenfellner, Florian Jungwirth, and Alois Ferscha. 2019. Towards 3D smooth pursuit interaction. In Adjunct Proceedings of the 2019 ACM International Joint Conference on Pervasive and Ubiquitous Computing In Proceedings of the 2019 ACM International Symposium on Wearable Computers. 619–623.

Digital Library

[3]

Heiko Drewes, Ken Pfeuffer, and Florian Alt. 2019. Time-and Space-efficient Eye Tracker Calibration. In Proceedings of the 11th ACM Symposium on Eye Tracking Research & Applications. ACM, 7.

Digital Library

[4]

Augusto Esteves, Eduardo Velloso, Andreas Bulling, and Hans Gellersen. 2015. Orbits: Gaze interaction for smart watches using smooth pursuit eye movements. In UIST 2015 - Proceedings of the 28th Annual ACM Symposium on User Interface Software and Technology. https://doi.org/10.1145/2807442.2807499

Digital Library

[5]

Augusto Esteves, David Verweij, Liza Suraiya, Rasel Islam, Youryang Lee, and Ian Oakley. 2017. SmoothMoves: Smooth pursuits head movements for augmented reality. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology. ACM, 167–178.

Digital Library

[6]

Kaiming He, Georgia Gkioxari, Piotr Dollár, and Ross Girshick. 2017. Mask r-cnn. In Proceedings of the IEEE international conference on computer vision. 2961–2969.

[7]

Mohamed Khamis, Carl Oechsner, Florian Alt, and Andreas Bulling. 2018. VRPursuits: Interaction in virtual reality using smooth pursuit eye movements. In Proceedings of the Workshop on Advanced Visual Interfaces AVI. https://doi.org/10.1145/3206505.3206522

Digital Library

[8]

Mohamed Khamis, Ozan Saltuk, Alina Hang, Katharina Stolz, Andreas Bulling, and Florian Alt. 2016. TextPursuits: Using Text for Pursuits-based Interaction and Calibration on Public Displays. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing(UbiComp ’16). 274–285. https://doi.org/10.1145/2971648.2971679

Digital Library

[9]

Michaela Murauer, Michael Haslgrübler, and Alois Ferscha. 2018. Natural Pursuits for Eye Tracker Calibration. In Proceedings of the 5th international Workshop on Sensor-based Activity Recognition and Interaction. ACM, 3.

Digital Library

[10]

Takashi Nagamatsu, Junzo Kamahara, and Naoki Tanaka. 2009. Calibration-free gaze tracking using a binocular 3D eye model. In Conference on Human Factors in Computing Systems - Proceedings. https://doi.org/10.1145/1520340.1520543

Digital Library

[11]

Ken Pfeuffer, Melodie Vidal, Jayson Turner, Andreas Bulling, and Hans Gellersen. 2013. Pursuit Calibration: Making Gaze Calibration Less Tedious and More Flexible. In Proceedings of the 26th annual ACM symposium on User interface software and technology - UIST ’13. 261–270. https://doi.org/10.1145/2501988.2501998

Digital Library

[12]

Sheng Wen Shih, Yu Te Wu, and Jin Liu. 2000. A calibration-free gaze tracking technique. Proceedings - International Conference on Pattern Recognition (2000). https://doi.org/10.1109/icpr.2000.902895

[13]

Yusuke Sugano, Yasuyuki Matsushita, and Yoichi Sato. 2010. Calibration-free gaze sensing using saliency maps. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. https://doi.org/10.1109/CVPR.2010.5539984

[14]

Yuto Tamura and Kentaro Takemura. 2019. Estimating Focused Object Using Smooth Pursuit Eye Movements and Interest Points in the Real World. In The Adjunct Publication of the 32Nd Annual ACM Symposium on User Interface Software and Technology(UIST ’19). ACM, New York, NY, USA, 21–23. https://doi.org/10.1145/3332167.3357102

[15]

Mélodie Vidal, Ken Pfeuffer, Andreas Bulling, and Hans W. Gellersen. 2013. Pursuits: Eye-Based Interaction with Moving Targets. In Extended Abstracts on Human Factors in Computing Systems - CHI EA ’13. 3147. https://doi.org/10.1145/2468356.2479632

[16]

Heng Wang, Alexander Kläser, Cordelia Schmid, and Cheng-Lin Liu. 2011. Action Recognition by Dense Trajectories. In IEEE Conference on Computer Vision & Pattern Recognition. Colorado Springs, United States, 3169–3176. http://hal.inria.fr/inria-00583818/en

Digital Library

Cited By

Cocha Toabanda EErazo MYoo S(2023)Gaze Tracking: A Survey of Devices, Libraries and ApplicationsModelling and Development of Intelligent Systems10.1007/978-3-031-27034-5_2(18-41)Online publication date: 26-Feb-2023
https://doi.org/10.1007/978-3-031-27034-5_2
Ito YTakemura K(2021)Estimating Focused Pedestrian using Smooth-Pursuits Eye Movements and Point Cloud toward Assistive System for Wheelchair2021 IEEE International Conference on Systems, Man, and Cybernetics (SMC)10.1109/SMC52423.2021.9659153(404-410)Online publication date: 17-Oct-2021
https://doi.org/10.1109/SMC52423.2021.9659153

Estimating Point-of-Gaze using Smooth Pursuit Eye Movements without Implicit and Explicit User-Calibration
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision

Recommendations

Estimating Focused Object using Smooth Pursuit Eye Movements and Interest Points in the Real World
UIST '19 Adjunct: Adjunct Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology

User calibration is a significant problem in eye-based interaction. To overcome this, several solutions, such as the calibration-free method and implicit user calibration, have been proposed. Pursuits-based interaction is another such solution that has ...
Pursuit calibration: making gaze calibration less tedious and more flexible
UIST '13: Proceedings of the 26th annual ACM symposium on User interface software and technology

Eye gaze is a compelling interaction modality but requires user calibration before interaction can commence. State of the art procedures require the user to fixate on a succession of calibration markers, a task that is often experienced as difficult and ...
A Probabilistic Approach to Online Eye Gaze Tracking Without Explicit Personal Calibration
Existing eye gaze tracking systems typically require an explicit personal calibration process in order to estimate certain person-specific eye parameters. For natural human computer interaction, such a personal calibration is often inconvenient and ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ETRA '20 Short Papers: ACM Symposium on Eye Tracking Research and Applications

June 2020

305 pages

ISBN:9781450371346

DOI:10.1145/3379156

Editors:
Andreas Bulling
University of Stuttgart, Germany
,
Anke Huckauf
Ulm University, Germany
,
Eakta Jain
University of Florida, USA
,
Ralph Radach
University of Wuppertal, Germany
,
Daniel Weiskopf
University of Stuttgart, Germany

Copyright © 2020 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 June 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper
Research
Refereed limited

Conference

ETRA '20

Sponsor:

ETRA '20: 2020 Symposium on Eye Tracking Research and Applications

June 2 - 5, 2020

Stuttgart, Germany

Acceptance Rates

Overall Acceptance Rate 69 of 137 submissions, 50%

Upcoming Conference

ETRA '25

Sponsor:
sigchi
sigchi

2025 Symposium on Eye Tracking Research and Applications

May 26 - 29, 2025

Tokyo , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
299
Total Downloads

Downloads (Last 12 months)30
Downloads (Last 6 weeks)1

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Cocha Toabanda EErazo MYoo S(2023)Gaze Tracking: A Survey of Devices, Libraries and ApplicationsModelling and Development of Intelligent Systems10.1007/978-3-031-27034-5_2(18-41)Online publication date: 26-Feb-2023
https://doi.org/10.1007/978-3-031-27034-5_2
Ito YTakemura K(2021)Estimating Focused Pedestrian using Smooth-Pursuits Eye Movements and Point Cloud toward Assistive System for Wheelchair2021 IEEE International Conference on Systems, Man, and Cybernetics (SMC)10.1109/SMC52423.2021.9659153(404-410)Online publication date: 17-Oct-2021
https://doi.org/10.1109/SMC52423.2021.9659153

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Figures

Tables

Media

View Table of Conten