research-article

TraQuMe: a tool for measuring the gaze tracking quality

Authors:

Roope RaisamoAuthors Info & Claims

ETRA '14: Proceedings of the Symposium on Eye Tracking Research and Applications

Pages 327 - 330

https://doi.org/10.1145/2578153.2578192

Published: 26 March 2014 Publication History

Get Access

Abstract

Consistent measuring and reporting of gaze data quality is important in research that involves eye trackers. We have developed TraQuMe: a generic system to evaluate the gaze data quality. The quality measurement is fast and the interpretation of the results is aided by graphical output. Numeric data is saved for reporting of aggregate metrics for the whole experiment. We tested TraQuMe in the context of a novel hidden calibration procedure that we developed to aid in experiments where participants should not know that their gaze is being tracked. The quality of tracking data after the hidden calibration procedure was very close to that obtained with the Tobii's T60 trackers built-in 2 point, 5 point and 9 point calibrations.

References

[1]

Bates, R. and Spakov, O. (2006) D2.3 Implementation of COGAIN Gaze Tracking Standards. COGAIN, IST-2003-511598: Deliverable 2.3. Retrieved from http://wiki.cogain.org/

Google Scholar

[2]

Blignaut, P, and Beelders, T. "TrackStick: a data quality measuring tool for Tobii eye trackers." Proceedings of the Symposium on Eye Tracking Research and Applications. ACM, 2012.

Digital Library

Google Scholar

[3]

Holmqvist, K., Nyström, M., and Mulveyz, F. 2012. Eye tracker data quality: what it is and how to measure it. ETRA'12, 45--52.

Digital Library

Google Scholar

[4]

Hornof, A. J., and Halverson, T. Cleaning up systematic error in eye-tracking data by using required fixation locations. Behavior Research Methods, Instruments, & Computers 34, no. 4 (2002): 592--604.

Google Scholar

[5]

Morgante, J,D., Zolfaghari, R., and Johnson, S. P. 2012. A Critical Test of Temporal and Spatial Accuracy of the Tobii T60XL Eye Tracker. Infancy, 17, 1, 9--32.

Crossref

Google Scholar

[6]

Nyström, M., Andersson, R., Holmqvist, K., and van de Weijer, J. 2013. The influence of calibration method and eye physiology on eyetracking data quality. Behavior Research Methods, 45, 1, 272--288.

Crossref

Google Scholar

[7]

SMI 2012, Sensometric instruments iView X#8482; SDK 3.0 manual. Retrieved from http://www.smivision.com.

Google Scholar

[8]

Smith, B. A., Ho, J., Ark, W., and Zhai, S. "Hand eye coordination patterns in target selection." In Proceedings of the 2000 symposium on Eye tracking research & applications, pp. 117--122. ACM, 2000.

Digital Library

Google Scholar

[9]

Tobii Technology 2011. Accuracy and Precision Test Method for Remote Eyetrackers, rev. 2.1.1, 7 February 2011. Tobii Technology AB. Retrieved from http://www.tobii.com.

Google Scholar

Cited By

View all

Zhu HJin XLiao HXiang YEl-Yacoubi MQin H(2025)Relax DARTS: Relaxing the Constraints of Differentiable Architecture Search for Eye Movement RecognitionBiometric Recognition10.1007/978-981-96-1071-6_11(112-122)Online publication date: 8-Feb-2025
https://doi.org/10.1007/978-981-96-1071-6_11
Sidenmark LLystbæk MGellersen H(2023)GE-Simulator: An Open-Source Tool for Simulating Real-Time Errors for HMD-based Eye TrackersProceedings of the 2023 Symposium on Eye Tracking Research and Applications10.1145/3588015.3588417(1-6)Online publication date: 30-May-2023
https://dl.acm.org/doi/10.1145/3588015.3588417
Holmqvist KÖrbom SHooge INiehorster DAlexander RAndersson RBenjamins JBlignaut PBrouwer AChuang LDalrymple KDrieghe DDunn MEttinger UFiedler SFoulsham Tvan der Geest JHansen DHutton SKasneci EKingstone AKnox PKok ELee HLee JLeppänen JMacknik SMajaranta PMartinez-Conde SNuthmann ANyström MOrquin JOtero-Millan JPark SPopelka SProudlock FRenkewitz FRoorda ASchulte-Mecklenbeck MSharif BShic FShovman MThomas MVenrooij WZemblys RHessels R(2022)RETRACTED ARTICLE: Eye tracking: empirical foundations for a minimal reporting guidelineBehavior Research Methods10.3758/s13428-021-01762-855:1(364-416)Online publication date: 6-Apr-2022
https://doi.org/10.3758/s13428-021-01762-8
Show More Cited By

Index Terms

TraQuMe: a tool for measuring the gaze tracking quality
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods

Recommendations

Interacting with objects in the environment using gaze tracking glasses and speech
OzCHI '14: Proceedings of the 26th Australian Computer-Human Interaction Conference on Designing Futures: the Future of Design

This work explores the combination of gaze and speech to interact with objects in the environment. A head-mounted wireless gaze tracker in the form of gaze tracking glasses is used for mobile monitoring of a subject's point of regard on the surrounding ...
Vibrotactile stimulation of the head enables faster gaze gestures

Gaze gestures are a promising input technology for wearable devices especially in the smart glasses form factor because gaze gesturing is unobtrusive and leaves the hands free for other tasks. We were interested in how gaze gestures can be enhanced with ...
eyeCan: affordable and versatile gaze interaction
UIST '13 Adjunct: Adjunct Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology

We present eyeCan, a software system that promises rich, sophisticated, and still usable gaze interactions with low-cost gaze tracking setups. The creation of this practical system was to drastically lower the hurdle of gaze interaction by presenting ...

Comments

Information & Contributors

Information

Published In

ETRA '14: Proceedings of the Symposium on Eye Tracking Research and Applications

March 2014

394 pages

ISBN:9781450327510

DOI:10.1145/2578153

Conference Chairs:
Pernilla Qvarfordt
FX Palo Alto Laboratory
,
Dan Witzner Hansen
IT University, Denmark

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 March 2014

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Suomen Akatemia

Conference

ETRA '14

Sponsor:

ETRA '14: Eye Tracking Research and Applications

March 26 - 28, 2014

Florida, Safety Harbor

Acceptance Rates

Overall Acceptance Rate 69 of 137 submissions, 50%

Upcoming Conference

ETRA '25

Sponsor:
sigchi
sigchi

2025 Symposium on Eye Tracking Research and Applications

May 26 - 29, 2025

Tokyo , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

13
Total Citations
View Citations
469
Total Downloads

Downloads (Last 12 months)16
Downloads (Last 6 weeks)2

Reflects downloads up to 27 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Zhu HJin XLiao HXiang YEl-Yacoubi MQin H(2025)Relax DARTS: Relaxing the Constraints of Differentiable Architecture Search for Eye Movement RecognitionBiometric Recognition10.1007/978-981-96-1071-6_11(112-122)Online publication date: 8-Feb-2025
https://doi.org/10.1007/978-981-96-1071-6_11
Sidenmark LLystbæk MGellersen H(2023)GE-Simulator: An Open-Source Tool for Simulating Real-Time Errors for HMD-based Eye TrackersProceedings of the 2023 Symposium on Eye Tracking Research and Applications10.1145/3588015.3588417(1-6)Online publication date: 30-May-2023
https://dl.acm.org/doi/10.1145/3588015.3588417
Holmqvist KÖrbom SHooge INiehorster DAlexander RAndersson RBenjamins JBlignaut PBrouwer AChuang LDalrymple KDrieghe DDunn MEttinger UFiedler SFoulsham Tvan der Geest JHansen DHutton SKasneci EKingstone AKnox PKok ELee HLee JLeppänen JMacknik SMajaranta PMartinez-Conde SNuthmann ANyström MOrquin JOtero-Millan JPark SPopelka SProudlock FRenkewitz FRoorda ASchulte-Mecklenbeck MSharif BShic FShovman MThomas MVenrooij WZemblys RHessels R(2022)RETRACTED ARTICLE: Eye tracking: empirical foundations for a minimal reporting guidelineBehavior Research Methods10.3758/s13428-021-01762-855:1(364-416)Online publication date: 6-Apr-2022
https://doi.org/10.3758/s13428-021-01762-8
Räihä K(2022)Life in the Fast Lane: Effect of Language and Calibration Accuracy on the Speed of Text Entry by GazeHuman-Computer Interaction – INTERACT 201510.1007/978-3-319-22701-6_30(402-417)Online publication date: 10-Mar-2022
https://dl.acm.org/doi/10.1007/978-3-319-22701-6_30
Kangas JKoskinen ORaisamo RTruong KHeylen DCzerwinski MBerthouze NChetouani MNakano M(2020)Gaze Tracker Accuracy and Precision Measurements in Virtual Reality HeadsetsProceedings of the 2020 International Conference on Multimodal Interaction10.1145/3382507.3418816(640-644)Online publication date: 21-Oct-2020
https://dl.acm.org/doi/10.1145/3382507.3418816
B. Adhanom ILee SFolmer EMacNeilage P(2020)GazeMetrics: An Open-Source Tool for Measuring the Data Quality of HMD-based Eye TrackersACM Symposium on Eye Tracking Research and Applications10.1145/3379156.3391374(1-5)Online publication date: 2-Jun-2020
https://dl.acm.org/doi/10.1145/3379156.3391374
Katrychuk DGriffith HKomogortsev O(2020)A Calibration Framework for Photosensor-based Eye-Tracking SystemACM Symposium on Eye Tracking Research and Applications10.1145/3379156.3391370(1-5)Online publication date: 2-Jun-2020
https://dl.acm.org/doi/10.1145/3379156.3391370
Li ZAkkil DRaisamo R(2019)Gaze Augmented Hand-Based Kinesthetic Interaction: What You See is What You FeelIEEE Transactions on Haptics10.1109/TOH.2019.289602712:2(114-127)Online publication date: 1-Apr-2019
https://doi.org/10.1109/TOH.2019.2896027
Akkil DThankachan BIsokoski PSharif BKrejtz K(2018)I see what you seeProceedings of the 2018 ACM Symposium on Eye Tracking Research & Applications10.1145/3204493.3204542(1-9)Online publication date: 14-Jun-2018
https://dl.acm.org/doi/10.1145/3204493.3204542
Gizatdinova YŠpakov OTuisku OTurk MSurakka VSharif BKrejtz K(2018)Gaze and head pointing for hands-free text entryProceedings of the 2018 ACM Symposium on Eye Tracking Research & Applications10.1145/3204493.3204539(1-9)Online publication date: 14-Jun-2018
https://dl.acm.org/doi/10.1145/3204493.3204539
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Interacting with objects in the environment using gaze tracking glasses and speech

Vibrotactile stimulation of the head enables faster gaze gestures

eyeCan: affordable and versatile gaze interaction

Comments

Information

Published In

Sponsors

Publisher

Publication History

Check for updates

Author Tags

Qualifiers

Funding Sources

Conference

Acceptance Rates

Upcoming Conference

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations