short-paper

Gaze Tracker Accuracy and Precision Measurements in Virtual Reality Headsets

Authors:

Jari Kangas,

Olli Koskinen,

Roope RaisamoAuthors Info & Claims

ICMI '20: Proceedings of the 2020 International Conference on Multimodal Interaction

Pages 640 - 644

https://doi.org/10.1145/3382507.3418816

Published: 22 October 2020 Publication History

Get Access

Abstract

To effectively utilize a gaze tracker in user interaction it is important to know the quality of the gaze data that it is measuring. We have developed a method to evaluate the accuracy and precision of gaze trackers in virtual reality headsets. The method consists of two software components. The first component is a simulation software that calibrates the gaze tracker and then performs data collection by providing a gaze target that moves around the headset's field-of-view. The second component makes an off-line analysis of the logged gaze data and provides a number of measurement results of the accuracy and precision. The analysis results consist of the accuracy and precision of the gaze tracker in different directions inside the virtual 3D space. Our method combines the measurements into overall accuracy and precision. Visualizations of the measurements are created to see possible trends over the display area. Results from selected areas in the display are analyzed to find out differences between the areas (for example, the middle/outer edge of the display or the upper/lower part of display).

Supplementary Material

MP4 File (3382507.3418816.mp4)

The presentation video first gives a short reasoning for the work and then goes through the main components of the software that was developed. The main reason for developing the software was to be able to check the gaze tracker accuracy flexibly in different virtual reality devices to assist in application development. The software consists of two components, the first component collects gaze data and the second component analyzes the data giving various visualizations and quantitative descriptors. The software is publicly available on a GitHub page.

Download
5.60 MB

References

[1]

Deepak Akkil, Poika Isokoski, Jari Kangas, Jussi Rantala, and Roope Raisamo. 2014. TraQuMe: a tool for measuring the gaze tracking quality. In Proceedings of the Symposium on Eye Tracking Research and Applications. ACM, 327--330.

Digital Library

Google Scholar

[2]

Isayas B. Adhanom, Samantha C. Lee, Eelke Folmer, and Paul MacNeilage. 2020. GazeMetrics: An Open-Source Tool for Measuring the Data Quality of HMDBased Eye Trackers. In ACM Symposium on Eye Tracking Research and Applications (ETRA '20 Short Papers). Association for Computing Machinery, New York, NY, USA, Article 19, 5 pages. https://doi.org/10.1145/3379156.3391374

Crossref

Google Scholar

[3]

Pieter Blignaut and Tanya Beelders. 2012. TrackStick: A Data Quality Measuring Tool for Tobii Eye Trackers. In Proceedings of the Symposium on Eye Tracking Research and Applications (ETRA '12). ACM, New York, NY, USA, 293--296. https: //doi.org/10.1145/2168556.2168619

Digital Library

Google Scholar

[4]

Alasdair DF Clarke and Benjamin W Tatler. 2014. Deriving an appropriate baseline for describing fixation behaviour. Vision research 102 (2014), 41--51.

Google Scholar

[5]

Kenneth Holmqvist, Marcus Nyström, and Fiona Mulvey. 2012. Eye tracker data quality: what it is and how to measure it. In Proceedings of the symposium on eye tracking research and applications. ACM, 45--52.

Digital Library

Google Scholar

[6]

Dillon J Lohr, Lee Friedman, and Oleg V Komogortsev. 2019. Evaluating the Data Quality of Eye Tracking Signals from a Virtual Reality System: Case Study using SMI's Eye-Tracking HTC Vive. arXiv preprint arXiv:1912.02083 (2019).

Google Scholar

[7]

Marcus Nyström, Richard Andersson, Kenneth Holmqvist, and Joost Van De Weijer. 2013. The influence of calibration method and eye physiology on eyetracking data quality. Behavior research methods 45, 1 (2013), 272--288.

Google Scholar

[8]

VR Gaze tracker. 2020. VR Gaze tracker evaluation software. https://github.com/ KangasTUNI/VRGazeTrackerEvaluation

Google Scholar

[9]

Unity. 2020. Unity Real-Time Development Platform. https://unity.com/

Google Scholar

[10]

HTC VIVE. 2019. The New VIVE Pro With Precision Eye Tracking. https://www.vive.com/eu/pro-eye/

Google Scholar

Cited By

View all

Holmqvist KÖrbom SHooge INiehorster DAlexander RAndersson RBenjamins JBlignaut PBrouwer AChuang LDalrymple KDrieghe DDunn MEttinger UFiedler SFoulsham Tvan der Geest JHansen DHutton SKasneci EKingstone AKnox PKok ELee HLee JLeppänen JMacknik SMajaranta PMartinez-Conde SNuthmann ANyström MOrquin JOtero-Millan JPark SPopelka SProudlock FRenkewitz FRoorda ASchulte-Mecklenbeck MSharif BShic FShovman MThomas MVenrooij WZemblys RHessels R(2022)RETRACTED ARTICLE: Eye tracking: empirical foundations for a minimal reporting guidelineBehavior Research Methods10.3758/s13428-021-01762-855:1(364-416)Online publication date: 6-Apr-2022
https://doi.org/10.3758/s13428-021-01762-8
Anwar SAziz AAdil S(2021)Development of Real-Time Eye Tracking Algorithm2021 4th International Conference on Computing & Information Sciences (ICCIS)10.1109/ICCIS54243.2021.9676406(1-6)Online publication date: 29-Nov-2021
https://doi.org/10.1109/ICCIS54243.2021.9676406

Index Terms

Gaze Tracker Accuracy and Precision Measurements in Virtual Reality Headsets
1. Human-centered computing

Recommendations

The Eye in Extended Reality: A Survey on Gaze Interaction and Eye Tracking in Head-worn Extended Reality
With innovations in the field of gaze and eye tracking, a new concentration of research in the area of gaze-tracked systems and user interfaces has formed in the field of Extended Reality (XR). Eye trackers are being used to explore novel forms of spatial ...
Snap, Pursuit and Gain: Virtual Reality Viewport Control by Gaze
CHI '24: Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems

Head-mounted displays let users explore virtual environments through a viewport that is coupled with head movement. In this work, we investigate gaze as an alternative modality for viewport control, enabling exploration of virtual worlds with less head ...
Comparison of gaze accuracy and precision in real-world and virtual reality
Abstract
Virtual reality (VR) is popular across many fields and is increasingly used in sports as a training tool. The reason, therefore, is recently improved display technologies, more powerful computation capacity, and lower costs of head-mounted ...

Comments

Information & Contributors

Information

Published In

ICMI '20: Proceedings of the 2020 International Conference on Multimodal Interaction

October 2020

920 pages

ISBN:9781450375818

DOI:10.1145/3382507

General Chairs:
Khiet Truong
University of Twente, the Netherlands
,
Dirk Heylen
University of Twente, the Netherlands
,
Mary Czerwinski
Microsoft Research, USA
,
Program Chairs:
Nadia Berthouze
University College London, United Kingdom
,
Mohamed Chetouani
Sorbonne University, France
,
Mikio Nakano
C4A Research Institute, Japan

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 October 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Funding Sources

Business Finland

Conference

ICMI '20

Sponsor:

SIGCHI

ICMI '20: INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION

October 25 - 29, 2020

Virtual Event, Netherlands

Acceptance Rates

Overall Acceptance Rate 453 of 1,080 submissions, 42%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
240
Total Downloads

Downloads (Last 12 months)22
Downloads (Last 6 weeks)0

Reflects downloads up to 27 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Holmqvist KÖrbom SHooge INiehorster DAlexander RAndersson RBenjamins JBlignaut PBrouwer AChuang LDalrymple KDrieghe DDunn MEttinger UFiedler SFoulsham Tvan der Geest JHansen DHutton SKasneci EKingstone AKnox PKok ELee HLee JLeppänen JMacknik SMajaranta PMartinez-Conde SNuthmann ANyström MOrquin JOtero-Millan JPark SPopelka SProudlock FRenkewitz FRoorda ASchulte-Mecklenbeck MSharif BShic FShovman MThomas MVenrooij WZemblys RHessels R(2022)RETRACTED ARTICLE: Eye tracking: empirical foundations for a minimal reporting guidelineBehavior Research Methods10.3758/s13428-021-01762-855:1(364-416)Online publication date: 6-Apr-2022
https://doi.org/10.3758/s13428-021-01762-8
Anwar SAziz AAdil S(2021)Development of Real-Time Eye Tracking Algorithm2021 4th International Conference on Computing & Information Sciences (ICCIS)10.1109/ICCIS54243.2021.9676406(1-6)Online publication date: 29-Nov-2021
https://doi.org/10.1109/ICCIS54243.2021.9676406

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

Supplementary Material

References

Cited By

Index Terms

Recommendations

The Eye in Extended Reality: A Survey on Gaze Interaction and Eye Tracking in Head-worn Extended Reality

Snap, Pursuit and Gain: Virtual Reality Viewport Control by Gaze

Comparison of gaze accuracy and precision in real-world and virtual reality

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Funding Sources

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations