short-paper

A Novel -Eye-Tracking Sensor for AR Glasses Based on Laser Self-Mixing Showing Exceptional Robustness Against Illumination

Authors:

Johannes Meyer,

Thomas Schlebusch,

Jochen Hellmig,

Enkelejda KasneciAuthors Info & Claims

ETRA '20 Short Papers: ACM Symposium on Eye Tracking Research and Applications

Article No.: 31, Pages 1 - 5

https://doi.org/10.1145/3379156.3391352

Published: 02 June 2020 Publication History

Abstract

The integration of eye-tracking sensors in next-generation AR glasses will increase usability and enable new interaction concepts. Consumer AR glasses emphasize however additional requirements to eye-tracking sensors, such as high integratability and robustness to ambient illumination. We propose a novel eye-tracking sensor based on the self-mixing interference (SMI) effect of lasers. In consequence, our sensor as small as a grain of sand shows exceptional robustness against ambient radiation compared to conventional camera-based eye trackers. In this paper, we evaluate ambient light robustness under different illumination conditions for video-based oculography, conventional scanned laser eye tracking as well as the SMI-based sensor.

References

[1]

Andrew T. T. Duchowski. 2017. Eye Tracking Methodology - Theory and Practice (3rd ed. 2017 ed.). Springer International Publishing, Cham, Heidelberg, New York, Dordrecht, London.

[2]

Wolfgang Fuhl, Marc Tonsen, Andreas Bulling, and Enkelejda Kasneci. 2016. Pupil detection for head-mounted eye tracking in the wild: an evaluation of the state of the art. Machine Vision and Applications 27, 8 (01 Nov 2016), 1275–1288. https://doi.org/10.1007/s00138-016-0776-4

[3]

Martin Grabherr, Philipp Gerlach, Roger King, and Roland Jäger. 2009. Integrated photodiodes complement the VCSEL platform. In Vertical-Cavity Surface-Emitting Lasers XIII, Kent D. Choquette and Chun Lei (Eds.), Vol. 7229. International Society for Optics and Photonics, SPIE, 119 – 127. https://doi.org/10.1117/12.808847

[4]

Injoon Hong, Kyeongryeol Bong, and Hoi-Jun Yoo. 2018. Challenges of eye tracking systems for mobile XR glasses. In Applications of Digital Image Processing XLI, Andrew G. Tescher(Ed.), Vol. 10752. International Society for Optics and Photonics, SPIE, 391 – 397. https://doi.org/10.1117/12.2322657

[5]

Changwon Jang, Kiseung Bang, Seokil Moon, Jonghyun Kim, Seungjae Lee, and Byoungho Lee. 2017. Retinal 3D: Augmented Reality Near-eye Display via Pupil-tracked Light Field Projection on Retina. ACM Trans. Graph. 36, 6, Article 190 (Nov. 2017), 13 pages. https://doi.org/10.1145/3130800.3130889

Digital Library

[6]

Jonghyun Kim, Youngmo Jeong, Michael Stengel, Kaan Akşit, Rachel Albert, Ben Boudaoud, Trey Greer, Joohwan Kim, Ward Lopes, Zander Majercik, Peter Shirley, Josef Spjut, Morgan McGuire, and David Luebke. 2019a. Foveated AR: Dynamically-foveated Augmented Reality Display. ACM Trans. Graph. 38, 4, Article 99 (July 2019), 15 pages. https://doi.org/10.1145/3306346.3322987

Digital Library

[7]

Joohwan Kim, Michael Stengel, Alexander Majercik, Shalini De Mello, David Dunn, Samuli Laine, Morgan McGuire, and David Luebke. 2019b. NVGaze: An Anatomically-Informed Dataset for Low-Latency, Near-Eye Gaze Estimation. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). ACM, New York, NY, USA, Article 550, 12 pages. https://doi.org/10.1145/3290605.3300780

Digital Library

[8]

G. A. Koulieris, K. Akşit, M. Stengel, R. K. Mantiuk, K. Mania, and C. Richardt. 2019. Near-Eye Display and Tracking Technologies for Virtual and Augmented Reality. Computer Graphics Forum 38, 2 (2019), 493–519. https://doi.org/10.1111/cgf.13654 arXiv:https://onlinelibrary.wiley.com/doi/pdf/10.1111/cgf.13654

[9]

Andrew Maimone, Andreas Georgiou, and Joel S. Kollin. 2017. Holographic Near-eye Displays for Virtual and Augmented Reality. ACM Trans. Graph. 36, 4, Article 85 (July 2017), 16 pages. https://doi.org/10.1145/3072959.3073624

Digital Library

[10]

Rainer Michalzik. 2013. VCSELs - Fundamentals, Technology and Applications of Vertical-Cavity Surface-Emitting Lasers. Springer Berlin Heidelberg. https://doi.org/10.1007/978-3-642-24986-0

[11]

B. O’Bard and K. George. 2018. Classification of eye gestures using machine learning for use in embedded switch controller. In 2018 IEEE International Instrumentation and Measurement Technology Conference (I2MTC). 1–6. https://doi.org/10.1109/I2MTC.2018.8409769

[12]

Armand Pruijmboom, Marcel Schemmann, Jochen Hellmig, Jeroen Schutte, Holger Moench, and Joseph Pankert. 2008. VCSEL-based miniature laser-Doppler interferometer. In Vertical-Cavity Surface-Emitting Lasers XII, Chun Leiand James K. Guenter (Eds.), Vol. 6908. International Society for Optics and Photonics, SPIE, 157 – 163. https://doi.org/10.1117/12.775131

[13]

Ann Russell. 2019. Osram OS Infrared in AR/VR. online. http://microvision.blogspot.com/2019/10/st-micro-blog-and-osram-powerpoint.html

[14]

Hananeh Salehifar, Peyman Bayat, and Mojtaba Amiri Majd. 2019. Eye gesture blink password: a new authentication system with high memorable and maximum password length. Multimedia Tools and Applications 78, 12 (01 Jun 2019), 16861–16885. https://doi.org/10.1007/s11042-018-7043-9

[15]

N. Sarkar, B. O’Hanlon, A. Rohani, D. Strathearn, G. Lee, M. Olfat, and R. R. Mansour. 2017. A resonant eye-tracking microsystem for velocity estimation of saccades and foveated rendering. In 2017 IEEE 30th International Conference on Micro Electro Mechanical Systems (MEMS). 304–307. https://doi.org/10.1109/MEMSYS.2017.7863402

[16]

N. Sarkar, D. Strathearn, G. Lee, M. Olfat, A. Rohani, and R. R. Mansour. 2015. A large angle, low voltage, small footprint micromirror for eye tracking and near-eye display applications. In 2015 Transducers - 2015 18th International Conference on Solid-State Sensors, Actuators and Microsystems (TRANSDUCERS). 855–858. https://doi.org/10.1109/TRANSDUCERS.2015.7181058

[17]

Yamada Shoji. 2009. Device for tracking pupil of eye ball using intensity changes of reflected light from eyeball and image display using the same. US20070705471.

[18]

Marc von Waldkirch, Paul Lukowicz, and Gerhard Tröster. 2004. Effect of light coherence on depth of focus in head-mounted retinal projection displays. Optical Engineering 43, 7 (2004), 1552 – 1560. https://doi.org/10.1117/1.1748209

[19]

Zhou Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli. 2004. Image quality assessment: from error visibility to structural similarity. IEEE Transactions on Image Processing 13, 4 (April 2004), 600–612. https://doi.org/10.1109/TIP.2003.819861

Digital Library

Cited By

Meyer JGering SKasneci E(2023)Static Laser Feedback Interferometry-Based Gaze Estimation for Wearable GlassesIEEE Sensors Journal10.1109/JSEN.2023.325071423:7(7558-7569)Online publication date: 1-Apr-2023
https://doi.org/10.1109/JSEN.2023.3250714
Meyer JFrank ASchlebusch TKasneci E(2022)U-HARProceedings of the ACM on Human-Computer Interaction10.1145/35308846:ETRA(1-19)Online publication date: 13-May-2022
https://dl.acm.org/doi/10.1145/3530884
Meyer JSchlebusch TKasneci E(2022)A Highly Integrated Ambient Light Robust Eye-Tracking Sensor for Retinal Projection AR Glasses Based on Laser Feedback InterferometryProceedings of the ACM on Human-Computer Interaction10.1145/35308816:ETRA(1-18)Online publication date: 13-May-2022
https://dl.acm.org/doi/10.1145/3530881
Show More Cited By

Recommendations

A Novel Gaze Gesture Sensor for Smart Glasses Based on Laser Self-Mixing
CHI EA '21: Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems

The integration of gaze gesture sensors in next-generation smart glasses will improve usability and enable new interaction concepts. However, consumer smart glasses place additional requirements to gaze gesture sensors, such as a low power consumption, ...
A Highly Integrated Ambient Light Robust Eye-Tracking Sensor for Retinal Projection AR Glasses Based on Laser Feedback Interferometry
ETRA

Robust and highly integrated eye-tracking is a key technology to improve resolution of near-eye-display technologies for augmented reality (AR) glasses such as focus-free retinal projection as it enables display enhancements like foveated rendering. ...
Low Power Scanned Laser Eye Tracking for Retinal Projection AR Glasses
ETRA '20 Adjunct: ACM Symposium on Eye Tracking Research and Applications

Next generation AR glasses require a highly integrated, high-resolution near-eye display technique such as focus-free retinal projection to enhance usability. Combined with low-power eye-tracking, such glasses enable better user experience and ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ETRA '20 Short Papers: ACM Symposium on Eye Tracking Research and Applications

June 2020

305 pages

ISBN:9781450371346

DOI:10.1145/3379156

Editors:
Andreas Bulling
University of Stuttgart, Germany
,
Anke Huckauf
Ulm University, Germany
,
Eakta Jain
University of Florida, USA
,
Ralph Radach
University of Wuppertal, Germany
,
Daniel Weiskopf
University of Stuttgart, Germany

Copyright © 2020 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 June 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper
Research
Refereed limited

Conference

ETRA '20

Sponsor:

ETRA '20: 2020 Symposium on Eye Tracking Research and Applications

June 2 - 5, 2020

Stuttgart, Germany

Acceptance Rates

Overall Acceptance Rate 69 of 137 submissions, 50%

Upcoming Conference

ETRA '25

Sponsor:
sigchi
sigchi

2025 Symposium on Eye Tracking Research and Applications

May 26 - 29, 2025

Tokyo , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
467
Total Downloads

Downloads (Last 12 months)55
Downloads (Last 6 weeks)5

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Meyer JGering SKasneci E(2023)Static Laser Feedback Interferometry-Based Gaze Estimation for Wearable GlassesIEEE Sensors Journal10.1109/JSEN.2023.325071423:7(7558-7569)Online publication date: 1-Apr-2023
https://doi.org/10.1109/JSEN.2023.3250714
Meyer JFrank ASchlebusch TKasneci E(2022)U-HARProceedings of the ACM on Human-Computer Interaction10.1145/35308846:ETRA(1-19)Online publication date: 13-May-2022
https://dl.acm.org/doi/10.1145/3530884
Meyer JSchlebusch TKasneci E(2022)A Highly Integrated Ambient Light Robust Eye-Tracking Sensor for Retinal Projection AR Glasses Based on Laser Feedback InterferometryProceedings of the ACM on Human-Computer Interaction10.1145/35308816:ETRA(1-18)Online publication date: 13-May-2022
https://dl.acm.org/doi/10.1145/3530881
Meyer JWilm TFiess RSchlebusch TStork WKasneci E(2022)A Holographic Single-Pixel Stereo Camera Sensor for Calibration-free Eye-Tracking in Retinal Projection Augmented Reality Glasses2022 Symposium on Eye Tracking Research and Applications10.1145/3517031.3529616(1-7)Online publication date: 8-Jun-2022
https://dl.acm.org/doi/10.1145/3517031.3529616
Meyer JFrank ASchlebusch TKasneci E(2021)A CNN-based Human Activity Recognition System Combining a Laser Feedback Interferometry Eye Movement Sensor and an IMU for Context-aware Smart GlassesProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/34949985:4(1-24)Online publication date: 30-Dec-2021
https://dl.acm.org/doi/10.1145/3494998
Meyer JSchlebusch TSpruit HHellmig JKasneci E(2021)A Novel Gaze Gesture Sensor for Smart Glasses Based on Laser Self-MixingExtended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411763.3451621(1-6)Online publication date: 8-May-2021
https://dl.acm.org/doi/10.1145/3411763.3451621
Meyer JSchlebusch TSpruit HHellmig JKasneci E(2021)A compact low-power gaze gesture sensor based on laser feedback interferometry for smart glassesDigital Optical Technologies 202110.1117/12.2593772(10)Online publication date: 20-Jun-2021
https://doi.org/10.1117/12.2593772
Meyer JSchlebusch TFuhl WKasneci E(2020)A Novel Camera-Free Eye Tracking Sensor for Augmented Reality Based on Laser ScanningIEEE Sensors Journal10.1109/JSEN.2020.301198520:24(15204-15212)Online publication date: 15-Dec-2020
https://doi.org/10.1109/JSEN.2020.3011985

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Figures

Tables

Media

View Table of Conten