research-article

Estimating cognitive load using remote eye tracking in a driving simulator

Authors:

Alexander Shyrokov,

Peter HeemanAuthors Info & Claims

ETRA '10: Proceedings of the 2010 Symposium on Eye-Tracking Research & Applications

Pages 141 - 144

https://doi.org/10.1145/1743666.1743701

Published: 22 March 2010 Publication History

Abstract

We report on the results of a study in which pairs of subjects were involved in spoken dialogues and one of the subjects also operated a simulated vehicle. We estimated the driver's cognitive load based on pupil size measurements from a remote eye tracker. We compared the cognitive load estimates based on the physiological pupillometric data and driving performance data. The physiological and performance measures show high correspondence suggesting that remote eye tracking might provide reliable driver cognitive load estimation, especially in simulators. We also introduced a new pupillometric cognitive load measure that shows promise in tracking cognitive load changes on time scales of several seconds.

References

[1]

Bailey B. P., and Iqbal S. T. 2008. Understanding changes in mental workload during execution of goal-directed tasks and its application for interruption management. ACM Trans. on Computer-Human Interaction, 14(4):1--28.

Digital Library

[2]

Beatty, J. 1982. Task Evoked Pupillary Responses, Processing Load and Structure of Processing Resources. Psychological Bulletin, 91(2): 276--292.

[3]

Hart S. G., and Staveland L. E. 1988. Development of NASATLX (Task Load Index): Results of empirical and theoritcal research. In Human Mental Workload, by Meshkati N. Hancock P. A., 239--250. Amsterdam: North Holland Press.

[4]

Healey J., and Picard R. 2000. Smartcar: Detecting driver stress. Proc. ICPR. Washington DC: IEEE Computer Society.

Digital Library

[5]

Iqbal S. T., Adamczyk P. D., Zheng X. S., and Bailey B. P. 2005. Towards an Index of Opportunity: Understanding Changes in Mental Workload during Task Execution. Proc. CHI'05. Portland, OR: ACM, 311--320.

Digital Library

[6]

Iqbal S. T., Zheng X. S., and Bailey B. P. 2004. Task-Evoked Pupillary Response to Mental Workload in Human-Computer Interaction. Proc. CHI'04. Vienna: ACM, 1477--1480.

Digital Library

[7]

Kun A. L., Paek T., Medenica Z., Memarovic N., and Palinko O. 2009. Glancing at personal navigation devices can affect driving: experimental results and design implications. Proc AutomotiveUI'09, ACM.

Digital Library

[8]

Klingner J., Kumar R., and Hanrahan P. 2008. Measuring the task-evoked pupillary response with a remote eye tracker. Proc. ETRA '08. Savannah, GA: ACM, 69--72.

Digital Library

[9]

Marshall, S. P. 2002. The Index of Cognitive Activity: measuring cognitive workload. Proc. IEEE Conf. on Human Factors and Power Plants. 7--9.

[10]

Mattes, S. 2003. The lane-change-task as a tool for driver distraction evaluation. Proc. ISOES.

[11]

O'Donnell R. D., and Eggmeier F. T. 1986. Workload assessment methodology. In Handbook of perception and human performance: Vol. II, by Thomas J. P. Kaufman L. New York: Wiley Interscience.

[12]

Recarte M. A., and Nunes L. M. 2000. Effects of verbal and spatial-imagery tasks on eye fixations while driving. J. Experimental Psychology, 6(1):31--43.

[13]

Recarte M. A., Perez E., Conchillo A., and Nunes L. M. 2008. Mental workload and visual impairment: Differences between pupil, blink and subjective rating. Spanish Journal of Psychology, 11(2):374--385.

[14]

Reimer B., Mehler B., Coughlin J. F., Godfrey K. M., and Tan C. 2009. An on-road assessment of the impact of cognitive workload on physiological arousal in young adult drivers. Proc AutomotiveUI'09, ACM, 115--118.

Digital Library

[15]

Schwalm M., Keinath A., and Zimmer H. D. 2008. Pupillometry as a method for measuring mental workload within a simulated driving task. In Human Factors for assistance and automation, by Flemisch F., Lorenz B., Oberheid H., Brookhuis K. De Waard D. Maastricht: Shaker Publishing.

[16]

Shyrokov, A. 2010. Human-human multi-threaded spoken dialogs in the presence of driving. PhD dissertation (in preparation). University of New Hampshire.

[17]

Wickens, C. D. 2002. Multiple Resources and Performance Prediction. Theoretical Issues in Ergonomics Sci., 3(2):159--177.

Cited By

Armougum AGaston-Bellegarde AJoie-La Marle CPiolino P(2025)Physiological analysis of cognitive load variations during complex information processingEuropean Transport Research Review10.1186/s12544-024-00692-817:1Online publication date: 8-Feb-2025
https://doi.org/10.1186/s12544-024-00692-8
Wang BWang JWang XChen LJiao CZhang HLiu Y(2024)An Identification Method for Road Hypnosis Based on the Fusion of Human Life ParametersSensors10.3390/s2423752924:23(7529)Online publication date: 25-Nov-2024
https://doi.org/10.3390/s24237529
Liang ZWang YQian CWang YZhao CDu HDeng JLi XHe Y(2024)A Driving Simulator Study to Examine the Impact of Visual Distraction Duration from In-Vehicle Displays: Driving Performance, Detection Response, and Mental WorkloadElectronics10.3390/electronics1314271813:14(2718)Online publication date: 11-Jul-2024
https://doi.org/10.3390/electronics13142718
Show More Cited By

Index Terms

Estimating cognitive load using remote eye tracking in a driving simulator
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Measuring the task-evoked pupillary response with a remote eye tracker
ETRA '08: Proceedings of the 2008 symposium on Eye tracking research & applications

The pupil-measuring capability of video eye trackers can detect the task-evoked pupillary response: subtle changes in pupil size which indicate cognitive load. We performed several experiments to measure cognitive load using a remote video eye tracker, ...
Measuring Cognitive Load using Eye Tracking Technology in Visual Computing
BELIV '16: Proceedings of the Sixth Workshop on Beyond Time and Errors on Novel Evaluation Methods for Visualization

In this position paper we encourage the use of eye tracking measurements to investigate users' cognitive load while interacting with a system. We start with an overview of how eye movements can be interpreted to provide insight about cognitive processes ...
Measuring linguistically-induced cognitive load during driving using the ConTRe task
AutomotiveUI '13: Proceedings of the 5th International Conference on Automotive User Interfaces and Interactive Vehicular Applications

This paper shows that fine-grained linguistic complexity has measurable effects on cognitive load with consequences for the design of in-car spoken dialogue systems. We used synthesized German sentences with grammatical ambiguities to test the ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ETRA '10: Proceedings of the 2010 Symposium on Eye-Tracking Research & Applications

March 2010

353 pages

ISBN:9781605589947

DOI:10.1145/1743666

Conference Chairs:
Carlos Hitoshi Morimoto
University of Sao Paulo, Brazil
,
Howell Istance
De Montfort University, UK
,
Program Chairs:
Aulikki Hyrskykari
University of Tampere, Finland
,
Qiang Ji
Rensselaer Polytechnic Institute

Copyright © 2010 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 March 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Conference

ETRA '10

Sponsor:

ETRA '10: Eye Tracking Research and Applications

March 22 - 24, 2010

Texas, Austin

Acceptance Rates

Overall Acceptance Rate 69 of 137 submissions, 50%

Upcoming Conference

ETRA '25

Sponsor:
sigchi
sigchi

2025 Symposium on Eye Tracking Research and Applications

May 26 - 29, 2025

Tokyo , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

237
Total Citations
View Citations
4,488
Total Downloads

Downloads (Last 12 months)306
Downloads (Last 6 weeks)30

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Armougum AGaston-Bellegarde AJoie-La Marle CPiolino P(2025)Physiological analysis of cognitive load variations during complex information processingEuropean Transport Research Review10.1186/s12544-024-00692-817:1Online publication date: 8-Feb-2025
https://doi.org/10.1186/s12544-024-00692-8
Wang BWang JWang XChen LJiao CZhang HLiu Y(2024)An Identification Method for Road Hypnosis Based on the Fusion of Human Life ParametersSensors10.3390/s2423752924:23(7529)Online publication date: 25-Nov-2024
https://doi.org/10.3390/s24237529
Liang ZWang YQian CWang YZhao CDu HDeng JLi XHe Y(2024)A Driving Simulator Study to Examine the Impact of Visual Distraction Duration from In-Vehicle Displays: Driving Performance, Detection Response, and Mental WorkloadElectronics10.3390/electronics1314271813:14(2718)Online publication date: 11-Jul-2024
https://doi.org/10.3390/electronics13142718
Wang TLuo PXia S(2024)Enhancing Visual Perception in Sports Environments: A Virtual Reality and Machine Learning ApproachBuildings10.3390/buildings1412401214:12(4012)Online publication date: 19-Dec-2024
https://doi.org/10.3390/buildings14124012
Cui XLi YYue LChen HZhou Z(2024)Investigating Blind Spot Design Effects on Drivers’ Cognitive Load with Lane Changing: A Comparative Experiment with Multiple Types of Intelligent VehiclesApplied Sciences10.3390/app1417757014:17(7570)Online publication date: 27-Aug-2024
https://doi.org/10.3390/app14177570
Deng SKulkarni COh JParker SLau N(2024)Comparison Between Scene-Independent and Scene-Dependent Eye Metrics in Assessing Psychomotor SkillsHuman Factors: The Journal of the Human Factors and Ergonomics Society10.1177/00187208241302475Online publication date: 28-Nov-2024
https://doi.org/10.1177/00187208241302475
Chiossi FEl Khaoudi YOu CSidenmark LZaky AFeuchtner TMayer S(2024)Evaluating Typing Performance in Different Mixed Reality Manifestations using Physiological FeaturesProceedings of the ACM on Human-Computer Interaction10.1145/36981428:ISS(377-406)Online publication date: 24-Oct-2024
https://dl.acm.org/doi/10.1145/3698142
Bozkir ERiedmiller CSkodras AKasneci GKasneci E(2024)Can You Tell Real from Fake Face Images? Perception of Computer-Generated Faces by HumansACM Transactions on Applied Perception10.1145/369666722:2(1-23)Online publication date: 30-Nov-2024
https://dl.acm.org/doi/10.1145/3696667
Grootjen JThalhammer PKosch T(2024)Your Eyes on Speed: Using Pupil Dilation to Adaptively Select Speed-Reading Parameters in Virtual RealityProceedings of the ACM on Human-Computer Interaction10.1145/36765318:MHCI(1-17)Online publication date: 24-Sep-2024
https://dl.acm.org/doi/10.1145/3676531
Chiossi FGruenefeld UHou BNewn JOu CLiao RWelsch RMayer S(2024)Understanding the Impact of the Reality-Virtuality Continuum on Visual Search Using Fixation-Related Potentials and Eye Tracking FeaturesProceedings of the ACM on Human-Computer Interaction10.1145/36765288:MHCI(1-33)Online publication date: 24-Sep-2024
https://dl.acm.org/doi/10.1145/3676528
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten