short-paper

One threshold to rule them all? Modification of the Index of Pupillary Activity to optimize the indication of cognitive load

Author:

Benedict C. O. F. FehringerAuthors Info & Claims

ETRA '20 Short Papers: ACM Symposium on Eye Tracking Research and Applications

Article No.: 42, Pages 1 - 5

https://doi.org/10.1145/3379156.3391341

Published: 02 June 2020 Publication History

Abstract

Cognitive load is an important source of information in performance situations. One promising non-invasive method is pupillometry. The Index of Pupillary Activity [IPA, Duchowski et al. 2018] performs a wavelet transformation on changes of pupillary dilations to detect high frequencies. This index is inspired by the Index of Cognitive Activity [ICA, Marshall 2000]. The IPA value is the sum of peaks exceeding a predefined threshold. The present study shows that it appears reasonable to adapt this threshold corresponding to the task. Fifty-five participants performed a spatial thinking test with six difficulty levels and two simple fixation tasks. Six different IPA values resulting from different thresholds were computed. The distributions of these IPA values of the eight conditions were analyzed regarding the validity to indicate different levels of cognitive load, corresponding to accuracy data. The analyses revealed that different thresholds are sensitive for different cognitive load levels. Contra-intuitive results were also obtained.

References

[1]

John L. Andreassi. 2007. Psychophysiology: Human behavior and physiological response (5th ed. ed.). L. Erlbaum Publishers, Mahwah, N.J and London.

[2]

John B. Carroll. 1993. Human cognitive abilities. Cambridge University Press, Cambridge. https://doi.org/10.1017/CBO9780511571312

[3]

Siyuan Chen and Julien Epps. 2014. Efficient and robust pupil size and blink estimation from near-field video sequences for human-machine interaction. IEEE transactions on cybernetics 44, 12 (2014), 2356–2367. https://doi.org/10.1109/TCYB.2014.2306916

[4]

Benjamin Cowley, Marco Filetti, Kristian Lukander, Jari Torniainen, Andreas Henelius, Lauri Ahonen, Oswald Barral, Ilkka Kosunen, Teppo Valtonen, Minna Huotilainen, Niklas Ravaja, and Giulio Jacucci. 2015. The Psychophysiology Primer: A Guide to Methods and a Broad Review with a Focus on Human–Computer Interaction. FNT in Human–Computer Interaction (Foundations and Trends in Human–Computer Interaction) 9, 3-4 (2015), 151–308. https://doi.org/10.1561/1100000065

[5]

V. Demberg, K. Evangelia, and A. Sayeed. 2013. The Index of Cognitive Activity as a Measure of Linguistic Processing. In Cooperative minds, Markus Knauff, Michael Pauen, Natalie Sebanz, and Ipke Wachsmuth (Eds.). Cognitive Science Soc, Austin, Tex., 2148–2153.

[6]

Andrew T. Duchowski, Krzysztof Krejtz, Izabela Krejtz, Cezary Biele, Anna Niedzielska, Peter Kiefer, Martin Raubal, and Ioannis Giannopoulos. 2018. The Index of Pupillary Activity. In CHI 2018, Regan Mandryk, Mark Hancock, Mark Perry, and Anna Cox(Eds.). The Association for Computing Machinery, New York, New York, 1–13. https://doi.org/10.1145/3173574.3173856

[7]

EyeTracking Inc.2015. Workload RT (1.5) [Software]. http://www.eyetracking.com

[8]

Benedict C. O. F. Fehringer. 2019. The diagnostic potential of eye tracking and pupilometry in the context of spatial thinking: Doctoral thesis, University of Mannheim. Mannheim.

[9]

Marcel Adam Just and Patricia A. Carpenter. 1993. The intensity dimension of thought: Pupillometric indices of sentence processing. Canadian Journal of Experimental Psychology/Revue canadienne de psychologie expérimentale 47, 2 (1993), 310–339. https://doi.org/10.1037/h0078820

[10]

Daniel Kahneman. 1973. Attention and effort. Prentice Hall, Englewood Cliffs.

[11]

Sandra P. Marshall. 2000. Method and apparatus for eye tracking and monitoring pupil dilation to evaluate cognitive activity.

[12]

Sandra P. Marshall. 2009. What the Eyes Reveal: Measuring the Cognitive Workload of Teams. In Digital human modeling, Vincent G. Duffy (Ed.). Lecture Notes in Computer Science, Vol. 5620. Springer, Berlin and Heidelberg, 265–274. https://doi.org/10.1007/978-3-642-02809-0_29

[13]

Allan Paivio. 2014. Intelligence, dual coding theory, and the brain. Intelligence 47(2014), 141–158. https://doi.org/10.1016/j.intell.2014.09.002

[14]

Oskar Palinko and Andrew L. Kun. 2012. Exploring the effects of visual cognitive load and illumination on pupil diameter in driving simulators. In Proceedings of the Symposium on Eye Tracking Research and Applications, Carlos H. Morimoto (Ed.). ACM, New York, NY, 413. https://doi.org/10.1145/2168556.2168650

Digital Library

[15]

Felix D. Schönbrodt, Eric-Jan Wagenmakers, Michael Zehetleitner, and Marco Perugini. 2017. Sequential hypothesis testing with Bayes factors: Efficiently testing mean differences. Psychological methods 22, 2 (2017), 322–339. https://doi.org/10.1037/met0000061

[16]

Maximilian Schwalm, Andreas Keinath, and Hubert D. Zimmer. 2008. Pupillometry as a method for measuring mental workload within a simulated driving task. In Human factors for assistance and automation, Dick de Waard (Ed.). Shaker Publ, Maastricht, 1–13.

[17]

Stuart R. Steinhauer, Greg J. Siegle, Ruth Condray, and Misha Pless. 2004. Sympathetic and parasympathetic innervation of pupillary dilation during sustained processing. International journal of psychophysiology : official journal of the International Organization of Psychophysiology 52, 1 (2004), 77–86. https://doi.org/10.1016/j.ijpsycho.2003.12.005

[18]

Adriana A. Zekveld and Sophia E. Kramer. 2014. Cognitive processing load across a wide range of listening conditions: Insights from pupillometry. Psychophysiology 51, 3 (2014), 277–284. https://doi.org/10.1111/psyp.12151

[19]

Bin Zheng, Xianta Jiang, and M. Stella Atkins. 2015. Detection of Changes in Surgical Difficulty: Evidence From Pupil Responses. Surgical innovation 22, 6 (2015), 629–635. https://doi.org/10.1177/1553350615573582

Cited By

Ahmadi MMichalka SNajafabadi MWünsche BBillinghurst M(2024)EEG, Pupil Dilations, and Other Physiological Measures of Working Memory Load in the Sternberg TaskMultimodal Technologies and Interaction10.3390/mti80400348:4(34)Online publication date: 19-Apr-2024
https://doi.org/10.3390/mti8040034

Recommendations

The Low/High Index of Pupillary Activity
CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems

A novel eye-tracked measure of pupil diameter oscillation is derived as an indicator of cognitive load. The new metric, termed the Low/High Index of Pupillary Activity (LHIPA), is able to discriminate cognitive load (vis-a-vis task difficulty) in several ...
Estimating cognitive load using remote eye tracking in a driving simulator
ETRA '10: Proceedings of the 2010 Symposium on Eye-Tracking Research & Applications

We report on the results of a study in which pairs of subjects were involved in spoken dialogues and one of the subjects also operated a simulated vehicle. We estimated the driver's cognitive load based on pupil size measurements from a remote eye ...
The Index of Pupillary Activity: Measuring Cognitive Load vis-à-vis Task Difficulty with Pupil Oscillation
CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems

A novel eye-tracked measure of the frequency of pupil diameter oscillation is proposed for capturing what is thought to be an indicator of cognitive load. The proposed metric, termed the Index of Pupillary Activity, is shown to discriminate task ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ETRA '20 Short Papers: ACM Symposium on Eye Tracking Research and Applications

June 2020

305 pages

ISBN:9781450371346

DOI:10.1145/3379156

Editors:
Andreas Bulling
University of Stuttgart, Germany
,
Anke Huckauf
Ulm University, Germany
,
Eakta Jain
University of Florida, USA
,
Ralph Radach
University of Wuppertal, Germany
,
Daniel Weiskopf
University of Stuttgart, Germany

Copyright © 2020 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 June 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper
Research
Refereed limited

Conference

ETRA '20

Sponsor:

ETRA '20: 2020 Symposium on Eye Tracking Research and Applications

June 2 - 5, 2020

Stuttgart, Germany

Acceptance Rates

Overall Acceptance Rate 69 of 137 submissions, 50%

Upcoming Conference

ETRA '25

Sponsor:
sigchi
sigchi

2025 Symposium on Eye Tracking Research and Applications

May 26 - 29, 2025

Tokyo , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
218
Total Downloads

Downloads (Last 12 months)23
Downloads (Last 6 weeks)2

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Ahmadi MMichalka SNajafabadi MWünsche BBillinghurst M(2024)EEG, Pupil Dilations, and Other Physiological Measures of Working Memory Load in the Sternberg TaskMultimodal Technologies and Interaction10.3390/mti80400348:4(34)Online publication date: 19-Apr-2024
https://doi.org/10.3390/mti8040034

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Figures

Tables

Media

View Table of Conten