Abstract
Human mental fatigue occurs during various tasks due to increased load and time-on-task. As it might impair human performance, it could be beneficial detecting it automatically and subsequently implement measures to mitigate fatigue. To accomplish this, mental fatigue has to be detected, preferably as unobtrusive as possible. Recent research proposes that remote eye-tracking could be a promising method. The background of this contribution is interactive image exploitation as it might occur in safety or security applications. We consider wide area motion imagery which typically covers several square kilometers and includes a huge number of tiny vehicles and persons. A human operator has to perform lots of search, zoom and pan operations in order to find relevant objects. We conducted a pilot study (N = 20 non-expert image analysts) where subjects preformed several basic image exploitation tasks. During the sessions, we collected their gaze data using a 500 Hz eye-tracker. From the recorded gaze data protocols, we extracted saccadic and fixational gaze parameters using the I-VT algorithm. Mean and maximum saccadic velocity as well as mean saccadic amplitude decrease over time. This corresponds to findings by the research community in terms of observed gaze behavior under mental fatigue. However, the effects are small and need confirmation by future work.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Bafna, T., Hansen, J.P.: Mental fatigue measurement using eye metrics: a systematic literature review. Psychophysiology 58(6), e13828 (2021)
Balkin, T.J., Wesensten, N.J.: Differentiation of sleepiness and mental fatigue effects. In: Ackerman, P.L. (ed.) Cognitive Fatigue: Multidisciplinary Perspectives on Current Research and Future Applications, pp. 47–66. American Psychological Association (2011)
Boksem, M.A., Tops, M.: Mental fatigue: costs and benefits. Brain Res. Rev. 59(1), 125–139 (2008)
Hopstaken, J.F., Van Der Linden, D., Bakker, A.B., Kompier, M.A.: A multifaceted investigation of the link between mental fatigue and task disengagement. Psychophysiology 52(3), 305–315 (2015)
Yoss, R.E., Moyer, N.J., Hollenhorst, R.W.: Pupil size and spontaneous pupillary waves associated with alertness, drowsiness, and sleep. Neurology 20(6), 545 (1970)
Abdulin, E., Komogortsev, O.: User eye fatigue detection via eye movement behavior. In: Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems, pp. 1265–1270. ACM (2015)
Renata, V., Li, F., Lee, C.H., Chen, C.H.: Investigation on the correlation between eye movement and reaction time under mental fatigue influence. In: 2018 International Conference on Cyberworlds (CW), pp. 207–213. IEEE (2018)
Yamada, Y., Kobayashi, M.: Detecting mental fatigue from eye-tracking data gathered while watching video: evaluation in younger and older adults. Artif. Intell. Med. 91, 39–48 (2018)
Eckstein, M.K., Guerra-Carrillo, B., Singley, A.T.M., Bunge, S.A.: Beyond eye gaze: what else can eyetracking reveal about cognition and cognitive development? Dev. Cogn. Neurosci. 25, 69–91 (2017)
Maffei, A., Angrilli, A.: Spontaneous eye blink rate: an index of dopaminergic component of sustained attention and fatigue. Int. J. Psychophysiol. 123, 58–63 (2018)
Di Stasi, L.L., et al.: Effects of driving time on microsaccadic dynamics. Exp. Brain Res. 233(2), 599–605 (2014). https://doi.org/10.1007/s00221-014-4139-y
Li, J., Li, H., Wang, H., Umer, W., Fu, H., Xing, X.: Evaluating the impact of mental fatigue on construction equipment operators’ ability to detect hazards using wearable eye-tracking technology. Autom. Constr. 105, 102835 (2019)
Song, J., Wang, R., Zhang, G., Xiong, C., Zhang, L., Sun, C.: Electrooculogram signals analysis for process control operator based on fuzzy c-means. Vectors 1, 2 (2015)
Cazzoli, D., Antoniades, C.A., Kennard, C., Nyffeler, T., Bassetti, C.L., Müri, R.M.: Eye movements discriminate fatigue due to chronotypical factors and time spent on task–a double dissociation. PLoS ONE 9(1), e87146 (2014)
Di Stasi, L.L., Renner, R., Catena, A., Canas, J.J., Velichkovsky, B.M., Pannasch, S.: Towards a driver fatigue test based on the saccadic main sequence: a partial validation by subjective report data. Transp. Res. Part C Emerg. Technol. 21(1), 122–133 (2012)
McGregor, D.K., Stern, J.A.: Time on task and blink effects on saccade duration. Ergonomics 39(4), 649–660 (1996)
Van Orden, K.F., Jung, T.P., Makeig, S.: Combined eye activity measures accurately estimate changes in sustained visual task performance. Biol. Psychol. 52(3), 221–240 (2000)
Lavine, R.A., Sibert, J.L., Gokturk, M., Dickens, B.: Eye-tracking measures and human performance in a vigilance task. Aviat. Space Environ. Med. 73(4), 367–372 (2002)
U.S. Air Force Research Laboratory (AFRL), WPAFB2009 dataset. https://www.sdms.afrl.af.mil/index.php?collection=wpafb2009. Accessed 9 Feb 2023
SR Research EyeLink. https://www.sr-research.com/eyelink-1000-plus/. Accessed 8 Feb 2023
Tobii Homepage. https://help.tobii.com/hc/en-us/articles/213414285-Specifications-for-the-Tobii-Eye-Tracker-%204C. Accessed 8 Feb 2023
Salvucci, D.D., Goldberg, J.H.: Identifying fixations and saccades in eye-tracking protocols. In: Proceedings of the 2000 Symposium on Eye Tracking Research & Applications, pp. 71–78. ACM (2000)
Leigh, R.J., Zee, D.S.: The neurology of eye movements. Contemporary Neurology (2015)
Holmqvist, K., Nyström, M., Andersson, R., Dewhurst, R., Jarodzka, H., Van de Weijer, J.: Eye Tracking: A Comprehensive Guide to Methods and Measures. OUP, Oxford (2011)
Birawo, B., Kasprowski, P.: Review and evaluation of eye movement event detection algorithms. Sensors 22(22), 8810 (2022)
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Lengenfelder, C., Hild, J., Voit, M., Peinsipp-Byma, E. (2023). Pilot Study on Gaze-Based Mental Fatigue Detection During Interactive Image Exploitation. In: Harris, D., Li, WC. (eds) Engineering Psychology and Cognitive Ergonomics. HCII 2023. Lecture Notes in Computer Science(), vol 14017. Springer, Cham. https://doi.org/10.1007/978-3-031-35392-5_8
Download citation
DOI: https://doi.org/10.1007/978-3-031-35392-5_8
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-35391-8
Online ISBN: 978-3-031-35392-5
eBook Packages: Computer ScienceComputer Science (R0)