Skip to main content
Springer Nature Link
Log in

Experimental Assessment of Fixation-Based Attention Measurement in an Aircraft Cockpit

  • Conference paper
  • First Online:
Engineering Psychology and Cognitive Ergonomics (HCII 2022)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 13307))

Included in the following conference series:

  • 1878 Accesses

Abstract

Goal of this study was to improve eye-tracking-based attention measurement by fixation-based classification in an aircraft cockpit simulator. Most eye-tracking studies measure attention with averaging metrics which is not suitable for application in adaptive systems. Alternatively, attention classification based on fixation on AoI is a reasonable method but sometimes fails to correctly classify visual attention in modern HMIs. To find the cause of these problems, we conducted an aircraft simulator experiment with 10 pilots and collected baseline data for visual attention on different cockpit instruments. With this data, we evaluated fixation durations, fixation vicinity and the relationship between interaction and fixation position. The results showed that, graphical or moving display elements can be perceived with shorter fixations and near-peripheral perception compared to displays of text and numbers. Also, control input is often aligned with visual attention to associated information. With these results, visual attention measurement can be improved by adapting minimum fixation durations and areas of interest to the displayed content and using interaction as a proxy for attention.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Fortmann, F., Lüdtke, A.: An intelligent SA-adaptive interface to aid supervisory control of a UAV swarm. In: IEEE 11th International Conference on Industrial Informatics (INDIN), pp. 768–773 (2013)

    Google Scholar 

  2. Fortmann, F., Mengeringhausen, T.: Development and evaluation of an assistant system to aid monitoring behavior during multi-UAV supervisory control. In: Stary, C. (ed.) Proceedings of the 2014 European Conference on Cognitive Ergonomics-ECCE 2014, pp. 1–8. ACM Press, New York (2014)

    Google Scholar 

  3. Brand, Y., Schulte, A.: Design and Evaluation of a Workload-Adaptive Associate System for Cockpit Crews. In: Harris, D. (ed.) EPCE 2018. LNCS (LNAI), vol. 10906, pp. 3–18. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-91122-9_1

    Chapter  Google Scholar 

  4. Barrios, V.M.G., et al.: AdELE: a framework for adaptive e-learning through eye tracking. In: Proceedings of IKNOW 2004, pp. 609–616 (2004)

    Google Scholar 

  5. Wickens, C.D.: Attention: theory, principles, models and applications. Int. J. Hum. Comput. Interact. 37, 403–417 (2021)

    Article  Google Scholar 

  6. Remington, R.W., Loft, S.: Attention and multitasking. In: Boehm-Davis, D.A., Durso, F.T., Lee, J.D. (eds.) APA Handbook of Human Systems Integration, pp. 261–276. American Psychological Association, Washington (2015)

    Chapter  Google Scholar 

  7. Wickens, C.D.: Noticing events in the visual workplace: the SEEV and NSEEV models. In: Hoffman, R.R., Hancock, P.A., Scerbo, M.W., Parasuraman, R., Szalma, J.L. (eds.) The Cambridge Handbook of Applied Perception Research, pp. 749–768. Cambridge University Press, New York (2015)

    Chapter  Google Scholar 

  8. Jones, D.G., Endsley, M.R.: Sources of situation awareness errors in aviation. Aviat. Space Environ. Med. 67, 507–512 (1996)

    Google Scholar 

  9. Shorrock, S.T.: Errors of perception in air traffic control. Saf. Sci. 45, 890–904 (2007)

    Article  Google Scholar 

  10. Kelly, D., Efthymiou, M.: An analysis of human factors in fifty controlled flight into terrain aviation accidents from 2007 to 2017. J. Safety Res. 69, 155–165 (2019)

    Article  Google Scholar 

  11. Thomson, D.R., Besner, D., Smilek, D.: A resource-control account of sustained attention: evidence from mind-wandering and vigilance paradigms. Perspect. Psychol. Sci. J. Assoc. Psychol. Sci. 10, 82–96 (2015)

    Article  Google Scholar 

  12. Wickens, C.D.: Attentional tunneling and task management. In: International Symposium on Aviation Psychology (2005)

    Google Scholar 

  13. Parasuraman, R., Manzey, D.H.: Complacency and bias in human use of automation: an attentional integration. Hum. Factors 52, 381–410 (2010)

    Article  Google Scholar 

  14. Styles, E.A.: The Psychology of Attention. Psychology Press, Hove (2005)

    Google Scholar 

  15. Pashler, H.E.: Attention. Psychology Press, Hove (1998)

    Google Scholar 

  16. Peißl, S., Wickens, C.D., Baruah, R.: Eye-tracking measures in aviation: a selective literature review. Int. J. Aerosp. Psychol. 28, 98–112 (2018)

    Article  Google Scholar 

  17. Ziv, G.: Gaze behavior and visual attention: a review of eye tracking studies in aviation. Int. J. Aviat. Psychol. 26, 75–104 (2016)

    Article  Google Scholar 

  18. Lounis, C., Peysakhovich, V., Causse, M.: Visual scanning strategies in the cockpit are modulated by pilots’ expertise: a flight simulator study. PLoS ONE 16, e0247061 (2021)

    Article  Google Scholar 

  19. Brams, S., et al.: Does effective gaze behavior lead to enhanced performance in a complex error-detection cockpit task? PLoS ONE 13, e0207439 (2018)

    Article  Google Scholar 

  20. Sarter, N.B., Mumaw, R.J., Wickens, C.D.: Pilots’ monitoring strategies and performance on automated flight decks: an empirical study combining behavioral and eye-tracking data. Hum. Factors 49, 347–357 (2007)

    Article  Google Scholar 

  21. Dehais, F., Peysakhovich, V., Scannella, S., Fongue, J., Gateau, T.: “Automation surprise” in aviation. In: Begole, B., Kim, J., Inkpen, K., Woo, W. (eds.) Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, pp. 2525–2534. ACM, New York (2015)

    Google Scholar 

  22. Dehais, F., Roy, R.N., Scannella, S.: Inattentional deafness to auditory alarms: inter-individual differences, electrophysiological signature and single trial classification. Behav. Brain Res. 360, 51–59 (2019)

    Article  Google Scholar 

  23. Klaproth, O.W., Halbrügge, M., Krol, L.R., Vernaleken, C., Zander, T.O., Russwinkel, N.: A neuroadaptive cognitive model for dealing with uncertainty in tracing pilots’ cognitive state. Top. Cogn. Sci. 12, 1012–1029 (2020)

    Article  Google Scholar 

  24. Schwerd, S., Schulte, A.: Experimental Validation of an Eye-Tracking-Based Computational Method for Continuous Situation Awareness Assessment in an Aircraft Cockpit. In: Harris, D., Li, W.-C. (eds.) HCII 2020. LNCS (LNAI), vol. 12187, pp. 412–425. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-49183-3_32

    Chapter  Google Scholar 

  25. Schwerd, S., Schulte, A.: Measuring the deviation between ground truth and operator awareness in a UAV management scenario: an eye-tracking approach. In: AIAA Scitech 2021 Forum. American Institute of Aeronautics and Astronautics, Reston (2021)

    Google Scholar 

  26. Schwerd, S., Schulte, A.: Operator state estimation to enable adaptive assistance in manned-unmanned-teaming. Cogn. Syst. Res. 67, 73–83 (2021)

    Article  Google Scholar 

  27. Mack, A.: Inattentional blindness. Curr. Dir. Psychol. Sci. 12, 180–184 (2003)

    Article  Google Scholar 

  28. Strasburger, H., Rentschler, I., Jüttner, M.: Peripheral vision and pattern recognition: a review. J. Vis. 11, 13 (2011)

    Article  Google Scholar 

  29. Dick, A.O.: Instrument scanning and controlling: using eye movement data to understand pilot behavior and strategies. National Aeronautics and Space Administration, Scientific and Technical Information Branch (1980)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Insititute of Flight Systems, Universität der Bundeswehr, 85577, Munich, Germany

    Simon Schwerd & Axel Schulte

Authors
  1. Simon Schwerd
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Axel Schulte
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Simon Schwerd .

Editor information

Editors and Affiliations

  1. Coventry University, Coventry, UK

    Don Harris

  2. Cranfield University, Cranfield, UK

    Wen-Chin Li

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Schwerd, S., Schulte, A. (2022). Experimental Assessment of Fixation-Based Attention Measurement in an Aircraft Cockpit. In: Harris, D., Li, WC. (eds) Engineering Psychology and Cognitive Ergonomics. HCII 2022. Lecture Notes in Computer Science(), vol 13307. Springer, Cham. https://doi.org/10.1007/978-3-031-06086-1_32

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-06086-1_32

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-06085-4

  • Online ISBN: 978-3-031-06086-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics