Skip to main content

Pilot’s Visual Eye-Track and Biological Signals: Can Computational Vision Toolbox Help to Predict the Human Behavior on a Flight Test Campaign?

  • Conference paper
  • First Online:
Human Interaction, Emerging Technologies and Future Applications IV (IHIET-AI 2021)

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 1378))

  • 1422 Accesses

Abstract

Humans’ biosignal responses are physiological behaviors that unravel the understanding of patterns which may help to predict reactions from risky situations. In the aeronautical field, the pilot’s reaction behavior is highly determinant to overcome a flight failure and excel in the execution of a maneuver during a flight. In this manner, an experiment was conducted using the AS-350 aircraft (Airbus Helicopters) during a Flight Test Campaign, which pilots were exposed to unexpected engine failures, and tested their ability to make a safe landing under the conditions prescribed by the aircraft manufacturer. This work aimed to analyze the spatial distribution of the visual eye-track and its effects on pilot performance, describing the recurrence of the location rate of the visual field across the cockpit versus the handling qualities of the aircraft, along with the physiological parameters of the pilots. Preliminary empirical results showed that the combination of three elements (Runway, altitude, and engine speed) are positively impacted on the success of the task.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 149.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 199.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Kim, S., Choi, B., Cho, T., Lee, Y., Koo, H., Kim, D.: Wearable bio signal monitoring system applied to aviation safety. In: 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), pp. 2349–2352. IEEE, July 2017

    Google Scholar 

  2. Scarpari, J.R.S., Ribeiro, M.W., Deolindo, C.S., Aratanha, M.A.A., Andrade, D., Forster, C. H., Figueira, J.M.P., Lacerda, S.S., Machado, B.S., Amaro-Jr, E., Sato, J.R., Kozasa, E.H., Silva, R.G.A.: Elite helicopter pilots physiological assessment during landing maneuver in critical situation. Unpublished (in press)

    Google Scholar 

  3. Eysenck, M.W., Derakshan, N., Santos, R., Calvo, M.G.: Anxiety and cognitive performance: attentional control theory. Emotion 7(2), 336 (2007)

    Article  Google Scholar 

  4. Cha, U.: Developing an embedded method to recognize human pilot intentions in an intelligent cockpit ads for the pilot decision support system. J. Ergon. Soc. Korea 17(3), 23–39 (1998)

    Google Scholar 

  5. Vishnu, S., Ramson, S.J., Jegan, R.: Internet of medical things (IoMT)-an overview. In: 2020 5th International Conference on Devices, Circuits and Systems (ICDCS), pp. 101–104. IEEE, March 2020

    Google Scholar 

  6. Qadri, Y.A., Nauman, A., Zikria, Y.B., Vasilakos, A.V., Kim, S.W.: The future of healthcare internet of things: a survey of emerging technologies. IEEE Commun. Surv. Tutor. 22(2), 1121–1167 (2020)

    Article  Google Scholar 

  7. Fang, Z., Yao, G., Zhang, Y.: Target recognition of aircraft based on moment invariants and BP neural network. In: World Automation Congress 2012, pp. 1–5. IEEE, June 2021

    Google Scholar 

  8. Newell, A., Card, S.K.: The prospects for psychological science in human-computer interaction. Hum.-Comput. Interact. 1(3), 209–242 (1985)

    Article  Google Scholar 

  9. Jaimes, A., Sebe, N.: Multimodal human–computer interaction: a survey. Comput. Vis. Image Underst. 108(1–2), 116–134 (2007)

    Article  Google Scholar 

  10. Hartson, R., Pyla, P.S.: The UX Book: Process and Guidelines for Ensuring a Quality User Experience. Elsevier, Amsterdam (2012)

    Google Scholar 

  11. Salas, E., Maurino, D., Curtis, M.: Human factors in aviation: an overview. In: Human Factors in Aviation, pp. 3–19. Academic Press (2010)

    Google Scholar 

  12. Driskell, J.E., Salas, E. (eds.): Stress and Human Performance. Psychology Press (2013)

    Google Scholar 

  13. Allsop, J., Gray, R.: Flying under pressure: Effects of anxiety on attention and gaze behavior in aviation. J. Appl. Res. Mem. Cogn. 3(2), 63–71 (2014)

    Article  Google Scholar 

  14. Wiegmann, D.A., Shappell, S.A.: Human error perspectives in aviation. Int. J. Aviat. Psychol. 11(4), 341–357 (2001)

    Article  Google Scholar 

  15. Nagel, D.C.: Human error in aviation operations. In: Human Factors in Aviation, pp. 263–303. Academic Press (1988)

    Google Scholar 

  16. Sharma, S., Singh, H., Prakash, A.: Multi-agent modeling and simulation of human behavior in aircraft evacuations. IEEE Trans. Aerosp. Electron. Syst. 44(4), 1477–1488 (2008)

    Article  Google Scholar 

  17. Miyoshi, T., Nakayasu, H., Ueno, Y., Patterson, P.: An emergency aircraft evacuation simulation considering passenger emotions. Comput. Ind. Eng. 62(3), 746–754 (2012)

    Article  Google Scholar 

  18. Scarpari, J.R.S., Forster, C.H.Q., Andrade, D., Silva, R.G.A.: Autorotation: physiological measures of workload. In: 45th European Rotorcraft Forum, Warsaw, Poland, pp. 17–20 (2019)

    Google Scholar 

  19. Follador, R.D.C., Trabasso, L.G.: Knowledge management patterns model for a flight test environment. J. Aerosp. Technol. Manag. 8(3), 263–271 (2016)

    Article  Google Scholar 

  20. Roscoe, A.H., Ellis, G.A.: A subjective rating scale for assessing pilot workload in flight: a decade of practical use (No. RAE-TR-90019). Royal Aerospace Establishment Farnborough, United Kingdom (1990)

    Google Scholar 

  21. Popoola, O.P., Wang, K.: Video-based abnormal human behavior recognition—a review. IEEE Trans. Syst. Man Cybern. Part C (Appl. Rev.) 42(6), 865–878 (2012)

    Article  Google Scholar 

  22. Haupt, C., Huber, A.B.: How axons see their way–axonal guidance in the visual system. Front. Biosci. 13, 3136–3149 (2008)

    Article  Google Scholar 

  23. Majaranta, P., Bulling, A.: Eye tracking and eye-based human–computer interaction. In: Advances in Physiological Computing, pp. 39–65. Springer, London (2014)

    Google Scholar 

  24. Ji, Q., Wechsler, H., Duchowski, A., Flickner, M.: Special issue: eye detection and tracking. Comput. Vis. Image Underst. 98(1), 1–3 (2005)

    Article  Google Scholar 

  25. Colvin, K.W., Dodhia, R.M., Belcher, S.A., Dismukes, R.K.: Scanning for visual traffic: an eye tracking study. In: Proceedings of the 12th International Symposium on Aviation Psychology, vol. 14 (2003)

    Google Scholar 

  26. Peysakhovich, V., Lefrançois, O., Dehais, F., Causse, M.: The neuroergonomics of aircraft cockpits: the four stages of eye-tracking integration to enhance flight safety. Safety 4(1), 8 (2018)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Marcela Di Marzo .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Di Marzo, M., Bidinotto, J., Scarpari, J. (2021). Pilot’s Visual Eye-Track and Biological Signals: Can Computational Vision Toolbox Help to Predict the Human Behavior on a Flight Test Campaign?. In: Ahram, T., Taiar, R., Groff, F. (eds) Human Interaction, Emerging Technologies and Future Applications IV. IHIET-AI 2021. Advances in Intelligent Systems and Computing, vol 1378. Springer, Cham. https://doi.org/10.1007/978-3-030-74009-2_29

Download citation

Publish with us

Policies and ethics