skip to main content
10.1145/3452853.3452855acmotherconferencesArticle/Chapter ViewAbstractPublication PagesecceConference Proceedingsconference-collections
research-article
Open access

Automation, teamwork, and the feared loss of safety: Air traffic controllers’ experiences and expectations on current and future ATM systems

Published: 26 April 2021 Publication History

Abstract

In various control systems, automation is implemented to increase efficiency and safety. With increased automation, it becomes increasingly relevant to view the automation as a team member, rather than as a tool. In best cases, human-automation teamwork keeps workload within acceptable limits, increase situation awareness, and keeps the operator in the control loop. However, human-automation teamwork will only flourish if the automation is developed with the human operator in mind. Therefore, investigations of the current experiences and expectations regarding automation and teamwork are important for the development of automation. Through a questionnaire among Air Traffic Controllers (ATCOs), the present study aims to investigate how ATCOs perceive automation and safety in current and future air traffic control systems and the importance of different teamwork factors for human-human and human-automation collaboration. The results indicate that the ATCOs believe that safety will increase in the future along with increasing automation as long as the automation is working as expected. The ATCOs expressed a fear of deskilling and losing situation awareness with automation, a fear associated with a new ATCO role of monitoring the system and take over when the automation fails. The results suggest that design for human-automation teamwork aspects that ATCOs value, such as adaptability or mutual performance monitoring, could be a way forward.

References

[1]
Sheridan, T.B., W.L. Verplank, and T.L. Brooks. Human/computer control of undersea teleoperators. in Proceedings of the International Conference on Cybernetics and Society. 1978. Tokyo-Kyoto, Japan: IEEE.
[2]
Endsley, M.R., Level of Automation Forms a Key Aspect of Autonomy Design. Journal of Cognitive Engineering and Decision Making, 2018. 12(1): p. 29-34.
[3]
Kaber, D.B., Issues in human-automation interaction modeling: Presumptive aspects of frameworks of types and levels of automation. Journal of Cognitive Engineering and Decision Making, 2018.
[4]
SESAR, Air Transport Framework - The Current Situation. 2006: Brussels, Belgium.
[5]
SESAR, European ATM Master Plan Level 3 - Implementation Plan. 2017: Brussels, Belgium.
[6]
SESAR, European ATM Master Plan. 2015: Brussels, Belgium.
[7]
SESAR, A proposal for the future architecture of the European airspace. 2019: Brussels, Belgium.
[8]
Martinie, C., P. Palanque, A. Pasquini, M. Ragosta, E. Rigaud, Using complementary models-based approaches for representing and analysing ATM systems' variability. in 2nd International Conference on Application and Theory of Automation in Command and Control Systems-ATACCS'12. 2012. IRIT Press.
[9]
Fürstenau, N., Virtual and Remote Control Tower. 2016: Springer.
[10]
Bagassi, S., Augmented and Virtual Reality in the Airport Control Tower: The RETINA concept. 2017.
[11]
Kontogiannis, T. and S. Malakis, Cognitive Engineering and Safety Organization in Air Traffic Management. 2017.
[12]
Strauch, B., Ironies of Automation: Still Unresolved After All These Years. IEEE Transactions on Human-Machine Systems, 2017. 48(5): p. 419 - 433.
[13]
Endsley, M.R. and E.O. Kiris, The out-of-the-loop performance problem and level of control in automation. Human Factors, 1995. 37(2): p. 381-394.
[14]
Endsley, M.R. and D.B. Kaber, Level of automation effects on performance, situation awareness and workload in a dynamic control task. Ergonomics, 1999. 42(3): p. 462 - 492.
[15]
Baxter, G., J. Rooksby, Y. Wang, and A. Khajeh-Hosseini. The ironies of automation: still going strong at 30? in Proceedings of the 30th European Conference on Cognitive Ergonomics. 2012. Edinburgh, United Kingdom: ACM.
[16]
Hilburn, B. and M. Flynn. Air traffic controller and management attitudes toward automation: an empirical investigation. in Air Traffic Management Reserach and Development Seminar. 2001. Santa Fe, USA.
[17]
Bekier, M., Automation acceptance in air traffic management, in Deptartment of Aviation. 2013, New South Wales: Sydney, Australia.
[18]
Borst, C., C. Westin, and B. Hilburn. An Investigation into the Use of Novel Conflict Detection and Resolution Automation in Air Traffic Management. in SESAR Innovation Days. 2012. Braunschweig, Germany.
[19]
Lee, J.D. and K.A. See, Trust in Automation: Designing for Appropriate Reliance. Human Factors, 2004. 46(1): p. 50-80.
[20]
Mirchi, T., K.-P. Vu, J. Miles, L. Sturre, S. Curtis, Air Traffic Controller Trust in Automation in NextGen. Procedia Manufacturing, 2015. 3: p. 2482-2488.
[21]
Eurocontrol, Age, Experience and Automation in European Air Traffic Control - Survey in the ECAC Area. 2004: Brussels, Belgium.
[22]
Thompson, R.C. and L.L. Bailey, Age and attitudes in the air traffic control specialist workforce: an initial assessment. 2000, Federal Aviation Administration: Oklahoma City, USA.
[23]
Parasuraman, R., J. Duley, and A. Smoker, Automation tools for controllers in future air traffic control. The Controller, 1998.
[24]
Eurocontrol, Attitudes towards future automation concepts: A litterature review. 2000: Brussels, Belgium.
[25]
Nijhuis, H., S. Buck, C. Kelly, P. Goillau, C. Fassert, RHEA. Role of the Human in the Evolution of ATM systems. Final report. 1999.
[26]
Norman, D., Design, business models, and human-technology teamwork: As automation and artificial intelligence technologies develop, we need to think less about human-machine interfaces and more about human-machine teamwork. Research-Technology Management, 2017. 60(1): p. 26-30.
[27]
Svensson, Å., U. Ohlander, and J. Lundberg, Design implications for teamwork in ATC. Cognition, Technology & Work, 2019.
[28]
Banks, V.A. and N.A. Stanton, Keep the driver in control: Automating automobiles of the future. Applied ergonomics, 2016. 53: p. 389-395.
[29]
Endsley, M.R., Testimony to the United States House of Representatives: Hearing on Boeing 737-Max8 Crashes. 2019.
[30]
Naser, J., Guidance for the Design and Use of Automation in Nuclear Power Plants. 2005, Electric Power Research Institute: California, USA.
[31]
Parasuraman, R., T. Sheridan, and C. Wickens, A model for types and levels of human interaction with automation. IEEE Transactions on Systems, Man, and Cybernetics – Part A: Systems and Humans, 2000. 30(3): p. 286 - 297.
[32]
Endsley, M.R. and E.O. Kiris, Out-of-the-Loop Performance Problems and the Use of Intermediate Levels of Automation for Improved Control System Functioning and Safety. Human Factors: The Journal of the Human Factors and Ergonomics Society, 1995. 37(2): p. 381-394.
[33]
Miller, C. and R. Parasuraman, Beyond Levels of Automation: An Architecture for More Flexible Human-Automation Collaboration. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 2003. 47(1): p. 182.
[34]
Wickens, C., Automation Stages & Levels, 20 Years After. Journal of Cognitive Engineering and Decision Making, 2018. 12(1): p. 35-41.
[35]
Bekier, M., B.R. Molesworth, and A. Williamson, Tipping point: The narrow path between automation acceptance and rejection in air traffic management. Safety science, 2011. 50(2): p. 259-265.
[36]
Hopkin, V.D. and J.A. Wise, Human Factors in Air Traffic System Automation. Automation and human performance: Theory and applications, 1996: p. 192.
[37]
Endsley, M.R., Toward a Theory of Situation Awareness in Dynamic Systems. Human Factors, 1995. 37(1): p. 32-64.
[38]
Stanton, N.A., P.M. Salmon, G.H. Walker, E. Salas, and P.A. Hancock, State-of-science: situation awareness in individuals, teams and systems. Ergonomics, 2017. 60(4): p. 449-466.
[39]
Eurocontrol, Model for Task and Job Descriptions of Air Traffic Controllers. European Air Traffic Control Harmonisation and Integration Programme. 1996: Brussels, Belgium.
[40]
Hilburn, B., Conflict Resolution Assistant Level 2 (CORA2) Controller Assessments: Final Report. 2000.
[41]
Salas, E., T.L. Dickinson, S.A. Converse, and S.I. Tannenbaum, Toward an understanding of team performance and training, in Teams: Their training and performance, R.W. Swezey and E. Salas, Editors. 1992, Ablex: Norwood, NJ. p. 2-29.
[42]
Salas, E., D.E. Sims, and C.S. Burke, Is there a “big five” in teamwork? Small group research, 2005. 36(5): p. 555-599.
[43]
McGrath, J.E., Social psychology: A brief introduction. 1964: Holt, Rinehart and Winston.
[44]
Kay, J., N. Maisonneuve, K. Yacef, and P. Reimann. The big five and visualisations of team work activity. in 8th International Conference on Intelligent Tutoring Systems, ITS 2006. 2006. Jhongli, Taiwan: Springer.
[45]
Duel, J., Teamwork in action: Military teams preparing for, and conducting Peace Support Operations. 2010, Tilburg University: Haag, Netherlands.
[46]
van Roosmalen, T.M., The development of a questionnaire on the subjective experience of teamwork, based on Salas, Sims and Burke's" the big five of teamwork" and Hackman's understanding of team effectiveness. 2012, The Norwegian University of Science and Technology: Trondheim, Norway.
[47]
Ohlander, U., Towards Enhanced Tactical Support Systems, in Artificial Intelligence Lab. 2016, Högskolan i Skövde Skövde, Sweden.
[48]
Fink, A., How to conduct surveys: a step-by-step guide. 5th ed. 2013, London, UK: Sage Publisher.
[49]
Cronbach, L.J., Coefficient alpha and the internal structure of tests. psychometrika, 1951. 16(3): p. 297-334.
[50]
Creswell, J.W., Research Design: Qualitative, Quantitative, and Mixed Methods Approaches. Vol. 3. 2009, Thousand Oaks, California, US: Sage Publications, Inc.
[51]
Richards, L., Handling qualitative data: A practical guide. 2014: Sage.
[52]
Norman, D.A., The Human Side of Automation, in Road Vehicle Automation 2, G. Meyer and S. Beiker, Editors. 2015, Springer International Publishing: Cham. p. 73-79.
[53]
Drogoul, F. and P. Palanque, Education and Performance in Aviation: Realising and Sustaining Benefits. 2019, Eurocontrol: Brussels, Belgium.
[54]
Bekier, M. and B.R.C. Molesworth, Altering user'acceptance of automation through prior automation exposure. Ergonomics, 2017. 60(6): p. 745-753.

Cited By

View all
  • (2024)Towards Full ATC Automation for Aircraft Ground Movement: A First Step2024 AIAA DATC/IEEE 43rd Digital Avionics Systems Conference (DASC)10.1109/DASC62030.2024.10749019(1-9)Online publication date: 29-Sep-2024
  • (2023)SonAir: the design of a sonification of radar data for air traffic controlJournal on Multimodal User Interfaces10.1007/s12193-023-00404-x17:3(137-149)Online publication date: 8-Jul-2023
  1. Automation, teamwork, and the feared loss of safety: Air traffic controllers’ experiences and expectations on current and future ATM systems

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    ECCE '21: Proceedings of the 32nd European Conference on Cognitive Ergonomics
    April 2021
    235 pages
    ISBN:9781450387576
    DOI:10.1145/3452853
    This work is licensed under a Creative Commons Attribution International 4.0 License.

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 26 April 2021

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Air Traffic Control
    2. Automation
    3. Safety
    4. Teamwork

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Funding Sources

    • Swedish Transport Administration (Trafikverket)
    • The Air Navigation Service Provider of Sweden (LFV)

    Conference

    ECCE 2021

    Acceptance Rates

    Overall Acceptance Rate 56 of 91 submissions, 62%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)187
    • Downloads (Last 6 weeks)30
    Reflects downloads up to 19 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Towards Full ATC Automation for Aircraft Ground Movement: A First Step2024 AIAA DATC/IEEE 43rd Digital Avionics Systems Conference (DASC)10.1109/DASC62030.2024.10749019(1-9)Online publication date: 29-Sep-2024
    • (2023)SonAir: the design of a sonification of radar data for air traffic controlJournal on Multimodal User Interfaces10.1007/s12193-023-00404-x17:3(137-149)Online publication date: 8-Jul-2023

    View Options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Login options

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media