Abstract
We examined two metrics for assessing Human-Autonomy-Teaming (HAT) performance, subjective workload and eye-gaze durations, in a simulation of dispatcher flight following while interacting with the HAT features of an Autonomous Constrained Flight Planner. Operator workload was lower in the HAT condition and decreased with time in the scenario. However, participants took more time to uplink flight plan changes in this condition.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
National Research Council: Autonomy Research for Civil Aviation: Toward a New Era of Flight. National Academies Press, Washington D.C. (2014)
Langan-Fox, J., Canty, J.M., Sankey, M.J.: Human-automation teams and adaptable control for future air traffic management. Int. J. Ind. Ergon. 39, 894–903 (2009)
Chen, J.Y.C., Barnes, M.J.: Human-Agent Teaming for Multi-Robot Control: A Literature Review (ARL-TR-6328). Human Research and Engineering Directorate, Aberdeen Proving Grounds (2013)
Shively, R.J, Lachter, J., Brandt, S., Matessa, M., Battiste, V., Johnson, W.W.: Why human-autonomy teaming? In: Proceedings of the 8th Annual International Conference on Applied Human Factors and Ergonomics (AHFE 2017), Los Angeles, CA (this volume)
Fern, L., Shively, R.J.: A comparison of varying levels of automation on the supervisory control of multiple UASs. In: Proceedings of AUVSI’s Unmanned Systems North America, Washington, DC (2009)
Brandt, S., Lachter, J.B., Russel, R., Shively, R.J.: A human-autonomy teaming approach for a flight-following task. In: Proceedings of the 8th Annual International Conference on Applied Human Factors and Ergonomics (AHFE 2017), Los Angeles, CA (this volume)
Lachter, J.B., Brandt, S., Sadler, G. Shively, R.: Beyond point design: general pattern to specific implementations. In: Proceedings of the 8th Annual International Conference on Applied Human Factors and Ergonomics (AHFE 2017), Los Angeles, CA (this volume)
Endsley, M.R., Jones, D.G.: Designing for situation awareness: an approach to human-centered design, 2nd edn. CRC Press, New York (2012)
Matessa, M.: Using a crew resource management framework to develop human-autonomy teaming measures. In: Proceedings of the 8th Annual International Conference on Applied Human Factors and Ergonomics (AHFE 2017), Los Angeles, CA (this volume)
Joe, J.C., O’Hara, J., Medema, H.D., Oxstrand, J.H.: Identifying requirements for effective human-automation teamwork. In: Probabilistic Safety Assessment and Management PSAM 2012, Honolulu, HI (2014)
Parasuraman, R., Sheridan, T.B., Wickens, C.D.: Humans: still vital after all these years of automation. Hum. Factors Gold. Anniv. Spec. Issue 50, 511–520 (2008)
Cummings, M.L., Stimpson, A., Clamann, M.: Functional Requirements for Onboard Intelligent Automation in Single Pilot Operations. AIAA 2016-1652. AIAA Infotech @ Aerospace, San Diego (2016)
Chen, J.Y.C., Barnes, M.J., Harper-Sciarini, M.: Humans: still vital after all these years of automation. IEEE Trans. Syst. Man Cybern.—Part C: Appl. Rev. 41, 435–454 (2011)
Endsley, M.R.: From here to autonomy: lessons learned from human–automation research. Hum. Factors 59, 5–27 (2016)
Donmez, B., Pina, P.E., Cummings, M.L.: Evaluation criteria for human-automation performance metrics. In: Madhavan, R., Tunstel, E., Messina, E. (eds.) Performance Evaluation and Benchmarking of Intelligent Systems, pp. 21–40. Springer, Heidelberg (2009)
Birsen, D., Pina, P.E., Cummings, M.L.: Evaluation criteria for human-automation performance metrics. In: Proceedings of the 8th Workshop on Performance Metrics for Intelligent Systems. Gaithersburg, Maryland, pp. 77–82 (2008)
Battiste, V., Bortolussi, M.: Transport pilot workload: a comparison of two subjective techniques. Proc. Hum. Factors Ergon. Soc. Annu. Meet. 32(2), 150–154 (1988)
Salmon, P.M., Stanton, N.A., Walker, G.H., Jenkins, D., Ladva, D., Rafferty, L., Young, M.: Measuring Situation Awareness in complex systems: comparison of measures study. Int. J. Ind. Ergon. 39(3), 490–500 (2009)
Jian, J., Bisantz, A., Drury, C.: Foundations for an empirically determined scale of trust in automated systems. Int. J. Cogn. Ergon. 4, 53–71 (2000)
Dickinson T.L., McIntyre R.M.: A conceptual framework for teamwork measurement. In: Team Performance Assessment and Measurement: Theory, Methods, and Applications, pp. 19–43. Lawrence Erlbaum (1997)
Higham, T., Vu, K.-P., Miles, J., Strybel, T.Z., Battiste, V.: Training air traffic controller trust in automation within a NextGen environment. In: Yamamoto, S. (ed.) HIMI/HCII 2013, Part II. LNCS, pp. 76–84. Springer, Heidelberg (2013)
Hancock, P.A., Billings, D.R., Schaefer, K.E., Chen, J.Y.C., de Visser, E.J., Parasuraman, R.: A meta-analysis of factors affecting trust in automation in human-robot interaction. Hum. Factors 53, 518–527 (2011)
Muir, B.M., Moray, N.: Trust in automation: Part II. Experimental studies of trust and human intervention on a process control simulation. Ergonomics 39, 429–460 (1996)
Acknowledgements
This research was supported by the NASA cooperative agreement #NNA14AB39C “Single Pilot Understanding through Distributed Simulation (SPUDS),” R.J. Shively, Technical Monitor.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG
About this paper
Cite this paper
Strybel, T.Z. et al. (2018). Measuring the Effectiveness of Human Autonomy Teaming. In: Baldwin, C. (eds) Advances in Neuroergonomics and Cognitive Engineering. AHFE 2017. Advances in Intelligent Systems and Computing, vol 586. Springer, Cham. https://doi.org/10.1007/978-3-319-60642-2_3
Download citation
DOI: https://doi.org/10.1007/978-3-319-60642-2_3
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-60641-5
Online ISBN: 978-3-319-60642-2
eBook Packages: EngineeringEngineering (R0)