Skip to main content
Springer Nature Link
Log in

A Design Pattern for Working Agreements in Human-Autonomy Teaming

  • Conference paper
  • First Online:
Advances in Human Factors in Simulation and Modeling (AHFE 2017)

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 591))

Included in the following conference series:

Abstract

Humans and machines are increasingly reliant upon each other in complex environments and military operations. The near future suggests human understanding of machine counterparts is a required, paradigmatic element. Knowing how to engineer and design for these environments is challenging. The complexity between levels of automation, human information processing, and function allocation authority issues in an adaptive system make it unlikely to find a “one-size-fits-all” approach. There may still be general strategies for engineering in these cases; for example, collaborating and coordinating are familiar requirements of all human team activities, and extend to human-automation teaming. Here, we outline what we believe is one so-called “design pattern” for working agreements. We use the loose structure of prior software design patterns to organize our thoughts on why working agreements are necessary, where and how they are applicable, what instantiating them requires, and how to measure their effectiveness. By choosing the design pattern structure, we end up carefully describing what might work best and what the limits are toward improving human-machine teaming.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Smith, R.: Panel on design methodology. In: OOPSLA 1987 (1987)

    Google Scholar 

  2. Beck, K., Cunningham, W.: Using pattern languages for object-oriented program. In: OOPSLA 1987 (1987)

    Google Scholar 

  3. Gamma, E., Helm, R., Johnson, R., Vlissides, J.: Design Patterns: Elements of Reusable Object-Oriented Software. Addison-Wesley, Boston (1995)

    MATH  Google Scholar 

  4. Lange, D.S., Gutzwiller, R.S.: Human-autonomy teaming patterns in the command and control of teams of autonomous systems. In: HCII 2016 (2016)

    Google Scholar 

  5. Schulte, A., Donath, D., Lange, D.S.: Design patterns for human-cognitive agent teaming. In: Harris, D. (ed.) Engineering Psychology and Cognitive Ergonomics, pp. 231–243. Springer, Cham (2016)

    Google Scholar 

  6. de Greef, T., Arciszewski, H., Neerincx, M.: Adaptive automation based on an object-oriented task model: implementation and evaluation in a realistic C2 environment. J. Cognit. Eng. Decis. Mak. 4(2), 152–182 (2010)

    Article  Google Scholar 

  7. Lützhöft, M.H., Dekker, S.W.A.: On your watch: automation on the bridge. J. Navig. 55(1), 83–96 (2002)

    Article  Google Scholar 

  8. Cuevas, H.M., Fiore, S.M., Caldwell, B.S., Strater, L.: Augmenting team cognition in human-automation teams performing in complex operational environments. Aviat. Space Environ. Med. 78(5), B63–B70 (2007)

    Google Scholar 

  9. Malin, J.T., Schreckenghost, D.L., Woods, D.D., Potter, S.S., Johannesen, L., Holloway, M., Forbus, K.D.: Making intelligent systems team players: case studies and design issues. Volume 1: human-computer interaction design. NASA Technol. Memo. 104738, 1–276 (1991)

    Google Scholar 

  10. Klein, G., Bradshaw, J.M., Feltovich, J.M., Woods, D.D.: Common ground and coordination in joint activity. In: Rouse, W.B., Boff, K.R. (eds.) Organizational Simulation, pp. 139–184. Wiley, Hoboken (2005)

    Chapter  Google Scholar 

  11. Gutzwiller, R.S., Lange, D.S., Reeder, J., Morris, R.L., Rodas, O.: Human-computer collaboration in adaptive supervisory control and function allocation of autonomous system teams. In: Shumaker, R., Lackey, S. (eds.) Virtual, Augmented and Mixed Reality, pp. 447–456. Springer, Cham (2015)

    Chapter  Google Scholar 

  12. Gutzwiller, R.S., Lange, D.S.: Tasking teams: supervisory control and task management of autonomous unmanned systems. In: International Conference on Virtual, Augmented and Mixed Reality, pp. 397–405 (2016)

    Google Scholar 

  13. Sheridan, T.B., Verplank, W.L.: Human and computer control of undersea teleoperators, Man-Machine Syst. Lab, Dep. Mech. Eng. MIT. Grant N00014-77-C-0256 (1978)

    Google Scholar 

  14. Cummings, M., Mastracchio, C., Thornburg, K., Mkrtchyan, A.: Boredom and distraction in multiple unmanned vehicle supervisory control. Interact. Comput. 25(1), 34–47 (2013)

    Article  Google Scholar 

  15. Kaber, D.B.: Adaptive automation. In: Oxford Handbook of Cognitive Engineering. In: Lee, J., Kirlik, A. (eds.) Oxford University Press, Oxford, March 2013

    Google Scholar 

  16. Parasuraman, R., Bahri, T., Deaton, J.E., Morrison, J.G., Barnes, M.: Theory and design of adaptive automation in aviation systems. NAWCADWAR Technical Report-92033-60, pp. 1–44 (1992)

    Google Scholar 

  17. Scerbo, M.W.: Theoretical perspectives on adaptive automation. In: Parasuraman, R., Mouloua, M. (eds.) Automation and Human Performance: Theory and Applications, pp. 37–63. Erlbaum, Mahwah (1996)

    Google Scholar 

  18. Kaber, D.B., Endsley, M.R.: The effects of level of automation and adaptive automation on human performance, situation awareness and workload in a dynamic control task. Theor. Issues Ergon. Sci. 5(2), 113–153 (2004)

    Article  Google Scholar 

  19. Arciszewski, H., de Greef, T., van Delft, J.: Adaptive automation in a naval combat management system. IEEE Trans. Syst. Man Cybern. Part A Syst. Hum. 39(6), 1188–1199 (2009)

    Article  Google Scholar 

  20. Feigh, K., Dorneich, M.C., Hayes, C.C.: Toward a characterization of adaptive systems: a framework for researchers and system designers. Hum. Factors 54(6), 1008–1024 (2012)

    Article  Google Scholar 

  21. Klein, G., Woods, D.D., Bradshaw, J.M., Hoffman, R.R., Feltovich, P.J.: Ten challenges for making automation a team player in joint human-agent activity. IEEE Intell. Syst. 19, 91–95 (2004)

    Article  Google Scholar 

  22. Hollnagel, E., Woods, D.: Joint Cognitive Systems: Foundations of Cognitive Systems Engineering. Taylor & Francis, Boca Raton (2005)

    Book  Google Scholar 

  23. Johnson, A.W., Oman, C.M., Sheridan, T.B., Duda, K.R.: Dynamic task allocation in operational systems: issues, gaps, and recommendations In: IEEE Aerospace Conference, pp. 1–15, March 2014

    Google Scholar 

  24. Lange, D.S., Gutzwiller, R.S., Verbancsics, P., Sin, T.: Task models for human-computer collaboration in supervisory control of teams of autonomous systems. In: International Inter-Disciplinary Conference on Cognitive Methods in Situation Awareness and Decision Support, pp. 97–102 (2014)

    Google Scholar 

  25. Gutzwiller, R.S., Reeder, J.: Human interactive machine learning for trust in teams of autonomous robots. In: IEEE CogSIMA (2017)

    Google Scholar 

  26. Sheridan, T.: Adaptive automation, level of automation, allocation authority, supervisory control, and adaptive control: distinctions and modes of adaptation. IEEE Trans. Syst. Man Cybern. Part A Syst. Hum. 41(4), 662–667 (2011)

    Article  Google Scholar 

  27. Wilson, G., Russell, C.: Performance enhancement in an uninhabited air vehicle task using psychophysiologically determined adaptive aiding. Hum. Factors 49(6), 1005–1018 (2007)

    Article  Google Scholar 

  28. Parasuraman, R., Riley, V.: Humans and automation: use, misuse, disuse, abuse. Hum. Factors 39(2), 230–253 (1997)

    Article  Google Scholar 

  29. Crandall, B.W., Klein, G.A., Hoffman, R.: Working Minds: A Practitioner’s Guide to Cognitive Task Analysis. MIT Press, Cambridge (2006)

    Google Scholar 

  30. Clark, R., Feldon, D., van Merriënboer, J.J.G., Yates, K., Early, S.: Cognitive Task Analysis, vol. 2006 (2006)

    Google Scholar 

  31. Endsley, M.R., Jones, D.: Designing for Situation Awareness: An Approach to Human-Centered Design, 2nd edn. CRC Press, New York (2012)

    Google Scholar 

  32. Pritchett, A.R., Kim, S.Y., Feigh, K.M.: Measuring human-automation function allocation. J. Cogn. Eng. Decis. Mak. 8(1), 52–77 (2013)

    Article  Google Scholar 

  33. Kortum, P.: Usability Assessment: How to Measure the Usability of Products, Services, and Systems. Human Factors and Ergonomics Society, Santa Monica (2016)

    Google Scholar 

  34. Wightman, D.C., Lintern, G.: Part-task training for tracking and manual control. Hum. Factors 27(3), 267–283 (1985)

    Article  Google Scholar 

  35. Naylor, J.C., Briggs, G.E.: Effects of task complexity and task organization on the relative efficiency of part and whole training techniques. J. Exp. Psychol. 65(3), 217–224 (1963)

    Article  Google Scholar 

  36. Gutzwiller, R.S., Clegg, B.A., Blitch, J.G.: Part-task training in the context of automation: current and future directions. Am. J. Psychol. 126(4), 417–432 (2013)

    Article  Google Scholar 

  37. European Organisation for the Safety of Air Navigation: Common Format Letter of Agreement Between Air Traffic Services Unites (ASM.ET1.ST015 DEL01/02 Ed. 4) (2012)

    Google Scholar 

  38. US Department of Transportation Federal Aviation Administration: Air Traffic Organization Policy: Section 3. Letters of Agreement (LOA) (2010)

    Google Scholar 

  39. Federal Aviation Administration Los Angeles ARTCC: Los Angeles Air Route Traffic Control Center, CA, U.S.A; Tijuana Terminal Radar Approach Control: Letter Of Agreement (1990)

    Google Scholar 

  40. US Department of Transportation Federal Aviation Administration: Air Traffic Organization Policy (2015)

    Google Scholar 

  41. Prevot, T., Homola, J., Martin, L., Mercer, J., Cabrall, C.: Toward automated air traffic control—investigating a fundamental paradigm shift in human/systems interaction. Int. J. Hum. Comput. Interact. 28(2), 77–98 (2012)

    Article  Google Scholar 

  42. Mercer, J., Gomez, A., Homola, J., Prevot, T.: A closer look at automation behavior during a human in the loop simulation. In: 33rd IEEE/AIAA Digital Avionics Systems Conference (2014)

    Google Scholar 

Download references

Acknowledgements

The views expressed in this article are the sole views of the authors and do not reflect official policy or the opinions of the US Government or Department of Defense. This work was funded in part by a NISE ONR project from SPAWAR Pacific, and from the Autonomy Research Pilot Initiative IMPACT project.

Author information

Authors and Affiliations

  1. Space and Naval Warfare Systems Center Pacific, 53560 Hull Street, San Diego, CA, 92152, USA

    Robert S. Gutzwiller, Sarah H. Espinosa, Caitlin Kenny & Douglas S. Lange

Authors
  1. Robert S. Gutzwiller
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Sarah H. Espinosa
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Caitlin Kenny
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Douglas S. Lange
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Robert S. Gutzwiller .

Editor information

Editors and Affiliations

  1. RDRL-HRF-D, United States Army, Aberdeen Proving Ground, Maryland, USA

    Daniel N. Cassenti

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG (outside the USA)

About this paper

Cite this paper

Gutzwiller, R.S., Espinosa, S.H., Kenny, C., Lange, D.S. (2018). A Design Pattern for Working Agreements in Human-Autonomy Teaming. In: Cassenti, D. (eds) Advances in Human Factors in Simulation and Modeling. AHFE 2017. Advances in Intelligent Systems and Computing, vol 591. Springer, Cham. https://doi.org/10.1007/978-3-319-60591-3_2

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-60591-3_2

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-60590-6

  • Online ISBN: 978-3-319-60591-3

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics