ABSTRACT
Advances in artificial intelligence capabilities in autonomy-enabled systems and robotics have pushed research to address the unique nature of human-autonomy team collaboration. The goals of these advanced technologies are to enable rapid decision making, enhance situation awareness, promote shared understanding, and improve team dynamics. Simultaneously, use of these technologies is expected to reduce risk to those who collaborate with these systems. Yet, for appropriate human- autonomy teaming to take place, especially as we move beyond dyadic partnerships, proper calibration of team trust is needed to effectively coordinate interactions during high-risk operations. To meet this end, multimodal measures of team trust for this new dynamic of human-autonomy teams are needed. This paper provides an overview of the purpose, components, and functionality of the Human-Autonomy Teaming Trust Toolkit (HAT3), which is a multimodal measurement tool for real, and near-real time measures of trust. More specifically, HAT3 is a modular software toolkit capable of measuring and visualizing individual and team-level trust via subjective measures, multiple communication tools, and a forthcoming physiological module.
- Anthony L. Baker, Ralph W. Brewer, and Kristin E. Schafer. Development and usability assessment of the realtime event, flow, and coordination tool (REFLECT). CCDC Army Research Laboratory (US); 2020. Report No.: ARL-TR-9012.Google Scholar
- Anthony L. Baker, Sean M. Fitzhugh, Daniel E. Forster, and Kristin E. Schaefer. (2022). Communication metrics for human-autonomy teaming: Lessons learned from US Army gunnery field experiments. In Proc Hum Factors Ergon Soc Annu Meet. 65(1):1157–1161.Google ScholarCross Ref
- Anthony L. Baker, Sean M. Fitzhugh, Lixiao Huang, Daniel E. Forster, Angelique Scharine, Catherine Neubauer, Glenn Lematta, Shawaiz Bhatti, Craig J. Johnson, Andrea Krausman, Eric Holder, Kristin E. Schaefer, and Nancy J. Cooke (2021). Approaches for assessing communication in human-autonomy teams. Human-Intelligent Systems Integration, 3(2), 99–128.Google ScholarCross Ref
- Ethan Fast. (2023). Empath. https://github.com/Ejhfast/empath-clientGoogle Scholar
- Andrea Krausman, Catherine Neubauer, Daniel E. Forster, Shan Lakhmani, Anthony L. Baker, Sean M. Fitzhugh, Gregory M. Gremillion, Julia L. Wright, Jason S. Metcalfe, and Kristin E. Schaefer. (2022). Trust measurement in human-autonomy teams: Development of a conceptual toolkit. Trans Hum Robot Interact, 11(3), 1-58.Google ScholarDigital Library
- Catherine Neubauer, Gregory M. Gremillion, Brandon Perelman, Claire La Fleur, Jason Metcalfe, and Kristin E. Schaefer. Analysis of facial expressions: Explaining affective state and trust-based decisions during interaction with automation. CCDC Army Research Laboratory (US); 2020a. Report No.: ARL-TR-8945.Google Scholar
- Catherine Neubauer, Sean M. Fitzhugh, Anthony L. Baker, Bret Kellihan, Justin Jagielski, and Andrea Krausman. (2022). Human-Autonomy Teaming (HAT3) trust toolkit software development documentation and user guide. Report number ARL-TR-9623. Prepared for DEVCOM Army Research Laboratory.Google Scholar
- Catherine Neubauer, Kristin E. Schaefer, Ashley Oiknine, Steven Thurman, Benjamin Files, Stephen Gordon, Cortney Bradford, Derek Spangler, and Gregory M. Gremillion. Multimodal physiological and behavioral measures to estimate human states and decisions for improved human autonomy teaming. CCDC Army Research Laboratory (US); 2020b. Report No.: ARL-TR-9070.Google Scholar
- Eduardo Salas, Katherine A. Wilson, Carrie E. Murphy, Heidi King, and Mary Salisbury. (2008). Communicating, coordinating, and cooperating when lives depend on it: Tips for teamwork. JT Comm J Qual Patient Safety, 34, 333–341.Google ScholarCross Ref
Index Terms
- HAT3: The Human Autonomy Team Trust Toolkit
Recommendations
Let's Think Together! Assessing Shared Mental Models, Performance, and Trust in Human-Agent Teams
GROUPAn emerging research agenda in Computer-Supported Cooperative Work focuses on human-agent teaming and AI agent's roles and effects in modern teamwork. In particular, one understudied key question centers around the construct of team cognition within ...
Trust Measurement in Human-Autonomy Teams: Development of a Conceptual Toolkit
The rise in artificial intelligence capabilities in autonomy-enabled systems and robotics has pushed research to address the unique nature of human-autonomy team collaboration. The goal of these advanced technologies is to enable rapid decision-making, ...
A Model of Team Trust in Human-Agent Teams
ICMI '20 Companion: Companion Publication of the 2020 International Conference on Multimodal InteractionTrust is a central element for effective teamwork and successful human-technology collaboration. Although technologies, such as agents, are increasingly becoming autonomous team members operating alongside humans, research on team trust in human-agent ...
Comments