skip to main content
10.1145/3610661.3620660acmconferencesArticle/Chapter ViewAbstractPublication Pagesicmi-mlmiConference Proceedingsconference-collections
demonstration

HAT3: The Human Autonomy Team Trust Toolkit

Published: 09 October 2023 Publication History

Abstract

Advances in artificial intelligence capabilities in autonomy-enabled systems and robotics have pushed research to address the unique nature of human-autonomy team collaboration. The goals of these advanced technologies are to enable rapid decision making, enhance situation awareness, promote shared understanding, and improve team dynamics. Simultaneously, use of these technologies is expected to reduce risk to those who collaborate with these systems. Yet, for appropriate human- autonomy teaming to take place, especially as we move beyond dyadic partnerships, proper calibration of team trust is needed to effectively coordinate interactions during high-risk operations. To meet this end, multimodal measures of team trust for this new dynamic of human-autonomy teams are needed. This paper provides an overview of the purpose, components, and functionality of the Human-Autonomy Teaming Trust Toolkit (HAT3), which is a multimodal measurement tool for real, and near-real time measures of trust. More specifically, HAT3 is a modular software toolkit capable of measuring and visualizing individual and team-level trust via subjective measures, multiple communication tools, and a forthcoming physiological module.

References

[1]
Anthony L. Baker, Ralph W. Brewer, and Kristin E. Schafer. Development and usability assessment of the realtime event, flow, and coordination tool (REFLECT). CCDC Army Research Laboratory (US); 2020. Report No.: ARL-TR-9012.
[2]
Anthony L. Baker, Sean M. Fitzhugh, Daniel E. Forster, and Kristin E. Schaefer. (2022). Communication metrics for human-autonomy teaming: Lessons learned from US Army gunnery field experiments. In Proc Hum Factors Ergon Soc Annu Meet. 65(1):1157–1161.
[3]
Anthony L. Baker, Sean M. Fitzhugh, Lixiao Huang, Daniel E. Forster, Angelique Scharine, Catherine Neubauer, Glenn Lematta, Shawaiz Bhatti, Craig J. Johnson, Andrea Krausman, Eric Holder, Kristin E. Schaefer, and Nancy J. Cooke (2021). Approaches for assessing communication in human-autonomy teams. Human-Intelligent Systems Integration, 3(2), 99–128.
[4]
Ethan Fast. (2023). Empath. https://github.com/Ejhfast/empath-client
[5]
Andrea Krausman, Catherine Neubauer, Daniel E. Forster, Shan Lakhmani, Anthony L. Baker, Sean M. Fitzhugh, Gregory M. Gremillion, Julia L. Wright, Jason S. Metcalfe, and Kristin E. Schaefer. (2022). Trust measurement in human-autonomy teams: Development of a conceptual toolkit. Trans Hum Robot Interact, 11(3), 1-58.
[6]
Catherine Neubauer, Gregory M. Gremillion, Brandon Perelman, Claire La Fleur, Jason Metcalfe, and Kristin E. Schaefer. Analysis of facial expressions: Explaining affective state and trust-based decisions during interaction with automation. CCDC Army Research Laboratory (US); 2020a. Report No.: ARL-TR-8945.
[7]
Catherine Neubauer, Sean M. Fitzhugh, Anthony L. Baker, Bret Kellihan, Justin Jagielski, and Andrea Krausman. (2022). Human-Autonomy Teaming (HAT3) trust toolkit software development documentation and user guide. Report number ARL-TR-9623. Prepared for DEVCOM Army Research Laboratory.
[8]
Catherine Neubauer, Kristin E. Schaefer, Ashley Oiknine, Steven Thurman, Benjamin Files, Stephen Gordon, Cortney Bradford, Derek Spangler, and Gregory M. Gremillion. Multimodal physiological and behavioral measures to estimate human states and decisions for improved human autonomy teaming. CCDC Army Research Laboratory (US); 2020b. Report No.: ARL-TR-9070.
[9]
Eduardo Salas, Katherine A. Wilson, Carrie E. Murphy, Heidi King, and Mary Salisbury. (2008). Communicating, coordinating, and cooperating when lives depend on it: Tips for teamwork. JT Comm J Qual Patient Safety, 34, 333–341.

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
ICMI '23 Companion: Companion Publication of the 25th International Conference on Multimodal Interaction
October 2023
434 pages
ISBN:9798400703218
DOI:10.1145/3610661
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 09 October 2023

Check for updates

Author Tags

  1. Human-autonomy teaming
  2. Humans in complex systems
  3. Software development
  4. Team trust
  5. Trust measurement

Qualifiers

  • Demonstration
  • Research
  • Refereed limited

Conference

ICMI '23
Sponsor:

Acceptance Rates

Overall Acceptance Rate 453 of 1,080 submissions, 42%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 74
    Total Downloads
  • Downloads (Last 12 months)53
  • Downloads (Last 6 weeks)3
Reflects downloads up to 23 Jan 2025

Other Metrics

Citations

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media