skip to main content
10.1145/3610661.3620660acmconferencesArticle/Chapter ViewAbstractPublication Pagesicmi-mlmiConference Proceedingsconference-collections
demonstration

HAT3: The Human Autonomy Team Trust Toolkit

Published:09 October 2023Publication History

ABSTRACT

Advances in artificial intelligence capabilities in autonomy-enabled systems and robotics have pushed research to address the unique nature of human-autonomy team collaboration. The goals of these advanced technologies are to enable rapid decision making, enhance situation awareness, promote shared understanding, and improve team dynamics. Simultaneously, use of these technologies is expected to reduce risk to those who collaborate with these systems. Yet, for appropriate human- autonomy teaming to take place, especially as we move beyond dyadic partnerships, proper calibration of team trust is needed to effectively coordinate interactions during high-risk operations. To meet this end, multimodal measures of team trust for this new dynamic of human-autonomy teams are needed. This paper provides an overview of the purpose, components, and functionality of the Human-Autonomy Teaming Trust Toolkit (HAT3), which is a multimodal measurement tool for real, and near-real time measures of trust. More specifically, HAT3 is a modular software toolkit capable of measuring and visualizing individual and team-level trust via subjective measures, multiple communication tools, and a forthcoming physiological module.

References

  1. Anthony L. Baker, Ralph W. Brewer, and Kristin E. Schafer. Development and usability assessment of the realtime event, flow, and coordination tool (REFLECT). CCDC Army Research Laboratory (US); 2020. Report No.: ARL-TR-9012.Google ScholarGoogle Scholar
  2. Anthony L. Baker, Sean M. Fitzhugh, Daniel E. Forster, and Kristin E. Schaefer. (2022). Communication metrics for human-autonomy teaming: Lessons learned from US Army gunnery field experiments. In Proc Hum Factors Ergon Soc Annu Meet. 65(1):1157–1161.Google ScholarGoogle ScholarCross RefCross Ref
  3. Anthony L. Baker, Sean M. Fitzhugh, Lixiao Huang, Daniel E. Forster, Angelique Scharine, Catherine Neubauer, Glenn Lematta, Shawaiz Bhatti, Craig J. Johnson, Andrea Krausman, Eric Holder, Kristin E. Schaefer, and Nancy J. Cooke (2021). Approaches for assessing communication in human-autonomy teams. Human-Intelligent Systems Integration, 3(2), 99–128.Google ScholarGoogle ScholarCross RefCross Ref
  4. Ethan Fast. (2023). Empath. https://github.com/Ejhfast/empath-clientGoogle ScholarGoogle Scholar
  5. Andrea Krausman, Catherine Neubauer, Daniel E. Forster, Shan Lakhmani, Anthony L. Baker, Sean M. Fitzhugh, Gregory M. Gremillion, Julia L. Wright, Jason S. Metcalfe, and Kristin E. Schaefer. (2022). Trust measurement in human-autonomy teams: Development of a conceptual toolkit. Trans Hum Robot Interact, 11(3), 1-58.Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Catherine Neubauer, Gregory M. Gremillion, Brandon Perelman, Claire La Fleur, Jason Metcalfe, and Kristin E. Schaefer. Analysis of facial expressions: Explaining affective state and trust-based decisions during interaction with automation. CCDC Army Research Laboratory (US); 2020a. Report No.: ARL-TR-8945.Google ScholarGoogle Scholar
  7. Catherine Neubauer, Sean M. Fitzhugh, Anthony L. Baker, Bret Kellihan, Justin Jagielski, and Andrea Krausman. (2022). Human-Autonomy Teaming (HAT3) trust toolkit software development documentation and user guide. Report number ARL-TR-9623. Prepared for DEVCOM Army Research Laboratory.Google ScholarGoogle Scholar
  8. Catherine Neubauer, Kristin E. Schaefer, Ashley Oiknine, Steven Thurman, Benjamin Files, Stephen Gordon, Cortney Bradford, Derek Spangler, and Gregory M. Gremillion. Multimodal physiological and behavioral measures to estimate human states and decisions for improved human autonomy teaming. CCDC Army Research Laboratory (US); 2020b. Report No.: ARL-TR-9070.Google ScholarGoogle Scholar
  9. Eduardo Salas, Katherine A. Wilson, Carrie E. Murphy, Heidi King, and Mary Salisbury. (2008). Communicating, coordinating, and cooperating when lives depend on it: Tips for teamwork. JT Comm J Qual Patient Safety, 34, 333–341.Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. HAT3: The Human Autonomy Team Trust Toolkit

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      ICMI '23 Companion: Companion Publication of the 25th International Conference on Multimodal Interaction
      October 2023
      434 pages
      ISBN:9798400703218
      DOI:10.1145/3610661

      Copyright © 2023 Owner/Author

      Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 9 October 2023

      Check for updates

      Qualifiers

      • demonstration
      • Research
      • Refereed limited

      Acceptance Rates

      Overall Acceptance Rate453of1,080submissions,42%
    • Article Metrics

      • Downloads (Last 12 months)40
      • Downloads (Last 6 weeks)9

      Other Metrics

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format .

    View HTML Format