Kazuhiko Momose
ABSTRACT
Intelligent systems are increasingly interacting with people, both in their daily lives and through their use in safety critical systems. Current research is focused on how to use intelligent systems in a collaborative way as a teammate, rather than a tool. This requires a better understanding of what behaviors enable effective human-agent teams. This paper reports an experiment where a human player collaborates with an agent to perform a maneuvering task while concurrently performing a memory task. The player must determine in which contexts the agent requires their input to achieve better combined game plus memory task accuracy scores. We hypothesized that high-performing teams would exhibit different patterns of control inputs when compared to low-performing teams and that these patterns of control would be made more evident with user interfaces that increased operator situation awareness. Preliminary results are inconclusive, but show different patterns of interaction between high- and low-performing teams.
Footnotes
1 The game was built on [26], and some of the icons used in the game were downloaded from https://icons8.com and https://imgbin.com/ [accessed on 03/13/2023]
Footnote
Supplemental Material
- Michael E Bratman. 1992. Shared cooperative activity. The philosophical review 101, 2 (1992), 327–341.Google Scholar
- Abhizna Butchibabu, Christopher Sparano-Huiban, Liz Sonenberg, and Julie Shah. 2016. Implicit coordination strategies for effective team communication. Human factors 58, 4 (2016), 595–610.Google Scholar
- Erin K Chiou, Mustafa Demir, Verica Buchanan, Christopher C Corral, Mica R Endsley, Glenn J Lematta, Nancy J Cooke, and Nathan J McNeese. 2021. Towards Human–Robot Teaming: Tradeoffs of Explanation-Based Communication Strategies in a Virtual Search and Rescue Task. International Journal of Social Robotics (2021), 1–20.Google Scholar
- Erin K Chiou, John D Lee, and Tianshuo Su. 2019. Negotiated and reciprocal exchange structures in human-agent cooperation. Computers in Human Behavior 90 (2019), 288–297.Google ScholarCross Ref
- Nazli Cila. 2022. Designing Human-Agent Collaborations: Commitment, responsiveness, and support. In CHI Conference on Human Factors in Computing Systems. 1–18.Google ScholarDigital Library
- Sylvain Daronnat, Leif Azzopardi, Martin Halvey, and Mateusz Dubiel. 2020. Impact of agent reliability and predictability on trust in real time human-agent collaboration. In Proceedings of the 8th International Conference on Human-Agent Interaction. 131–139.Google ScholarDigital Library
- Dániel András Drexler, Árpád Takács, Tamás Dániel Nagy, Péter Galambos, Imre J. Rudas, and Tamás Haidegger. 2019. Situation Awareness and System Trust Affecting Handover Processes in Self-Driving Cars up to Level 3 Autonomy. In 2019 IEEE International Work Conference on Bioinspired Intelligence (IWOBI). 000179–000184. https://doi.org/10.1109/IWOBI47054.2019.9114533Google ScholarCross Ref
- Lisa A Elkin, Matthew Kay, James J Higgins, and Jacob O Wobbrock. 2021. An aligned rank transform procedure for multifactor contrast tests. In The 34th Annual ACM Symposium on User Interface Software and Technology. 754–768.Google ScholarDigital Library
- Mica R Endsley. 2022. Supporting Human-AI Teams: Transparency, explainability, and situation awareness. Computers in Human Behavior (2022), 107574.Google Scholar
- Franz Faul, Edgar Erdfelder, Axel Buchner, and Albert-Georg Lang. 2009. Statistical power analyses using G* Power 3.1: Tests for correlation and regression analyses. Behavior research methods 41, 4 (2009), 1149–1160.Google Scholar
- Paul M Fitts. 1951. Human engineering for an effective air-navigation and traffic-control system. (1951).Google Scholar
- Frank Flemisch, Johann Kelsch, Christan Löper, Anna Schieben, Julian Schindler, and Matthias Heesen. 2008. Cooperative control and active interfaces for vehicle assitsance and automation. (2008).Google Scholar
- Sarah Friedrich, Frank Konietschke, and Markus Pauly. 2019. Resampling-based analysis of multivariate data and repeated measures designs with the R package MANOVA. RM.R J. 11, 2 (2019), 380.Google Scholar
- Sandra G Hart. 2006. NASA-task load index (NASA-TLX); 20 years later. In Proceedings of the human factors and ergonomics society annual meeting, Vol. 50. Sage publications Sage CA: Los Angeles, CA, 904–908.Google ScholarCross Ref
- Sandra G Hart and Lowell E Staveland. 1988. Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. In Advances in psychology. Vol. 52. Elsevier, 139–183.Google Scholar
- Robert R Hoffman, Shane T Mueller, Gary Klein, and Jordan Litman. 2018. Metrics for explainable AI: Challenges and prospects. arXiv preprint arXiv:1812.04608 (2018).Google Scholar
- SAE International. 2021. Taxonomy and Definitions for Terms Related to Driving Automation Systems for On-Road Motor Vehicles J3016_202104.Google Scholar
- Matthew Johnson, Jeffrey M Bradshaw, Paul J Feltovich, Catholijn M Jonker, M Birna Van Riemsdijk, and Maarten Sierhuis. 2014. Coactive design: Designing support for interdependence in joint activity. Journal of Human-Robot Interaction 3, 1 (2014), 43–69.Google ScholarDigital Library
- Matthew Johnson and Alonso Vera. 2019. No AI is an island: the case for teaming intelligence. AI magazine 40, 1 (2019), 16–28.Google Scholar
- Claire Liang, Julia Proft, Erik Andersen, and Ross A Knepper. 2019. Implicit communication of actionable information in human-ai teams. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1–13.Google ScholarDigital Library
- Joseph B Lyons, Katia Sycara, Michael Lewis, and August Capiola. 2021. Human–autonomy teaming: Definitions, debates, and directions. Frontiers in Psychology (2021), 1932.Google ScholarCross Ref
- Carl Macrae. 2021. Learning from the Failure of Autonomous and Intelligent Systems: Accidents, Safety, and Sociotechnical Sources of Risk. Risk Analysis 42 (2021).Google Scholar
- Nathan J McNeese, Mustafa Demir, Nancy J Cooke, and Christopher Myers. 2018. Teaming with a synthetic teammate: Insights into human-autonomy teaming. Human factors 60, 2 (2018), 262–273.Google Scholar
- Faiz Siddiqui, Rachel Lerman, and Jeremy B. Merrill. 2022. Telsas running Autopilot involved in 273 crashes reported since last year. The Washington Post (2022). https://www.washingtonpost.com/technology/2022/06/15/tesla-autopilot-crashes/Google Scholar
- DJ Strouse, Kevin McKee, Matt Botvinick, Edward Hughes, and Richard Everett. 2021. Collaborating with humans without human data. Advances in Neural Information Processing Systems 34 (2021), 14502–14515.Google Scholar
- tblazevic. 2022. Moonlander. https://github.com/tblazevic/moonlanderGoogle Scholar
- R Core Team 2013. R: A language and environment for statistical computing. (2013).Google Scholar
- Nikolai von Janczewski, Jennifer Wittmann, Arnd Engeln, Martin Baumann, and Lutz Krauß. 2021. A meta-analysis of the n-back task while driving and its effects on cognitive workload. Transportation research part F: traffic psychology and behaviour 76 (2021), 269–285.Google Scholar
- Jacob O Wobbrock, Leah Findlater, Darren Gergle, and James J Higgins. 2011. The aligned rank transform for nonparametric factorial analyses using only anova procedures. In Proceedings of the SIGCHI conference on human factors in computing systems. 143–146.Google ScholarDigital Library
- Wei Xu. 2020. From automation to autonomy and autonomous vehicles: Challenges and opportunities for human-computer interaction. Interactions 28, 1 (2020), 48–53.Google ScholarDigital Library
Index Terms
- Patterns of Effective Human-Agent Teams
Recommendations
Comparing Human Trust Attitudes Towards Human and Agent Teammates
HAI '20: Proceedings of the 8th International Conference on Human-Agent InteractionAgents' roles in our lives increasingly matter as they engage with people in a variety of important tasks. To achieve successful human-agent teamwork, it is critical to know the differences and similarities in people's attitudes towards human and agent ...
Reputation Based Trust In Human-Agent Teamwork Without Explicit Coordination
HAI '18: Proceedings of the 6th International Conference on Human-Agent InteractionInteracting with strangers and agents through computer networks has become a routine aspect of our daily lives. In such environments, reputation plays a critical role in determining our future interactions and satisfaction derived from them. This paper ...
Agent-based support for human/agent teams
CHI EA '00: CHI '00 Extended Abstracts on Human Factors in Computing SystemsIn this paper, we present an interface agent, MokSAF, which facilitates time-critical team-planning tasks for teams of both humans and heterogeneous software agents. This agent assists in the formation of teams of humans (via other MokSAF agents) and ...
Comments