research-article

Comparing Human Trust Attitudes Towards Human and Agent Teammates

Authors:

Feyza Merve Hafızoğlu,

Sandip SenAuthors Info & Claims

HAI '20: Proceedings of the 8th International Conference on Human-Agent Interaction

Pages 50 - 59

https://doi.org/10.1145/3406499.3415082

Published: 10 November 2020 Publication History

Abstract

Agents' roles in our lives increasingly matter as they engage with people in a variety of important tasks. To achieve successful human-agent teamwork, it is critical to know the differences and similarities in people's attitudes towards human and agent teammates in virtual environments. It is unclear to what extent we can rely on the rich literature on interpersonal trust, i.e., trust between humans, while designing trustworthy agent teammates for human-agent teamwork and constructing hypotheses for human-agent trust research. This study empirically investigates the differences in the growth of human trust in and reliance on human and agent teammates during initial interactions. We developed a team coordination game, the Game of Trust, in which two players repeatedly cooperate to complete team tasks without prior assignment of subtasks. The effects of teammate type, i.e., human vs. agent, are evaluated by performing an extensive set of controlled experiments with participants recruited from Amazon Mechanical Turk. We collect both teamwork performance data as well as surveys to gauge participants' trust in their teammates. The empirical results show that humans' trust attitudes towards human and agent teammates differ: trust in and reliance on teammate and team performance were slightly higher when playing with the agent teammate. Moreover, the level of trustworthiness of a teammate is more influential on human trust compared to teammate type. These findings enhance our understanding of changes in human trust concerning teammate type towards achieving successful virtual teamwork.

References

[1]

Alper Alan, Enrico Costanza, Joel Fischer, Sarvapali Ramchurn, Tom Rodden, and Nicholas R. Jennings. 2014. A field study of human-agent interaction for electricity tariff switching. In Proceedings of the 13th International Conference on Autonomous Agents and Multi-Agent Systems (AAMAS2014). 965--972.

[2]

Dimitrios Antos, Celso de Melo, Jonathan Gratch, and Barbara Grosz. 2011. The influence of emotion expression on perceptions of trustworthiness in negotiation. In Proceedings of the Twenty-Fifth AAAI Conference on Artificial Intelligence (AAAI-11). San Francisco, CA, 772--778.

Digital Library

[3]

Benoit A. Aubert and Barbara L. Kelsey. 2003. Further Understanding of Trust and Performance in Virtual Teams. Small Group Research, Vol. 34, 5 (October 2003), 575--618.

[4]

Amos Azaria, Zinovi Rabinovich, Sarit Kraus, Claudia V. Goldman, and Omer Tsimhoni. 2012. Giving Advice to People in Path Selection Problems. In Proceedings of the 11th International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2012), Conitzer, Winikoff, Padgham, and van der Hoek (Eds.). International Foundation for Autonomous Agents and Multiagent Systems, 459--466.

Digital Library

[5]

Thomas Baumgartner, Markus Heinrichs, Aline Vonlanthen, Urs Fischbacher, and Ernst Fehr. 2008. Oxytocin Shapes the Neural Circuitry of Trust and Trust Adaptation in Humans. Neuron, Vol. 58, 4 (May 2008), 639--650.

[6]

Gary Bente, Odile Baptist, and Haug Leuschner. 2012. To buy or not to buy: Influence of seller photos and reputation on buyer trust and purchase behavior. International Journal of Human-Computer Studies, Vol. 70, 1 (2012), 1--13.

Digital Library

[7]

Moshe Bitan, Ya'akov Gal, Sarit Kraus, Elad Dokow, and Amos Azaria. 2013. Social Rankings in Human-Computer Committees. In AAAI Conference on Artificial Intelligence. 116--122.

Digital Library

[8]

Grant Blank and William H. Dutton. 2012. Age and Trust in the Internet: The Centrality of Experience and Attitudes Toward Technology in Britain. Social Science Computer Review, Vol. 30, 2 (2012), 135--151.

Digital Library

[9]

Cody Buntain and Jennifer Golbeck. 2014. Trust Transfer Between Contexts.

[10]

E. Chan and P. Vorderer. 2006. Massively multiplayer online games. In Playing computer games: Motives, responses, and consequences, P. Vorderer and J. Bryant (Eds.). Lawrence Erlbaum Associates Publishers, Mahwah, NJ, US, 77--88.

[11]

Ying-Hueih Chen, Shu-Hua Chien, Jyh-Jeng Wu, and Pei-Yin Tsai. 2010. Impact of Signals and Experience on Trust and Trusting Behavior. Cyberpsychology, Behavior, and Social Networking, Vol. 13, 5 (October 2010), 539--546.

[12]

Celso de Melo, Peter Carnevale, and Jonathan Gratch. 2014. Social Categorization and Cooperation between Humans and Computers. In The Annual Meeting of The Cognitive Science Society (CogSci'14). 2109--2114.

[13]

Ewart J. de Visser, Frank Krueger, Patrick McKnight, Steven Scheid, Melissa Smith, Stephanie Chalk, and Raja Parasuraman. 2012. The World is not Enough: Trust in Cognitive Agents. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, Vol. 56, 1 (September 2012), 263--267.

[14]

Hongying Du and M.N. Huhns. 2013. Determining the Effect of Personality Types on Human-Agent Interactions. In Web Intelligence (WI) and Intelligent Agent Technologies (IAT), 2013 IEEE/WIC/ACM International Joint Conferences on. 239--244.

[15]

Jennifer R. Dunn and Maurice E Schweitzer. 2005. Feeling and Believing: The Influence of Emotion on Trust. Journal of Personality and Social Psychology, Vol. 88, 5 (May 2005), 736--748.

[16]

William H. Dutton and Adrian Shepherd. 2006. Trust in the Internet as an experience technology. Information, Communication & Society, Vol. 9, 4 (November 2006), 433--451.

[17]

Xiaocong Fan, Sooyoung Oh, Michael McNeese, John Yen, Haydee Cuevas, Laura Strater, and Mica R. Endsley. 2008. The Influence of Agent Reliability on Trust in Human-agent Collaboration. In Proceedings of the 15th European Conference on Cognitive Ergonomics: The Ergonomics of Cool Interaction. ACM, New York, NY, USA, 1--8.

[18]

Chris Frith and Uta Frith. 2005. Theory of mind. Current Biology, Vol. 15, 17 (2005), R644--R645.

[19]

Mark A. Fuller, Mark A. Serva, and John "Skip" Benamati. 2007. Seeing Is Believing: The Transitory Influence of Reputation Information on E-Commerce Trust and Decision Making. Decision Sciences, Vol. 38, 4 (2007), 675--699.

[20]

Patrick Gebhard, Tobias Baur, Ionut Damian, Gregor Mehlmann, Johannes Wagner, and Elisabeth André. 2014. Exploring Interaction Strategies for Virtual Characters to Induce Stress in Simulated Job Interviews. In Proceedings of the 2014 International Conference on Autonomous Agents and Multi-agent Systems. International Foundation for Autonomous Agents and Multiagent Systems, Richland, SC, 661--668.

Digital Library

[21]

Alyssa Glass, Deborah L. McGuinness, and Michael Wolverton. 2008. Toward Establishing Trust in Adaptive Agents. In Proceedings of the 13th International Conference on Intelligent User Interfaces. ACM, New York, NY, USA, 227--236.

Digital Library

[22]

Feyza Merve Hafizoglu and Sandip Sen. 2018. The effects of past experience on trust in repeated human-agent teamwork. In Proceedings of the 17th International Conference on Autonomous Agents and MultiAgent Systems. 514--522.

[23]

Galit Haim, Yaakov Kobi Gal, Sarit Kraus, and Michele Gelfand. 2012. A Cultural Sensitive Agent for Human-Computer Negotiation. In Proceedings of the 11th International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2012), Conitzer, Winikoff, Padgham, and van der Hoek (Eds.). International Foundation for Autonomous Agents and Multiagent Systems, Valencia, Spain, 451--458.

Digital Library

[24]

Nader Hanna and Deborah Richards. 2014. "Building a Bridge": Communication, Trust and Commitment in Human-Intelligent Virtual Agent Teams. In HAIDM Workshop at the Autonomous Agents and Multiagent Systems (AAMAS'14).

[25]

Sebastian Hergeth, Lutz Lorenz, and Josef F. Krems. 2017. Prior Familiarization With Takeover Requests Affects Drivers? Takeover Performance and Automation Trust. Human Factors, Vol. 59, 3 (May 2017), 457--470.

[26]

Kevin Anthony Hoff and Masooda Bashir. 2015. Trust in Automation: Integrating Empirical Evidence on Factors That Influence Trust. Human Factors, Vol. 57, 3 (May 2015), 407--434.

[27]

Daniel Johnson, Peta Wyeth, Madison Clark, and Christopher Watling. 2015. Cooperative Game Play with Avatars and Agents: Differences in Brain Activity and the Experience of Play. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 3721--3730.

Digital Library

[28]

Gareth R. Jones and Jennifer M. George. 1998. The Experience and Evolution of Trust: Implications for Cooperation and Teamwork. The Academy of Management Review, Vol. 23, 3 (July 1998).

[29]

Aniket Kittur, Jeffrey V Nickerson, Michael Bernstein, Elizabeth Gerber, Aaron Shaw, John Zimmerman, Matt Lease, and John Horton. 2013. The future of crowd work. In Proceedings of the 2013 conference on Computer supported cooperative work. ACM, 1301--1318.

Digital Library

[30]

S. Komiak, Weiquan Wang, and I. Benbasat. 2005. Comparing Customer Trust in Virtual Salespersons With Customer Trust in Human Salespersons. In System Sciences, 2005. HICSS '05. Proceedings of the 38th Annual Hawaii International Conference on. 175a--175a.

[31]

Sherrie Y. X. Komiak and Izak Benbasat. 2006. The Effects of Personalization and Familiarity on Trust and Adoption of Recommendation Agents. MIS Quarterly, Vol. 30, 4 (December 2006), 941--960.

Digital Library

[32]

Sohye Lim and Byron Reeves. 2010. Computer agents vs avatars: Responses to interactive game characters controlled by a computer or other player. International Journal of Human-Computer Studies, Vol. 68, 1--2 (September 2010), 57--68.

Digital Library

[33]

Jr. Lount, R. B. 2010. The impact of positive mood on trust in interpersonal and intergroup interactions. Journal of Personality and Social Psychology, Vol. 98, 3 (2010), 420--433.

[34]

Dietrich Manzey, Juliane Reichenbach, and Linda Onnasch. 2012. Human Performance Consequences of Automated Decision Aids: The Impact of Degree of Automation and System Experience. Journal of Cognitive Engineering and Decision Making, Vol. 6 (January 2012), 57--87.

[35]

Roger C. Mayer, James H. Davis, and F. David Schoorman. 1995. An Integrative Model of Organizational Trust. The Academy of Management Review, Vol. 20, 3 (July 1995), 709--734.

[36]

Daniel J. McAllister. 1995. Affect- and Cognition-Based Trust as Foundations for Interpersonal Cooperation in Organizations. Academy of Management Journal, Vol. 38, 1 (February 1995), 24--59.

[37]

Kevin McCabe, Daniel Houser, Lee Ryan, Vernon Smith, and Theodore Trouard. 2001. A functional imaging study of cooperation in two-person reciprocal exchange. Proceedings of the National Academy of Sciences, Vol. 98, 20 (September 2001), 11832--11835.

[38]

Stephanie M. Merritt, Heather Heimbaugh, Jennifer LaChapell, and Deborah Lee. 2013. I Trust It, but I Don't Know Why Effects of Implicit Attitudes Toward Automation on Trust in an Automated System. Human Factors: The Journal of the Human Factors and Ergonomics Society, Vol. 55, 3 (June 2013), 520--534.

[39]

Tim Robert Merritt, Kian Boon Tan, Christopher Ong, Aswin Thomas Abraham, Teong Leong Chuah, and Kevin McGee. 2011. Are artificial team-mates scapegoats in computer games?. In Proceedings of the 2011 ACM Conference on Computer Supported Cooperative Work, CSCW. ACM, 685--688.

Digital Library

[40]

Clifford Nass, B.J. Fogg, and Youngme Moon. 1996. Can computers be teammates? International Journal of Human-Computer Studies, Vol. 45, 6 (April 1996), 669--678.

Digital Library

[41]

Clifford Nass, Jonathan Steuer, and Ellen R. Tauber. 1994. Computers are Social Actors. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 72--78.

[42]

Florian Nothdurft, Tobias Heinroth, and Wolfgang Minker. 2013. The Impact of Explanation Dialogues on Human-Computer Trust. In Human-Computer Interaction. Users and Contexts of Use, Masaaki Kurosu (Ed.). Springer Berlin Heidelberg, 59--67.

[43]

Christopher Ong, Kevin McGee, and Teong Leong Chuah. 2012. Closing the human-AI Team-mate Gap: How Changes to Displayed Information Impact Player Behavior Towards Computer Teammates. In Proceedings of the 24th Australian Computer-Human Interaction Conference. ACM, New York, NY, USA, 433--439.

Digital Library

[44]

R. Pak, N. Fink, M. Price, B. Bass, and L. Sturre. 2012. Decision support aids with anthropomorphic characteristics influence trust and performance in younger and older adults. Ergonomics, Vol. 55, 9 (July 2012), 1059--1072.

[45]

Noam Peled, Ya'akov (Kobi) Gal, and Sarit Kraus. 2013. An Agent Design for Repeated Negotiation and Information Revelation with People. In Proceedings of the Twenty-Seventh AAAI Conference on Artificial Intelligence. Association for the Advancement of Artificial Intelligence, 789--795.

[46]

Paul Robinette, Alan R. Wagner, and Ayanna M. Howard. 2013. Building and Maintaining Trust Between Humans and Guidance Robots in an Emergency. In AAAI Spring Symposium: Trust and Autonomous Systems. Stanford, CA, 78--83.

[47]

Sandip Sen. 2013. A Comprehensive Approach to Trust Management. In Proceedings of the Twelfth International Conference on Autonomous Agents and Multiagent Systems. Saint Paul, Minnesota, USA, 797--800.

Digital Library

[48]

Daniel B. Shank. 2012. Perceived Justice and Reactions to Coercive Computers. Sociological Forum, Vol. 27, 2 (June 2012), 372--391.

[49]

C.K. Stokes, J.B. Lyons, K. Littlejohn, J. Natarian, E. Case, and N. Speranza. 2010. Accounting for the human in cyberspace: Effects of mood on trust in automation. In Collaborative Technologies and Systems (CTS), 2010 International Symposium on. 180--187.

[50]

Piotr Sztompka. 1999. Trust: A Sociological Theory. Cambridge University Press, Cambridge, UK.

[51]

A. van Wissen, Y. Gal, B.A. Kamphorst, and M. V. Dignum. 2012. Human-agent teamwork in dynamic environments. Computers in Human Behavior, Vol. 28, 1 (2012), 23--33.

Digital Library

[52]

Arlette van Wissen, Jurriaan van Diggelen, and Virginia Dignum. 2009. The Effects of Cooperative Agent Behavior on Human Cooperativeness. In Proceedings of eighth International Confefence on Autonomous Agents and Multiagent Systems (AAMAS 2009). 1179--1180.

[53]

Frank Verberne, Jaap Ham, and Cees J. H. Midden. 2012. Trust in Smart Systems: Sharing Driving Goals and Giving Information to Increase Trustworthiness and Acceptability of Smart Systems in Cars. Human Factors: The Journal of the Human Factors and Ergonomics Society, Vol. 54, 5 (May 2012), 799--810.

[54]

Frank M. F. Verberne, Jaap Ham, and Cees J. H. Midden. 2014. Familiar faces: Trust in a facially similar agent. In HAIDM Workshop at the Autonomous Agents and Multiagent Systems (AAMAS'14).

[55]

Astrid M. von der Putten, Nicole C. Kramer, Jonathan Gratch, and Sin-Hwa Kang. 2010. "It Doesn't Matter What You Are!" Explaining Social Effects of Agents and Avatars. Computers in Human Behavior, Vol. 26, 6 (July 2010), 1641--1650.

Digital Library

[56]

Robert A. Wagner and Michael J. Fischer. 1974. The String-to-String Correction Problem. J. ACM, Vol. 21, 1 (January 1974), 168--173.

Digital Library

Cited By

Falcão Filho H(2024)Making sense of negotiation and AI: The blossoming of a new collaborationInternational Journal of Commerce and Contracting10.1177/205556362412692708:1-2(44-64)Online publication date: 12-Sep-2024
https://doi.org/10.1177/20555636241269270
Maehigashi ATsumura TYamada S(2022)Experimental Investigation of Trust in Anthropomorphic Agents as Task PartnersProceedings of the 10th International Conference on Human-Agent Interaction10.1145/3527188.3563921(302-305)Online publication date: 5-Dec-2022
https://dl.acm.org/doi/10.1145/3527188.3563921

Index Terms

Comparing Human Trust Attitudes Towards Human and Agent Teammates
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Empirical studies in HCI

Recommendations

Reputation Based Trust In Human-Agent Teamwork Without Explicit Coordination
HAI '18: Proceedings of the 6th International Conference on Human-Agent Interaction

Interacting with strangers and agents through computer networks has become a routine aspect of our daily lives. In such environments, reputation plays a critical role in determining our future interactions and satisfaction derived from them. This paper ...
Understanding the Influences of Past Experience on Trust in Human-agent Teamwork
Special Section on Trust and AI and Regular Papers

People use the knowledge acquired from past experiences in assessing the trustworthiness of a trustee. In a time where the agents are being increasingly accepted as partners in collaborative efforts and activities, it is critical to understand all ...
The Effects of Past Experience on Trust in Repeated Human-Agent Teamwork
AAMAS '18: Proceedings of the 17th International Conference on Autonomous Agents and MultiAgent Systems

For human-agent virtual ad hoc teams to be effective, humans must be able to trust their agent counterparts. To earn the human's trust, agents need to quickly develop an understanding of the expectation of human team members and adapt accordingly. This ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

HAI '20: Proceedings of the 8th International Conference on Human-Agent Interaction

November 2020

304 pages

ISBN:9781450380546

DOI:10.1145/3406499

General Chairs:
Mohammad Obaid
Chalmers University of Technology, Sweden
,
Omar Mubin
Western Sydney University, Australia
,
Yukie Nagai
The University of Tokyo, Japan
,
Program Chairs:
Hirotaka Osawa
University of Tsukuba, Japan
,
Yomna Abdelrahman
Bundeswehr University Munich, Germany
,
Morten Fjeld
Chalmers University of Technology, Sweden

Copyright © 2020 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 10 November 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

HAI '20

Sponsor:

SIGCHI

HAI '20: 8th International Conference on Human-Agent Interaction

November 10 - 13, 2020

Virtual Event, USA

Acceptance Rates

Overall Acceptance Rate 121 of 404 submissions, 30%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
207
Total Downloads

Downloads (Last 12 months)16
Downloads (Last 6 weeks)1

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Falcão Filho H(2024)Making sense of negotiation and AI: The blossoming of a new collaborationInternational Journal of Commerce and Contracting10.1177/205556362412692708:1-2(44-64)Online publication date: 12-Sep-2024
https://doi.org/10.1177/20555636241269270
Maehigashi ATsumura TYamada S(2022)Experimental Investigation of Trust in Anthropomorphic Agents as Task PartnersProceedings of the 10th International Conference on Human-Agent Interaction10.1145/3527188.3563921(302-305)Online publication date: 5-Dec-2022
https://dl.acm.org/doi/10.1145/3527188.3563921

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten