Skip to main content

The Effect of Group Membership, System Reliability and Anthropomorphic Appearance on User’s Trust in Intelligent Decision Support System

  • Conference paper
  • First Online:
Book cover Engineering Psychology and Cognitive Ergonomics. Cognition and Design (HCII 2020)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 12187))

Included in the following conference series:

Abstract

Past studies have found that the in-group membership of an intelligent agent can improve users’ trust. We explored whether such an effect depends on system reliability levels and anthropomorphic appearance. We manipulated reliability levels (95%, 70%, 45%) and anthropomorphic appearance (human-like vs. computer-like appearance) of an intelligent decision support system in our study. The minimum group paradigm was adopted to manipulate the group membership of the intelligent system (in-group vs out-group). We measured trust by using both subjective rating and compliant behaviors toward the system recommendations. The results showed that the intelligent system with an in-group membership resulted in higher trust as compared to the system with an out-group membership. The magnitude of these effects did not differ across different reliability levels and anthropomorphic appearances. We discussed such findings in light of human-robot interaction theories and potential implications for designing trustworthy decision support system.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Lee, J.D., See, K.A.: Trust in automation: designing for appropriate reliance. Hum. Factors 46(1), 50–80 (2004)

    Article  Google Scholar 

  2. Park, E., Jenkins, Q., Jiang, X.: Measuring trust of human operators in new generation rescue robots. Paper presented at the proceedings of the JFPS international symposium on fluid power (2008)

    Google Scholar 

  3. Freedy, A., DeVisser, E., Weltman, G., Coeyman, N.: Measurement of trust in human-robot collaboration. In: 2007 International Symposium on Collaborative Technologies and Systems, pp. 106–114. IEEE, May 2007

    Google Scholar 

  4. Chavaillaz, A., Wastell, D., Sauer, J.: System reliability, performance and trust in adaptable automation. Appl. Ergon. 52, 333–342 (2016)

    Article  Google Scholar 

  5. Ross, J.M., Szalma, J.L., Hancock, P.A., Barnett, J.S., Taylor, G.: The effect of automation reliability on user automation trust and reliance in a search-and-rescue scenario. Paper presented at the proceedings of the human factors and ergonomics society annual meeting (2008)

    Google Scholar 

  6. de Vries, P., Midden, C., Bouwhuis, D.: The effects of errors on system trust, self-confidence, and the allocation of control in route planning. Int. J. Hum. Comput. Stud. 58(6), 719–735 (2003)

    Article  Google Scholar 

  7. Dzindolet, M.T., Peterson, S.A., Pomranky, R.A., Pierce, L.G., Beck, H.P.: The role of trust in automation reliance. Int. J. Hum. Comput. Stud. 58(6), 697–718 (2003)

    Article  Google Scholar 

  8. Schaefer, K.E., Chen, J.Y., Szalma, J.L., Hancock, P.A.: A meta-analysis of factors influencing the development of trust in automation: implications for understanding autonomy in future systems. Hum. Factors 58(3), 377–400 (2016)

    Article  Google Scholar 

  9. Sanchez, J., Fisk, A.D., Rogers, W.A.: Reliability and age-related effects on trust and reliance of a decision support aid. Paper presented at the proceedings of the human factors and ergonomics society annual meeting (2004)

    Google Scholar 

  10. Farrell, S., Lewandowsky, S.: A connectionist model of complacency and adaptive recovery under automation. J. Exp. Psychol. Learn. Mem. Cogn. 26(2), 395 (2000)

    Article  Google Scholar 

  11. Hancock, P.A., Billings, D.R., Schaefer, K.E., Chen, J.Y., De Visser, E.J., Parasuraman, R.: A meta-analysis of factors affecting trust in human-robot interaction. Hum. Factors 53(5), 517–527 (2011)

    Article  Google Scholar 

  12. Bartneck, C., Kulić, D., Croft, E., Zoghbi, S.: Measurement instruments for the anthropomorphism, animacy, likeability, perceived intelligence, and perceived safety of robots. Int. J. Soc. Robot. 1(1), 71–81 (2009)

    Article  Google Scholar 

  13. Madhavan, P., Wiegmann, D.A.: Effects of information source, pedigree, and reliability on operator interaction with decision support systems. Hum. Factors 49(5), 773–785 (2007)

    Article  Google Scholar 

  14. Qiu, L., Benbasat, I.: Evaluating anthropomorphic product recommendation agents: a social relationship perspective to designing information systems. J. Manag. Inf. Syst. 25(4), 145–182 (2008)

    Article  Google Scholar 

  15. Nass, C., Steuer, J., Tauber, E.R.: Computer are social actors. In: Conference on Human Factors in Computing Systems, CHI 1994, Boston, Massachusetts, USA, April 24–28, p. 204 (1994). Conference Companion

    Google Scholar 

  16. Pak, R., Fink, N., Price, M., Bass, B., Sturre, L.: Decision support aids with anthropomorphic characteristics influence trust and performance in younger and older adults. Ergonomics 55(9), 1059 (2012)

    Article  Google Scholar 

  17. de Visser, E.J., et al.: Almost human: anthropomorphism increases trust resilience in cognitive agents. J. Exp. Psychol. Appl. 22(3), 331 (2016)

    Article  Google Scholar 

  18. Messick, D.M., Mackie, D.M.: Intergroup relations. Annu. Rev. Psychol. 40(1), 45–81 (1989)

    Article  Google Scholar 

  19. Deligianis, C., Stanton, C.J., McGarty, C., Stevens, C.J.: The impact of intergroup bias on trust and approach behaviour towards a humanoid robot. J. Hum.-Robot Interact. 6(3), 4–20 (2017)

    Article  Google Scholar 

  20. Kuchenbrandt, D., Eyssel, F., Bobinger, S., Neufeld, M.: Minimal group - maximal effect? Evaluation and anthropomorphization of the humanoid robot NAO. In: Mutlu, B., Bartneck, C., Ham, J., Evers, V., Kanda, T. (eds.) ICSR 2011. LNCS (LNAI), vol. 7072, pp. 104–113. Springer, Heidelberg (2011). https://doi.org/10.1007/978-3-642-25504-5_11

    Chapter  Google Scholar 

  21. Häring, M., Kuchenbrandt, D., André, E.: Would you like to play with me?: how robots’ group membership and task features influence human-robot interaction. Paper presented at the proceedings of the 2014 ACM/IEEE international conference on human-robot interaction (2014)

    Google Scholar 

  22. Kuchenbrandt, D., Eyssel, F., Bobinger, S., Neufeld, M.: When a robot’s group membership matters. Int. J. Soc. Robot. 5(3), 409–417 (2013)

    Article  Google Scholar 

  23. Nass, C., Moon, Y.: Machines and mindlessness: social responses to computers. J. Soc. Issues 56(1), 81–103 (2000)

    Article  Google Scholar 

  24. Pak, R., Mclaughlin, A.C., Bass, B.: A multi-level analysis of the effects of age and gender stereotypes on trust in anthropomorphic technology by younger and older adults. Ergonomics 57(9), 1277–1289 (2014)

    Article  Google Scholar 

  25. Tajfel, H., Billig, M.G., Bundy, R.P., Flament, C.: Social categorization and intergroup behaviour. Eur. J. Soc. Psychol. 1(2), 149–178 (1971)

    Article  Google Scholar 

  26. Van Dongen, K., van Maanen, P.P.: Under-reliance on the decision aid: a difference in calibration and attribution between self and aid. In: Proceedings of the Human Factors and Ergonomics Society Annual Meeting, vol. 50, no. 3, pp. 225–229. SAGE Publications, Los Angeles, October 2006

    Google Scholar 

  27. Brewer, M.B.: In-group bias in the minimal intergroup situation: a cognitive-motivational analysis. Psychol. Bull. 86(2), 307 (1979)

    Article  Google Scholar 

  28. Brewer, M.B., Kramer, R.M.: The psychology of intergroup attitudes and behavior. Annu. Rev. Psychol. 36(1), 219–243 (1985)

    Article  Google Scholar 

  29. Kramer, R.M., Brewer, M.B.: Effects of group identity on resource use in a simulated commons dilemma. J. Pers. Soc. Psychol. 46(5), 1044 (1984)

    Article  Google Scholar 

  30. Sun, L., Chen, L., Duan, J.: Advice taking in decision-making: strategies, influences and feature research. Adv. Psychol. Sci. 25(1), 169–179 (2017)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jingyu Zhang .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Zou, X., Lv, C., Zhang, J. (2020). The Effect of Group Membership, System Reliability and Anthropomorphic Appearance on User’s Trust in Intelligent Decision Support System. In: Harris, D., Li, WC. (eds) Engineering Psychology and Cognitive Ergonomics. Cognition and Design. HCII 2020. Lecture Notes in Computer Science(), vol 12187. Springer, Cham. https://doi.org/10.1007/978-3-030-49183-3_18

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-49183-3_18

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-49182-6

  • Online ISBN: 978-3-030-49183-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics