Skip to main content

Part of the book series: Studies in Computational Intelligence ((SCI,volume 281))

Abstract

This chapter concerns user responses toward adaptive and autonomous system behavior. The work consists of a review of the relevant literature off-set with the findings from three studies that investigated the way people respond to adaptive and autonomous agents. The systems evaluated in this chapter make decisions on behalf of the user, behave autonomously and need user feedback or compliance. Apart from the need for systems to competently perform their tasks, people will see adaptive and autonomous system behavior as social actions. Factors from humans’ social interaction will therefore also play a role in the experience users will have when using the systems. The user needs to trust, understand and control the system’s autonomous actions. In some cases the users need to invest effort in training the system so that it can learn. This indicates a complex relationship between the user, the adaptive and autonomous system and the specific context in which the system is used. This chapter specifically evaluates the way people trust and understand a system as well as the effects of system transparency and autonomy.

This chapter re-uses material from the following previous publications:

– Henriette Cramer, Vanessa Evers, Maarten van Someren, Bob Wielinga (2009) “Awareness, Training and Trust in Interaction with Adaptive Spam Filters”, Proceedings of the 27th International Conference on Human Factors in Computing Systems (CHI’09), Boston, USA, pp. 909-912. http://doi.acm.org/10.1145/1518701.1518839. ©2009 Association for Computing Machinery, Inc. Reprinted by permission.

– Henriette Cramer, Vanessa Evers, Maarten van Someren, Satyan Ramlal, Lloyd Rutledge, Natalia Stash, Lora Aroyo, Bob Wielinga (2008 ) The effects of transparency on trust and acceptance in interaction with a content-based art recommender, User Modeling and User-Adapted Interaction, 18, 5, pp. 455-496. DOI 10.1007/s11257-008-9051-3. ©2008 Springer. With kind permission of Springer Science and Business Media.

– Henriette Cramer, Vanessa Evers, Maarten van Someren, Bob Wielinga, Sam Besselink, Lloyd Rutledge, Natalia Stash, Lora Aroyo (2007). User Interaction with user-adaptive information filters. Proceedings of the Second International Conference on Usability and Internationalization, UI-HCII 2007, Held as Part of HCI International 2007, Beijing, China, Lecture Notes in Computer Science, Usability and Internationalization. Global and Local User Interfaces. pp. 324-333. DOI 10.1109/WIIAT.2008.326 ©2008 Springer. With kind permission of Springer Science and Business Media.

– Henriette Cramer, Vanessa Evers, Nicander Kemper, Bob Wielinga (2008) “Effects of Autonomy, Traffic Conditions and Driver Personality Traits on Attitudes and Trust towards In-Vehicle Agents”, Workshop on Human Aspects in Ambient Intelligence (HAI’08), Proceedings of the International Conference on Web Intelligence and Intelligent Agent Technology (WI-IAT’08), Sydney, Australia, pp. 477-482, DOI 10.1109/WIIAT.2008.326. ©2008 IEEE. Reprinted by permission.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Alpert, S., Karat, J., Karat, C., Brodie, C., Vergo, J.: User attitudes regarding a user-adaptive e-commerce web site. User Modeling and User-Adapted Interaction 13(4), 373–396 (2003)

    Article  Google Scholar 

  2. Avesani, P., Massa, P., Tiella, R.: A trust-enhanced recommender system application: Moleskiing. In: ACM symposium on Applied computing, pp. 1589–1593 (2005)

    Google Scholar 

  3. Benyon, D.: Adaptive systems: A solution to usability problems. User Modeling and User-Adapted Interaction 3(1), 65–87 (1993)

    Article  Google Scholar 

  4. Bilgic, M., Mooney, R.: Explaining recommendations: Satisfaction vs. promotion. In: Beyond Personalization Workshop, The International Conference on Intelligent User Interfaces, San Diego, California, USA (2005)

    Google Scholar 

  5. Billsus, D., Hilbert, D., Maynes-Aminzade, D.: Improving proactive information systems. In: IUI 2005, pp. 159–166. ACM Press, New York (2005)

    Chapter  Google Scholar 

  6. Briggs, P., Simpson, B., De Angeli, A.: Trust and Personalisation: A Reciprocal Relationship? In: Designing Personalised User Experiences for eCommerce, pp. 39–55. Kluwer, Dordrecht (2004)

    Chapter  Google Scholar 

  7. Brusilovsky, P.: Methods and techniques of adaptive hypermedia. User Modeling and User-Adapted Interaction 6(2-3), 87–129 (1996)

    Article  Google Scholar 

  8. Carmichael, D., Kay, J., Kummerfeld, B.: W., N.: Why did you show/tell/hide that?: The need for scrutability in ubiquitous personalisation. In: ECHISE Workshop Exploiting Context Histories in Smart Environments at UbiComp, Irvine, CA, USA (2006)

    Google Scholar 

  9. Castelfranchi, C., Falcone, R.: Trust and control: a dialectic link. Applied Artificial Intelligence 14(8), 799–823 (2000)

    Article  Google Scholar 

  10. Cheverst, K., Byun, H., Fitton, D., Sas, C., Kray, C., Villar, N.: Exploring issues of user model transparency and proactive behaviour in an office environment control system. User Modeling and User-Adapted Interaction 15(3-4), 235–273 (2005)

    Article  Google Scholar 

  11. Corritore, C., Kracher, B., Wiedenbeck, S.: On-line trust: concepts, evolving themes, a model. International Journal of Human-Computer Studies 58(6), 737–758 (2003)

    Article  Google Scholar 

  12. Cortellessa, G., Giuliani, M., Scopelliti, M., Cesta, A.: Issues in interactive problem solving: An empirical investigation on users attitude. In: Interact, Rome, Italy, pp. 657–670 (2005)

    Google Scholar 

  13. Cramer, H., Evers, V., Kemper, N., Wielinga, B.: Effects of autonomy, traffic conditions and driver personality traits on attitudes and trust towards in-vehicle agents. In: Workshop on Human Aspects in Ambient Intelligence at WI-IAT 2008, Sydney, Australia, pp. 477–482 (2008)

    Google Scholar 

  14. Cramer, H., Evers, V., Van Someren, M., Ramlal, S., Rutledge, L., Stash, N., Aroyo, L., Wielinga, B.: The effects of transparency on trust and acceptance in interaction with a content-based art recommender. User Modeling and User-Adapted Interaction 18(5), 455–496 (2008)

    Article  Google Scholar 

  15. Cramer, H., Evers, V., Van Someren, M., Wielinga, B.: Awareness, training and trust in interaction with adaptive spam filters. In: CHI, pp. 909–912 (2009)

    Google Scholar 

  16. Davis, F.: Perceived usefulness, perceived ease of use and user acceptance of information technology. MIS Quarterly 13(2), 318–340 (1989)

    Google Scholar 

  17. Desmond, P., Hancock, P., Monette, J.: Fatigue and automation-induced impairments in simulated driving performance. Transportation Research Record 1628, 8–14 (1998)

    Article  Google Scholar 

  18. Duttweiler, P.: The internal control index: a newly developed measure of locus of control. Educational and Psychological Measurement, 61–74 (1984)

    Google Scholar 

  19. Dzindolet, M., Peterson, S., Pomranky, R., Pierce, L., Beck, H.: The role of trust in automation reliance. International Journal of Human-Computer Studies 58(6), 697–718 (2003)

    Article  Google Scholar 

  20. Erickson, T.: Designing Agents as if People Mattered. In: Software Agents. MIT Press, Cambridge (1997)

    Google Scholar 

  21. Fogg, B.: Prominence-interpretation theory: Explaining how people assess credibility online. In: Extended Abstracts CHI 2003, pp. 722–723 (2003)

    Google Scholar 

  22. Fogg, B., Tseng, H.: The elements of computer credibility. In: CHI 1999, pp. 80–87. ACM Press, New York (1999)

    Google Scholar 

  23. Gefen, D., Karahanna, E., Straub, D.: Trust and tam in online shopping: An integrated model. MIS Quarterly 27(1), 51–90 (2003)

    Google Scholar 

  24. Goren-Bar, D., Graziola, I., Pianesi, F., Zancanaro, M.: The influence of personality factors on visitor attitudes towards adaptivity dimensions for mobile museum guides. User Modeling and User-Adapted Interaction 16(1), 31–62 (2006)

    Article  Google Scholar 

  25. Gregor, S., Benbasat, I.: Explanations from intelligent systems: Theoretical foundations and implications for practice. MIS Quarterly 23(4), 497–530 (1999)

    Article  Google Scholar 

  26. van der Heijden, H.: Acceptance of hedonic information systems. MIS Quarterly 28, 695–704 (2004)

    Google Scholar 

  27. Herlocker, J., Konstan, J., Riedl, J.: Explaining collaborative filtering recommendations. In: CSCW 2000, Philadelphia, Pennsylvania, USA, pp. 241–250 (2000)

    Google Scholar 

  28. Höök, K.: Evaluating the utility and usability of an adaptive hypermedia system. In: IUI 1997, pp. 179–186 (1997)

    Google Scholar 

  29. Höök, K.: Steps to take before intelligent interfaces become real. Interacting with Computers 12(4), 409–426 (2000)

    Article  Google Scholar 

  30. Höök, K., Karlgren, J., Waern, A., Dahlbck, N., Jansson, C., Karlgren, K., Lemaire, B.: A glass box approach to adaptive hypermedia. User Modeling and User-Adapted Interaction 6(2-3), 157–184 (1996)

    Article  Google Scholar 

  31. Inzana, C., Driskell, J., Salas, E., Johnston, J.: Effects of preparatory information on enhancing performance under stress. Applied Psychology 81(4), 429–435 (1996)

    Article  Google Scholar 

  32. Jameson, A.: Adaptive Interfaces and Agents. In: The human-computer interaction handbook: Fundamentals, evolving technologies and emerging applications, pp. 305–330. Erlbaum, Mahwah (2003)

    Google Scholar 

  33. Jameson, A., Schwarzkopf, E.: Pros and cons of controllability: An empirical study. In: De Bra, P., Brusilovsky, P., Conejo, R. (eds.) AH 2002. LNCS, vol. 2347, pp. 193–202. Springer, Heidelberg (2002)

    Chapter  Google Scholar 

  34. Jian, J., Bisantz, A., Drury, C.: Foundations for an empirically determined scale of trust in automated systems. International Journal Cognitive Ergonomics 4(1), 53–71 (2000)

    Article  Google Scholar 

  35. Jonnson, I.-M., Harris, H., Nass, C.: How accurate must in-car information systems be? Consequences of accurate and inaccurate information in cars. In: CHI 2008, Florence, Italy, pp. 1665–1674 (2008)

    Google Scholar 

  36. Jøsang, A., Lo Presti, S.: Analysing the relationship between risk and trust. In: Trust Management (2004)

    Google Scholar 

  37. Kay, J.: Scrutable adaptation: Because we can and must. In: Adaptive Hypermedia and Adaptive Web-Based Systems, Dublin, Ireland, pp. 11–19 (2006)

    Google Scholar 

  38. Keeble, R., Macredie, R.: Assistant agents for the world wide web intelligent interface design challenges. Interacting with Computers 12(4), 357–381 (2000)

    Article  Google Scholar 

  39. Klopping, I.M., McKinney, E.: Extending the technology acceptance model and the task-technology fit model to consumer e-commerce. Information Technology, Learning, and Performance Journal 22(1), 35–48 (2004)

    Google Scholar 

  40. Langheinrich, M.: Privacy by design - principles for privacy-aware ubiquitous systems. In: International Symposium on Ubiquitous Computing, Atlanta, GA, USA (2001)

    Google Scholar 

  41. Lee, J., See, K.: Trust in automation: designing for appropriate reliance. Human Factors 42(1), 50–80 (2004)

    Google Scholar 

  42. Lee, J.D., Moray, N.: Trust, self-confidence, and operator’s adaptation to automation. International Journal of Human-Computer Studies 40, 153–184 (1994)

    Article  Google Scholar 

  43. Lu, L., Wu, H., Cooper, C.: Perceived work stress and locus of control: a combined quantitative and qualitative approach. Research & Practice in Human Resources Management 6, 51–64 (1999)

    Google Scholar 

  44. Ma, Q., Liu, L.: The technology acceptance model: A meta-analysis of empirical findings. Journal of Organizational and End User Computing 16(1), 59–72 (2004)

    Google Scholar 

  45. Maes, P.: Agents that reduce work and information overload. Communications of the ACM 37(7), 30–40 (1994)

    Article  Google Scholar 

  46. Matthews, G.: Desmond, P.A., Joyner, L., Carcary, B., Gilliland, K.: Validation of the driver stress inventory and driver coping questionnaire. In: International Conference on Traffic and Transport Psychology, Valencia, Spain (1996)

    Google Scholar 

  47. McAllister, D.: Affect and cognition-based trust as foundations for interpersonal cooperation in organizations. Academy of Management Journal 38(1), 24–59 (1995)

    Article  MathSciNet  Google Scholar 

  48. McGuinness, D., Pinheiro da Silva, P.: Explaining answers from the semantic web: The inference web approach. Web Semantics: Science, Services and Agents on the World Wide Web 1(4), 397–413 (2004)

    Article  Google Scholar 

  49. McNee, S., Lam, S., Guetzlaff, C., Konstan, J., Riedl, J.: Confidence metrics and displays in recommender systems. In: Interact, Zurich, Switzerland, pp. 176–183 (2003)

    Google Scholar 

  50. McSherry, D.: Explanation in recommender systems. Artificial Intelligence Review 24, 179–197 (2005)

    Article  MATH  Google Scholar 

  51. Miller, C., Parasuraman, R.: Designing for flexible interaction between humans and automation: Delegation interfaces for supervisory control. Human Factors 49, 57–75 (2007)

    Article  Google Scholar 

  52. Muir, B.: Trust in automation: Part i. theoretical issues in the study of trust and human intervention in automated systems. Ergonomics 37, 1905–1922 (1994)

    Article  Google Scholar 

  53. Muir, B., Moray, N.: Trust in automation. part ii. Ergonomics 39, 429–460 (1996)

    Article  Google Scholar 

  54. Ndubisi, N.O., Gupta, O., Ndubisi, G.: The moguls’ model of computing: Integrating the moderating impact of users’ persona into the technology acceptance model. Journal of Global Information Technology Management 8(1), 27–47 (2005)

    Google Scholar 

  55. Netten, C., Bruinsma, G., van Someren, M., de Hoog, R.: Task-adaptive information distribution for dynamic collaborative emergency response. International Journal of Intelligent Control Systems 11(4), 238–247 (2006)

    Google Scholar 

  56. O’Donovan, J., Smyth, B.: Trust in recommender systems. In: IUI, pp. 167–174. ACM Press, New York (2005)

    Google Scholar 

  57. Parasuraman, R., Miller, C.: Trust and etiquette in high-criticality automated systems. Communications of the ACM 47(4), 51–55 (2004)

    Article  Google Scholar 

  58. Pavlou, P.: Consumer acceptance of electronic commerce: Integrating trust and risk with the technology acceptance model. International Journal of Electronic Commerce 7(3), 101–134 (2003)

    Google Scholar 

  59. Pu, P., Chen, L.: Trust-inspiring explanation interfaces for recommender systems. Knowledge-Based Systems Journal 20, 542–556 (2007)

    Article  MathSciNet  Google Scholar 

  60. Rajaonah, B., Anceaux, F., Vienne, F.: Study of driver trust during cooperation with adaptive cruise control. Le Travail Humaine 69, 99–127 (2006)

    Article  Google Scholar 

  61. Rajaonah, B., Anceaux, F., Vienne, F.: Trust and the use of adaptive cruise control: a study of a cut-in situation. Cognition, Technology & Work 8(2), 146–155 (2006)

    Article  Google Scholar 

  62. Rajaonah, B., Tricot, N., Anceaux, F., Millot, P.: Role of intervening variables in driver-acc cooperation. International Journal of Human Computer Studies 66(3), 185–197 (2008)

    Article  Google Scholar 

  63. Reeves, B., Nass, C.: The media equation: how people treat computers, television, and new media like real people and places. Cambridge University Press, New York (1996)

    Google Scholar 

  64. Shimazu, H.: Expertclerk: A conversational case-based reasoning tool for developing salesclerk agents in e-commerce webshops. Artificial Intelligence Review 18, 223–244 (2002)

    Article  Google Scholar 

  65. Shneiderman, B., Maes, P.: Direct manipulation vs. interface agents. Interactions 4(62), 42–61 (2007)

    Google Scholar 

  66. Simmel, G.: The Sociology of George Simmel. Free Press, New York (1964)

    Google Scholar 

  67. Sinha, R., Swearingen, K.: The role of transparency in recommender systems. In: Proceedings CHI 2002, pp. 830–831. ACM Press, New York (2002)

    Google Scholar 

  68. Tintarev, N., Masthoff, J.: Effective explanations of recommendations: User-centered design. In: ACM Conference on Recommender systems, pp. 153–156 (2007)

    Google Scholar 

  69. Venkatesh, V., Morris, M., Davis, G., Davis, F.: User acceptance of information technology. MIS Quarterly 27(3), 425–478 (2003)

    Google Scholar 

  70. Victor, P., Cornelis, C., De Cock, M., da Silva, P.: Gradual trust and distrust in recommender system. Fuzzy Sets and Systems 160(10), 1367–1382 (2009)

    Article  MATH  Google Scholar 

  71. Waern, A.: User involvement in automatic filtering: an experimental study. User Modeling and User-Adapted Interaction 14(2-3), 201–237 (2004)

    Article  Google Scholar 

  72. Wang, W., Benbasat, I.: Trust in and adoption of online recommendation agents. Journal of the Association for Information Systems 6(3), 72–101 (2005)

    Google Scholar 

  73. Wang, W., Benbasat, I.: Recommendation agents for electronic commerce: Effects of explanation facilities on trusting beliefs. Journal of Management Information Systems 23(4), 217–246 (2007)

    Article  Google Scholar 

  74. Wu, I., Chen, J.: An extension of trust and tam model with tpb in the initial adoption of on-line tax: an empirical study. International Journal of Human-Computer Studies 62(6), 784–808 (2005)

    Article  Google Scholar 

  75. Xiao, S., Benbasat, I.: The formation of trust and distrust in recommendation agents in repeated interactions: a process-tracing analysis. In: 5th international conference on Electronic commerce, pp. 287–293 (2003)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2010 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Evers, V., Cramer, H., van Someren, M., Wielinga, B. (2010). Interacting with Adaptive Systems. In: Babuška, R., Groen, F.C.A. (eds) Interactive Collaborative Information Systems. Studies in Computational Intelligence, vol 281. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-11688-9_11

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-11688-9_11

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-11687-2

  • Online ISBN: 978-3-642-11688-9

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics