Abstract
The inappropriate use of automation as a result of trust issues is a major barrier for a broad market penetration of automated vehicles. Studies so far have shown that providing information about the vehicle’s actions and intentions can be used to calibrate trust and promote user acceptance. However, how such feedback could be designed optimally is still an open question. This article presents the results of two user studies. In the first study, we investigated subjective trust and user experience of (N=21) participants driving in a fully automated vehicle, which interacts with other traffic participants in virtual reality. The analysis of questionnaires and semi-structured interviews shows that participants request feedback about the vehicle’s status and intentions and prefer visual feedback over other modalities. Consequently, we conducted a second study to derive concrete requirements for future feedback systems. We showed (N=56) participants various videos of an automated vehicle from the ego perspective and asked them to select elements in the environment they want feedback about so that they would feel safe, trust the vehicle, and understand its actions. The results confirm a correlation between subjective user trust and feedback needs and highlight essential requirements for automatic feedback generation. The results of both experiments provide a scientific basis for designing more adaptive and personalized in-vehicle interfaces for automated driving.
Funding source: Bundesministerium für Verkehr und Digitale Infrastruktur
Award Identifier / Grant number: 16AVF2145E
Award Identifier / Grant number: 16AVF2145F
Funding source: Bundesministerium für Bildung und Forschung
Award Identifier / Grant number: 13FH7I01IA
Funding statement: F. Janotta, A. Löcken and A. Riener are supported by the German Federal Ministry of Transport and Digital Infrastructure (BMVI) through the Automated and Connected Driving funding program under Grant Nos. 16AVF2145E and 16AVF2145F (SAVe). P. Wintersberger and J. Peintner are supported under the FH-Impuls program of the German Federal Ministry of Education and Research (BMBF) under Grant Number 13FH7I01IA (SAFIR). Further, we want to thank Hannah Nicklas and Spiegel Institut Germany for their support.
About the authors
![](/document/doi/10.1515/itit-2020-0024/asset/graphic/j_itit-2020-0024_fig_001.jpg)
Philipp Wintersberger obtained his doctorate in Engineering Science from Johannes Kepler University Linz specializing Human-Computer Interaction and Human-Machine Cooperation. He worked 10 years as a software engineer/architect before joining the Human-Computer Interaction Group at the Technische Hochschule Ingolstadt (THI) to conduct research in the area of Human Factors and Driving Ergonomics. His research contributions focus trust in automation, attentive user interfaces, as well as UX/acceptance of automated vehicles and received several awards in the past years.
![](/document/doi/10.1515/itit-2020-0024/asset/graphic/j_itit-2020-0024_fig_002.jpg)
Frederica Janotta studied Business Administration at the Catholic University Eichstaett-Ingolstadt. Since 2018, she has been working at the Chair of Service Management at Catholic University Eichstaett-Ingolstadt as a research associate and PhD candidate. Here, she has been working in different projects dealing with the acceptance of automated driving and urban air mobility respectively, funded by the German Federal Ministry of Transport, BMVI. Her research interests concern the acceptance of automated technologies in transportation and consumer behavior in the context of automation.
![](/document/doi/10.1515/itit-2020-0024/asset/graphic/j_itit-2020-0024_fig_003.jpg)
Jakob Peintner studied Industrial Design at OTH Regensburg. After graduating with a Bachelor of Arts degree, he enrolled in the masters program Human Factors Engineering at the University of Applied Sciences Munich (TUM). In 2020 he completed his Masters Thesis „Comparing different Interaction Modalities for Human-Robot Interaction in Augmented Reality“. He joined Andreas Riener’s Human-Computer Interaction Group at the Technische Hochschule Ingolstadt (THI) in 2020, where he is conducting research on augmented reality HMIs in automated driving.
![](/document/doi/10.1515/itit-2020-0024/asset/graphic/j_itit-2020-0024_fig_004.jpg)
Andreas Löcken studied Computer Science at the University of Oldenburg. Within the context of the Interdisciplinary Research Center Critical Systems Engineering for Socio-Technical Systems at the University of Oldenburg, he researched for his doctoral degree under the supervision of Prof. Susanne Boll. He defended his dissertation, “In-Vehicle Ambient Light to Support Safe Lane Change Decisions”, in 2019. In 2018, he joined Prof. Andreas Riener’s Human-Computer Interaction Group at the Technische Hochschule Ingolstadt. His research concerns the interaction between humans and automated vehicles. He is focusing on vulnerable road users, such as pedestrians or cyclists, and the passengers of self-driving cars.
![](/document/doi/10.1515/itit-2020-0024/asset/graphic/j_itit-2020-0024_fig_005.jpg)
Andreas Riener is professor for Human Machine Interface and Virtual Reality at Technische Hochschule Ingolstadt (THI) with co-appointment at the CARISSMA Institute for Automated Driving (C-IAD) research center. He is program manager for User Experience Design and leads the Usability research and driving simulator labs. In 2017, he founded the interdisciplinary Human-Computer Interaction Group. His reserach interests include ergonomics, driver state assessment, and trust/acceptance/ethics research in automated driving.
References
1. Matthias Beggiato and Josef F. Krems. The evolution of mental model, trust and acceptance of adaptive cruise control in relation to initial information. Transportation Research Part F: Traffic Psychology and Behaviour, 18:47–57, 2013.10.1016/j.trf.2012.12.006Search in Google Scholar
2. Johannes Beller, Matthias Heesen, and Mark Vollrath. Improving the driver–automation interaction: An approach using automation uncertainty. Human factors, 55(6):1130–1141, 2013.10.1177/0018720813482327Search in Google Scholar PubMed
3. Mark Colley, Christian Bräuner, Mirjam Lanzer, Marcel Walch, Martin Baumann, and Enrico Rukzio. Effect of visualization of pedestrian intention recognition on trust and cognitive load. In 12th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, AutomotiveUI ’20, page 181–191, New York, NY, USA, 2020. Association for Computing Machinery.10.1145/3409120.3410648Search in Google Scholar
4. Cyriel Diels and Simon Thompson. Information expectations in highly and fully automated vehicles. In International conference on applied human factors and ergonomics, pages 742–748. Springer, 2017.10.1007/978-3-319-60441-1_71Search in Google Scholar
5. Murat Dikmen and Catherine Burns. Trust in autonomous vehicles: The case of tesla autopilot and summon. In: 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC), pages 1093–1098. IEEE, 2017.10.1109/SMC.2017.8122757Search in Google Scholar
6. Fredrick Ekman, Mikael Johansson, and Jana Sochor. Creating appropriate trust in automated vehicle systems: A framework for hmi design. IEEE Transactions on Human-Machine Systems, 48(1):95–101, 2017.10.1109/THMS.2017.2776209Search in Google Scholar
7. Anna-Katharina Frison, Philipp Wintersberger, Tianjia Liu, and Andreas Riener. Why do you like to drive automated? a context-dependent analysis of highly automated driving to elaborate requirements for intelligent user interfaces. In Proceedings of the 24th International Conference on Intelligent User Interfaces, pages 528–537, 2019.10.1145/3301275.3302331Search in Google Scholar
8. Christian Gold, Moritz Körber, Christoph Hohenberger, David Lechner, and Klaus Bengler. Trust in automation–before and after the experience of take-over scenarios in a highly automated vehicle. Procedia Manufacturing, 3:3025–3032, 2015.10.1016/j.promfg.2015.07.847Search in Google Scholar
9. John F. Golding. Predicting individual differences in motion sickness susceptibility by questionnaire. Personality and Individual Differences, 41(2):237–248, 2006.10.1016/j.paid.2006.01.012Search in Google Scholar
10. Franziska Hartwich, Claudia Witzlack, Matthias Beggiato, and Josef F Krems. The first impression counts–a combined driving simulator and test track study on the development of trust and acceptance of highly automated driving. Transportation research part F: traffic psychology and behaviour, 65:522–535, 2019.10.1016/j.trf.2018.05.012Search in Google Scholar
11. Renate Häuslschmid, Max von Buelow, Bastian Pfleging, and Andreas Butz. Supportingtrust in autonomous driving. In Proceedings of the 22nd international conference on intelligent user interfaces, pages 319–329, 2017.10.1145/3025171.3025198Search in Google Scholar
12. Tove Helldin, Göran Falkman, Maria Riveiro, and Staffan Davidsson. Presenting system uncertainty in automotive uis for supporting trust calibration in autonomous driving. In Proceedings of the 5th international conference on automotive user interfaces and interactive vehicular applications, pages 210–217, 2013.10.1145/2516540.2516554Search in Google Scholar
13. Kevin Anthony Hoff and Masooda Bashir. Trust in automation: Integrating empirical evidence on factors that influence trust. Human Factors, 57(3):407–434, 2015.10.1177/0018720814547570Search in Google Scholar PubMed
14. Brittany E Holthausen, Philipp Wintersberger, Zoe Becerra, Alexander G Mirnig, Alexander Kunze, and Bruce N Walker. Third workshop on trust in automation: how does trust influence interaction. In Proceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications: Adjunct Proceedings, pages 13–18, 2019.10.1145/3349263.3350761Search in Google Scholar
15. Brittany E. Holthausen, Philipp Wintersberger, Bruce N. Walker, and Andreas Riener. Situational trust scale for automated driving (sts-ad): Development and initial validation. In 12th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, AutomotiveUI ’20, page 40–47, New York, NY, USA, 2020. Association for Computing Machinery.10.1145/3409120.3410637Search in Google Scholar
16. Jiun-Yin Jian, Ann M Bisantz, and Colin G Drury. Foundations for an empirically determined scale of trust in automated systems. International Journal of Cognitive Ergonomics, 4(1):53–71, 2000.10.1207/S15327566IJCE0401_04Search in Google Scholar
17. Jeamin Koo, Jungsuk Kwac, Wendy Ju, Martin Steinert, Larry Leifer, and Clifford Nass. Why did my car just do that? explaining semi-autonomous driving actions to improve driver understanding, trust, and performance. International Journal on Interactive Design and Manufacturing (IJIDeM), 9(4):269–275, 2015.10.1007/s12008-014-0227-2Search in Google Scholar
18. Alexander Kunze, Stephen J Summerskill, Russell Marshall, and Ashleigh J Filtness. Augmented reality displays for communicating uncertainty information in automated driving. In Proceedings of the 10th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, pages 164–175. ACM, 2018.10.1145/3239060.3239074Search in Google Scholar
19. Alexander Kunze, Stephen J. Summerskill, Russell Marshall, and Ashleigh J. Filtness. Conveying uncertainties using peripheral awareness displays in the context of automated driving. In Proceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, AutomotiveUI ’19, pages 329–341, New York, NY, USA, 2019. Association for Computing Machinery.10.1145/3342197.3344537Search in Google Scholar
20. John D Lee and Katrina A See. Trust in automation: Designing for appropriate reliance. Human factors, 46(1):50–80, 2004.10.1518/hfes.46.1.50.30392Search in Google Scholar
21. Mengyao Li, Brittany E Holthausen, Rachel E Stuck, and Bruce N Walker. No risk no trust: Investigating perceived risk in highly automated driving. In Proceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, pages 177–185, 2019.10.1145/3342197.3344525Search in Google Scholar
22. Andreas Löcken, Anna-Katharina Frison, Vanessa Fahn, Dominik Kreppold, Maximilian Götz, and Andreas Riener. Increasing user experience and trust in automated vehicles via an ambient light display. In 22nd International Conference on Human-Computer Interaction with Mobile Devices and Services, MobileHCI ’20, New York, NY, USA, 2020. Association for Computing Machinery.10.1145/3379503.3403567Search in Google Scholar
23. Andreas Löcken, Anna-Katharina Frison, Vanessa Fahn, Dominik Kreppold, Maximilian Götz, and Andreas Riener. Increasing user experience and trust in automated vehicles via an ambient light display. In Proceedings of the 22nd International Conference on Human-Computer Interaction with Mobile Devices and Services, MobileHCI ’20, New York, NY, USA, 2020. Association for Computing Machinery.10.1145/3379503.3403567Search in Google Scholar
24. Ana Mackay, Inês Fortes, Catarina Santos, Dário Machado, Patrícia Barbosa, Vera Vilas Boas, João Pedro Ferreira, Nélson Costa, Carlos Silva, and Emanuel Sousa. The impact of autonomous vehicles’ active feedback on trust. In International Conference on Applied Human Factors and Ergonomics, pages 342–352. Springer, 2019.10.1007/978-3-030-20497-6_32Search in Google Scholar
25. Stephanie M Merritt and Daniel R Ilgen. Not all trust is created equal: Dispositional and history-based trust in human-automation interactions. Human Factors, 50(2):194–210, 2008.10.1518/001872008X288574Search in Google Scholar
26. Kristin Mühl, Christoph Strauch, Christoph Grabmaier, Susanne Reithinger, Anke Huckauf, and Martin Baumann. Get ready for being chauffeured: Passenger’s preferences and trust while being driven by human and automation. Human factors, page 0018720819872893, 2019.10.1177/0018720819872893Search in Google Scholar
27. Bonnie M Muir. Trust between humans and machines, and the design of decision aids. International Journal of Man-Machine Studies, 27(5-6):527–539, 1987.10.1016/S0020-7373(87)80013-5Search in Google Scholar
28. Sean O’Kane. Tesla autopilot, distracted driving to blame in deadly 2018 crash. The Verge, February 2020. Retrieved March 11, 2020 from https://bit.ly/3kAvc6p.Search in Google Scholar
29. SAE. Taxonomy and Definitions for Terms Related to Driving Automation Systems for On-Road Motor Vehicles (J3016_201806), 2018.Search in Google Scholar
30. Brandon Schoettle and Michael Sivak. A survey of public opinion about autonomous and self-driving vehicles in the us, the uk, and australia. 2014.10.1109/ICCVE.2014.7297637Search in Google Scholar
31. James L Szalma and Grant S Taylor. Individual differences in response to automation: The five factor model of personality. Journal of Experimental Psychology: Applied, 17(2):71, 2011.10.1037/a0024170Search in Google Scholar PubMed
32. Trent W Victor, Emma Tivesten, Pär Gustavsson, Joel Johansson, Fredrik Sangberg, and Mikael Ljung Aust. Automation expectation mismatch: incorrect prediction despite eyes on threat and hands on wheel. Human factors, 60(8):1095–1116, 2018.10.1177/0018720818788164Search in Google Scholar PubMed PubMed Central
33. Gesa Wiegand, Malin Eiband, Maximilian Haubelt, and Heinrich Hussmann. “i’d like an explanation for that!” exploring reactions to unexpected autonomous driving. In 22nd International Conference on Human-Computer Interaction with Mobile Devices and Services, MobileHCI ’20, New York, NY, USA, 2020. Association for Computing Machinery.10.1145/3379503.3403554Search in Google Scholar
34. Philipp Wintersberger, Dmitrijs Dmitrenko, Clemens Schartmüller, Anna-Katharina Frison, Emanuela Maggioni, Marianna Obrist, and Andreas Riener. S (c) entinel: monitoring automated vehicles with olfactory reliability displays. In Proceedings of the 24th International Conference on Intelligent User Interfaces, pages 538–546, 2019.10.1145/3301275.3302332Search in Google Scholar
35. Philipp Wintersberger, Anna-Katharina Frison, and Andreas Riener. Man vs. machine: comparing a fully automated bus shuttle with a manually driven group taxi in a field study. In Adjunct Proceedings of the 10th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, pages 215–220, 2018.10.1145/3239092.3265969Search in Google Scholar
36. Philipp Wintersberger, Anna-Katharina Frison, Andreas Riener, and Tamara von Sawitzky. Fostering user acceptance and trust in fully automated vehicles: Evaluating the potential of augmented reality. Presence: Teleoperators and virtual environments, 27(1), 2018.10.1162/pres_a_00320Search in Google Scholar
37. Philipp Wintersberger, Hannah Nicklas, Thomas Martlbauer, Stephan Hammer, and Andreas Riener. Explainable automation: Personalized and adaptive uis to foster trust and understanding of driving automation systems. In 12th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, pages 252–261, 2020.10.1145/3409120.3410659Search in Google Scholar
38. Philipp Wintersberger, Brittany E Noah, Johannes Kraus, Roderick McCall, Alexander G Mirnig, Alexander Kunze, Shailie Thakkar, and Bruce N Walker. Second workshop on trust in the age of automated driving. In Adjunct Proceedings of the 10th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, pages 56–64, 2018.10.1145/3239092.3239099Search in Google Scholar
39. Philipp Wintersberger, Andreas Riener, and Anna-Katharina Frison. Automated driving system, male, or female driver: Who’d you prefer? comparative analysis of passengers’ mental conditions, emotional states & qualitative feedback. In Proceedings of the 8th international conference on automotive user interfaces and interactive vehicular applications, pages 51–58, 2016.10.1145/3003715.3005410Search in Google Scholar
40. Philipp Wintersberger, Tamara von Sawitzky, Anna-Katharina Frison, and Andreas Riener. Traffic augmentation as a means to increase trust in automated driving systems. In Proceedings of the 12th Biannual Conference on Italian SIGCHI Chapter, CHItaly ’17, New York, NY, USA, 2017. Association for Computing Machinery.10.1145/3125571.3125600Search in Google Scholar
© 2021 Walter de Gruyter GmbH, Berlin/Boston