skip to main content
10.1145/3342197.3344525acmconferencesArticle/Chapter ViewAbstractPublication PagesautomotiveuiConference Proceedingsconference-collections
research-article

No Risk No Trust: Investigating Perceived Risk in Highly Automated Driving

Published: 21 September 2019 Publication History

Abstract

When evaluating drivers' trust in automated systems, perceived risk is an inevitable, yet underestimated component, especially during initial interaction. We designed two experimental studies focusing on how people assess risk in different driving environments and how introductory information about automation reliability influences trust and risk perception. First, we designed nine driving scenarios to determine which factors influence Perceived Situational Risk (PSR) and Perceived Relational Risk (PRR). Results showed that participants identified levels of risk based on traffic type and vehicles' abnormal behaviors. We then evaluated how introductory information and situational risk influence trust and PRR. Results showed that participants reported the highest level of trust, perceived automation reliability, and the lowest level of PRR when presented with information about a highly reliable system, and when driving in a low-risk situation. These results highlight the importance of incorporating perceived risk and introductory information to support the trust calibration in automated vehicles.

References

[1]
Bailey, N.R. and Scerbo, M.W. 2007. Automation-induced complacency for monitoring highly reliable systems: The role of task complexity, system experience, and operator trust. Theoretical Issues in Ergonomics Science. (2007).
[2]
Beggiato, M. et al. 2015. Learning and development of trust, acceptance and the mental model of ACC. A longitudinal on-road study. Transportation Research Part F: Traffic Psychology and Behaviour. 35, (2015), 75--84.
[3]
Beggiato, M. and Krems, J.F. 2013. The evolution of mental model, trust and acceptance of adaptive cruise control in relation to initial information. Transportation Research Part F: Traffic Psychology and Behaviour. 18, (2013), 47--57.
[4]
Choi, J.K. and Ji, Y.G. 2015. Investigating the Importance of Trust on Adopting an Autonomous Vehicle. International Journal of Human-Computer Interaction. (2015). 49.
[5]
Corritore, C.L. et al. 2003. On-line trust: Concepts, evolving themes, a model. International Journal of Human Computer Studies. (2003).
[6]
Forster, Y. et al. 2018. Calibration of Trust Expectancies in Conditionally Automated Driving by Brand, Reliability Information and Introductionary Videos. Proceedings of the 10th International Conference on Automotive User Interfaces and Interactive Vehicular Applications - AutomotiveUI '18 (New York, New York, USA, 2018), 118--128.
[7]
Gable, T.M. and Walker, B.N. 2013. Georgia Tech Simulator Sickness Screening Protocol. (Oct. 2013).
[8]
Ghazizadeh, M. et al. 2012. Extending the Technology Acceptance Model to assess automation. Cognition, Technology and Work. 14, 1 (2012), 39--49.
[9]
Gold, C. et al. 2016. Taking Over Control From Highly Automated Vehicles in Complex Traffic Situations. Human Factors: The Journal of the Human Factors and Ergonomics Society. 58, 4 (Jun. 2016), 642--652.
[10]
Jian, J.-Y. et al. 2004. Foundations for an Empirically Determined Scale of Trust in Automated Systems. International Journal of Cognitive Ergonomics. (2004).
[11]
Körber, M. et al. 2018. Introduction matters: Manipulating trust in automation and reliance in automated driving. Applied Ergonomics. 66, (2018), 18--31.
[12]
Körber, M. 2018. Theoretical considerations and development of a questionnaire to measure trust in automation. In Proceedings 20th Triennial Congress of the IEA. Springer. (2018), 13--30.
[13]
Lee, J.D. and See, K.A. 2004. Trust in Automation: Designing for Appropriate Reliance. Human Factors: The Journal of the Human Factors and Ergonomics Society. 46, 1 (2004), 50--80.
[14]
Mayer, R.C. et al. 1995. An Integrative Model of Organizational Trust.
[15]
Merritt, S.M. and Ilgen, D.R. 2008. Not All Trust Is Created Equal: Dispositional and History-Based Trust in Human-Automation Interactions. Human Factors: The Journal of the Human Factors and Ergonomics Society. 50, 2 (2008), 194--210.
[16]
Numan, J.H. 1998. Knowledge-based systems as companions: Trust, human computer interaction and complex systems. [S.n.].
[17]
Parasuraman, R. 1997. Humans and Automation: Use, Misuse, Disuse, Abuse. Human Factors. 39, 2 (1997), 230--253. 230--253.
[18]
Parasuraman, R. and Riley, V. 2006. Humans and Automation: Use, Misuse, Disuse, Abuse. Human Factors: The Journal of the Human Factors and Ergonomics Society. (2006).
[19]
Pederson, B.K.M.K. et al. 2018. Simulations and Self-Driving Cars: A Study of Trust and Consequences. HRI '18 Companion (2018).
[20]
Perkins, L. et al. 2012. Designing for Human-Centered Systems: Situational Risk as a Factor of Trust in Automation. Proceedings of the Human Factors and Ergonomics Society Annual Meeting. (2012).
[21]
Rajaonah, B. et al. 2008. The role of intervening variables in driver-ACC cooperation. International Journal of Human Computer Studies. (2008).
[22]
Reeves, B. and Nass, C. 1996. The Media Equation: How People Treat Computers, Television, and New Media Like Real People and Places (CSLI Lecture Notes S). The Media Equation: How People Treat Computers, Television, and New Media Like Real People and Places. (1996).
[23]
SAE 2013. Summary of Levels of Driving Automation for On-Road Vehicles. Center for Internet and Society, Stanford Law School. (2013).
[24]
Satterfield, K. et al. 2017. The Influence of Risky Conditions in Trust in Autonomous Systems. Proceedings of the Human Factors and Ergonomics Society Annual Meeting. 61, 1 (Sep. 2017), 324--328.
[25]
Stuck, R.E., & Walker, B.N. The Importance of Incorporating Risk into the Study of Human-Automation Trust. Human Factors.

Cited By

View all
  • (2024)Determinants behind the acceptance of autonomous vehicles in mandatory and optional tripsProceedings of the Institution of Civil Engineers - Engineering Sustainability10.1680/jensu.23.00023177:3(174-184)Online publication date: 1-Jun-2024
  • (2024)Human-Automation Trust Development as a Function of Automation Exposure, Familiarity, and Perceived Risk: A High-Fidelity Remotely Operated Aircraft SimulationJournal of Cognitive Engineering and Decision Making10.1177/15553434241296573Online publication date: 21-Nov-2024
  • (2024)What If I’m Wrong? Team Performance and Trustworthiness When Modeling Risk-Sensitivity in Human–Robot CollaborationACM Transactions on Human-Robot Interaction10.1145/370606814:2(1-30)Online publication date: 3-Dec-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
AutomotiveUI '19: Proceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications
September 2019
402 pages
ISBN:9781450368841
DOI:10.1145/3342197
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 September 2019

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. car-driver interaction
  2. introductory information
  3. perceived risk
  4. simulator study
  5. trust in automation

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

AutomotiveUI '19
Sponsor:

Acceptance Rates

AutomotiveUI '19 Paper Acceptance Rate 34 of 119 submissions, 29%;
Overall Acceptance Rate 248 of 566 submissions, 44%

Upcoming Conference

AutomotiveUI '25

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)237
  • Downloads (Last 6 weeks)50
Reflects downloads up to 15 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Determinants behind the acceptance of autonomous vehicles in mandatory and optional tripsProceedings of the Institution of Civil Engineers - Engineering Sustainability10.1680/jensu.23.00023177:3(174-184)Online publication date: 1-Jun-2024
  • (2024)Human-Automation Trust Development as a Function of Automation Exposure, Familiarity, and Perceived Risk: A High-Fidelity Remotely Operated Aircraft SimulationJournal of Cognitive Engineering and Decision Making10.1177/15553434241296573Online publication date: 21-Nov-2024
  • (2024)What If I’m Wrong? Team Performance and Trustworthiness When Modeling Risk-Sensitivity in Human–Robot CollaborationACM Transactions on Human-Robot Interaction10.1145/370606814:2(1-30)Online publication date: 3-Dec-2024
  • (2024)"You Can either Blame Technology or Blame a Person..." --- A Conceptual Model of Users' AI-Risk Perception as a Tool for HCIProceedings of the ACM on Human-Computer Interaction10.1145/36869968:CSCW2(1-25)Online publication date: 8-Nov-2024
  • (2024)TimelyTale: A Multimodal Dataset Approach to Assessing Passengers' Explanation Demands in Highly Automated VehiclesProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785448:3(1-60)Online publication date: 9-Sep-2024
  • (2024)To Err Is AI! Debugging as an Intervention to Facilitate Appropriate Reliance on AI SystemsProceedings of the 35th ACM Conference on Hypertext and Social Media10.1145/3648188.3675130(98-105)Online publication date: 10-Sep-2024
  • (2024)What Makes Futuristic Vehicles Risky? Preliminary Design Considerations Based on Automation Level and Driving Versus Flying Modes.Adjunct Proceedings of the 16th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3641308.3685029(88-93)Online publication date: 22-Sep-2024
  • (2024)Dealing with Uncertainty: Understanding the Impact of Prognostic Versus Diagnostic Tasks on Trust and Reliance in Human-AI Decision MakingProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3641905(1-17)Online publication date: 11-May-2024
  • (2024)Exploring Factors Related to Drivers’ Mental Model of and Trust in Advanced Driver Assistance Systems Using an ABN-Based Mixed ApproachIEEE Transactions on Human-Machine Systems10.1109/THMS.2024.343687654:6(646-657)Online publication date: Dec-2024
  • (2024)Motion Comfort Optimization for Autonomous Vehicles: Concepts, Methods, and TechniquesIEEE Internet of Things Journal10.1109/JIOT.2023.328748911:1(378-402)Online publication date: 1-Jan-2024
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media