skip to main content
10.1145/3581961.3609897acmconferencesArticle/Chapter ViewAbstractPublication PagesautomotiveuiConference Proceedingsconference-collections
Work in Progress

Automation's Not Perfect But Neither Are We: Unveiling Illusionary Control And Automation Bias In Automated Driving

Published: 18 September 2023 Publication History

Abstract

If we want to develop automated vehicles that are truly human-centered, we need to keep in mind that our reasoning ability is far from “flawless”, as we are susceptible to inherent cognitive biases. With this work, we aim to systemically investigate cognitive biases in the context of automated driving for the first time. Using an online study (N = 99) and a short experiment (N = 21), we investigated two exemplary cognitive biases (1. illusion of control and 2. automation bias). Our results suggest that both can occur during automated driving. Specifically, we found that not only a greater amount of information about vehicle behavior but also the humanization of this information can lead to an (illusory) higher sense of control.

References

[1]
John Bernal. 2022. Tesla Crashes on Full Self Driving BETA. YouTube AI Addict. https://www.youtube.com/watch?v=sbSDsbDQjSURetrieved: 2022-05-09.
[2]
Adrian Bussone, Simone Stumpf, and Dympna O’Sullivan. 2015. The Role of Explanations on Trust and Reliance in Clinical Decision Support Systems. In 2015 International Conference on Healthcare Informatics. IEEE, New York City, NY, US, 160–169. https://doi.org/10.1109/ICHI.2015.26
[3]
K. Cherry and P.G. Mattiuzzi. 2010. The Everything Psychology Book: Explore the Human Psyche and Understand why We Do the Things We Do. Adams Media, New York City, NY, US. https://books.google.de/books?id=AjavDgAAQBAJ
[4]
Missy Cummings. 2004. Automation Bias in Intelligent Time Critical Decision Support Systems. Collection of Technical Papers - AIAA 1st Intelligent Systems Technical Conference 2 (09 2004). https://doi.org/10.2514/6.2004-6313
[5]
Luisa Damiano and Paul Dumouchel. 2018. Anthropomorphism in Human–Robot Co-evolution. Frontiers in Psychology 9 (2018), 1–9. https://doi.org/10.3389/fpsyg.2018.00468
[6]
Yannick Forster, Frederik Naujoks, and Alexandra Neukum. 2017. Increasing anthropomorphism and trust in automated driving functions by adding speech output. In 2017 IEEE Intelligent Vehicles Symposium (IV). IEEE, New York City, NY, US, 365–372. https://doi.org/10.1109/IVS.2017.7995746
[7]
From, J.E. (Hans) Korteling, and Alexander Toet. 2021. Cognitive Biases. Elsevier, Amsterdam, Netherlands, 610–619.
[8]
John Hanson. 2022. Tesla FSD BETA 10.11 is Overly Confident. YouTube AI DRIVR. https://www.youtube.com/watch?v=wQkXcySUnJk
[9]
John Hanson. 2022. Tesla FSD BETA 10.69.3 Finally Gets It. YouTube AI DRIVR. https://www.youtube.com/watch?v=DMa9VrEoUoYRetrieved: 2022-05-09.
[10]
John Hanson. 2022. Tesla FSD is NOT in a Good Place…. YouTube AI DRIVR. https://www.youtube.com/watch?v=FGXuVNl8YYc&t=1115sRetrieved: 2022-05-09.
[11]
Jeamin Koo, Dongjun Shin, Martin Steinert, and Larry Leifer. 2016. Understanding driver responses to voice alerts of autonomous car operations. International Journal of Vehicle Design 70 (01 2016), 377. https://doi.org/10.1504/IJVD.2016.076740
[12]
Johan E. Korteling, Anne-Marie Brouwer, and Alexander Toet. 2018. A Neural Network Framework for Cognitive Bias. Frontiers in Psychology 9 (2018), 1–12. https://doi.org/10.3389/fpsyg.2018.01561
[13]
Johannes Maria Kraus, Florian Nothdurft, Philipp Hock, David Scholz, Wolfgang Minker, and Martin Baumann. 2016. Human After All: Effects of Mere Presence and Social Interaction of a Humanoid Robot as a Co-Driver in Automated Driving. In Adjunct Proceedings of the 8th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Ann Arbor, MI, USA) (AutomotiveUI ’16 Adjunct). Association for Computing Machinery, New York, NY, USA, 129–134. https://doi.org/10.1145/3004323.3004338
[14]
Qiang Liu, Birte Emmermann, Oscar Suen, Bryan Grant, Jake Hercules, Erik Glaser, and Brian Lathrop. 2017. Rightward attentional bias in windshield displays: Implication towards external human machine interfaces for self-driving cars. In 2017 IEEE Conference on Cognitive and Computational Aspects of Situation Management (CogSIMA). IEEE, New York City, NY, 1–7. https://doi.org/10.1109/COGSIMA.2017.7929590
[15]
Mahsan Nourani, Chiradeep Roy, Jeremy E Block, Donald R Honeycutt, Tahrima Rahman, Eric Ragan, and Vibhav Gogate. 2021. Anchoring Bias Affects Mental Model Formation and User Reliance in Explainable AI Systems. In 26th International Conference on Intelligent User Interfaces (College Station, TX, USA) (IUI ’21). Association for Computing Machinery, New York, NY, USA, 340–350. https://doi.org/10.1145/3397481.3450639
[16]
On-Road Automated Driving (ORAD) committee. 2018. Taxonomy and Definitions for Terms Related to Driving Automation Systems for On-Road Motor Vehicles.
[17]
Yuqi Tian and Xiaowen Wang. 2022. A Study on Psychological Determinants of Users’ Autonomous Vehicles Adoption From Anthropomorphism and Utaut Perspectives. Frontiers in Psychology 13 (2022), 1–10. https://doi.org/10.3389/fpsyg.2022.986800
[18]
TTSMP3. 2022. Free Text-To-Speech and Text-to-MP3 for US English. TTSMP3. https://ttsmp3.com/Retrieved: 2022-05-09.
[19]
uxd1. 2022. Automation 1. YouTube. https://www.youtube.com/watch?v=ZzKDyMfE7rQ
[20]
Adam Waytz, Joy Heafner, and Nicholas Epley. 2014. The mind in the machine: Anthropomorphism increases trust in an autonomous vehicle. Journal of Experimental Social Psychology 52 (2014), 113–117. https://doi.org/10.1016/j.jesp.2014.01.005
[21]
Ion Yarritu, Helena Matute, and Miguel Vadillo. 2014. Illusion of Control: The Role of Personal Involvement. Experimental psychology 61 (08 2014), 38–47. https://doi.org/10.1027/1618-3169/a000225
[22]
Quan Zhou. 2020. Cognitive Biases in Technical Communication. In 2020 IEEE International Professional Communication Conference (ProComm). IEEE, New York City, NY, US, 39–46. https://doi.org/10.1109/ProComm48883.2020.00012

Cited By

View all
  • (2024)Driving Behavior Analysis: A Human Factors Perspective on Automated Driving Styles2024 IEEE Intelligent Vehicles Symposium (IV)10.1109/IV55156.2024.10588527(3312-3317)Online publication date: 2-Jun-2024

Index Terms

  1. Automation's Not Perfect But Neither Are We: Unveiling Illusionary Control And Automation Bias In Automated Driving

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      AutomotiveUI '23 Adjunct: Adjunct Proceedings of the 15th International Conference on Automotive User Interfaces and Interactive Vehicular Applications
      September 2023
      382 pages
      ISBN:9798400701122
      DOI:10.1145/3581961
      Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 18 September 2023

      Check for updates

      Author Tags

      1. Automated Driving
      2. Automation Bias.
      3. Cognitive Biases
      4. Illusionary Control
      5. User Study

      Qualifiers

      • Work in progress
      • Research
      • Refereed limited

      Funding Sources

      • German Federal Ministry of Education and Research (BMBF)

      Conference

      AutomotiveUI '23
      Sponsor:

      Acceptance Rates

      Overall Acceptance Rate 248 of 566 submissions, 44%

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)85
      • Downloads (Last 6 weeks)9
      Reflects downloads up to 10 Feb 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)Driving Behavior Analysis: A Human Factors Perspective on Automated Driving Styles2024 IEEE Intelligent Vehicles Symposium (IV)10.1109/IV55156.2024.10588527(3312-3317)Online publication date: 2-Jun-2024

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      HTML Format

      View this article in HTML Format.

      HTML Format

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media