skip to main content
10.1145/3580585.3607154acmconferencesArticle/Chapter ViewAbstractPublication PagesautomotiveuiConference Proceedingsconference-collections
research-article

Communication of Uncertainty Information in Cooperative, Automated Driving: A Comparative Study of Different Modalities

Published: 18 September 2023 Publication History

Abstract

Cooperation between drivers and automated vehicles requires transparent communication of the automation’s current status. This can be achieved by communicating confidence or certainty in its current perception or decision. We evaluate different sensory modalities for communicating information about how safely an automated driving system can perform the driving task in critical traffic situations to a driver who is present as a cooperator. We aimed to improve communication between the driving system and the human driver, ultimately increasing the overall driving experience and performance. In a virtual reality driving simulation study with 34 participants, we presented confidence information across three modalities: visual, auditory, and vibrotactile, compared to a baseline condition. Our results indicate that communicating automation uncertainty through the auditory and vibrotactile modalities improved user experience, trust in automation, and perceived safety. At the same time, interactions with the Non-Driving Related Task were reduced by communicating confidence information in critical driving situations.

References

[1]
David Beattie, Lynne Baillie, Martin Halvey, and Rod McCall. 2014. What’s around the Corner? Enhancing Driver Awareness in Autonomous Vehicles via in-Vehicle Spatial Auditory Displays. In Proceedings of the 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, Foundational (Helsinki, Finland) (NordiCHI ’14). Association for Computing Machinery, New York, NY, USA, 189–198. https://doi.org/10.1145/2639189.2641206
[2]
Johannes Beller, Matthias Heesen, and Mark Vollrath. 2013. Improving the Driver–Automation Interaction: An Approach Using Automation Uncertainty. Human Factors 55, 6 (2013), 1130–1141. https://doi.org/10.1177/0018720813482327 arXiv:https://doi.org/10.1177/0018720813482327PMID: 24745204.
[3]
Klaus Bengler, Michael Rettenmaier, and Alexander Feierle. 2020. From HMI to HMIs: Towards an HMI Framework for Automated Driving. Information 11 (01 2020), 61. https://doi.org/10.3390/info11020061
[4]
K Christoffersen and D Woods. 2001. How to make automated systems team players. Advances in Human Performance and Cognitive Engineering Research 2 (11 2001), 1–12. https://doi.org/10.1016/S1479-3601(02)02003-9 ISSN: 14793601.
[5]
Mark Colley, Benjamin Eder, Jan Ole Rixen, and Enrico Rukzio. 2021. Effects of Semantic Segmentation Visualization on Trust, Situation Awareness, and Cognitive Load in Highly Automated Vehicles. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 155, 11 pages. https://doi.org/10.1145/3411764.3445351
[6]
On-Road Automated Driving (ORAD) Committee. 2021. Taxonomy and Definitions for Terms Related to Driving Automation Systems for On-Road Motor Vehicles. Society of Automotive Engineers (SAE). https://doi.org/10.4271/J3016_202104
[7]
Paul H Fitts. 1951. Human engineering for an effective air-navigation and traffic-control system.
[8]
Frank Ole Flemisch, Klaus Bengler, Heiner Bubb, Hermann Winner, and Ralph Bruder. 2014. Towards cooperative guidance and control of highly automated vehicles: H-Mode and Conduct-by-Wire. Ergonomics 57, 3 (March 2014), 343–360. https://doi.org/10.1080/00140139.2013.869355
[9]
Nick Gang, Srinath Sibi, Romain Michon, Brian Mok, Chris Chafe, and Wendy Ju. 2018. Don’t Be Alarmed: Sonifying Autonomous Vehicle Perception to Increase Situation Awareness. In Proceedings of the 10th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Toronto, ON, Canada) (AutomotiveUI ’18). Association for Computing Machinery, New York, NY, USA, 237–246. https://doi.org/10.1145/3239060.3265636
[10]
Chunshi Guo, Chouki Sentouh, Jean-Baptiste Haué, and Jean-Christophe Popieul. 2019. Driver–vehicle cooperation: a hierarchical cooperative control architecture for automated driving systems. Cognition, Technology & Work 21, 4 (2019), 657–670.
[11]
Tove Helldin, Göran Falkman, Maria Riveiro, and Staffan Davidsson. 2013. Presenting System Uncertainty in Automotive UIs for Supporting Trust Calibration in Autonomous Driving. In Proceedings of the 5th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Eindhoven, Netherlands) (AutomotiveUI ’13). Association for Computing Machinery, New York, NY, USA, 210–217. https://doi.org/10.1145/2516540.2516554
[12]
Kai Holländer, Philipp Wintersberger, and Andreas Butz. 2019. Overtrust in External Cues of Automated Vehicles: An Experimental Investigation. In Proceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Utrecht, Netherlands) (AutomotiveUI ’19). Association for Computing Machinery, New York, NY, USA, 211–221. https://doi.org/10.1145/3342197.3344528
[13]
Sture Holm. 1979. A Simple Sequentially Rejective Multiple Test Procedure. Scandinavian Journal of Statistics 6, 2 (1979), 65–70. http://www.jstor.org/stable/4615733
[14]
Yong Gu Ji, Kwangil Lee, and Wonil Hwang. 2011. Haptic Perceptions in the Vehicle Seat. Hum. Factor. Ergon. Manuf. 21, 3 (may 2011), 305–325. https://doi.org/10.1002/hfm.20235
[15]
G. Klein, D.D. Woods, J.M. Bradshaw, R.R. Hoffman, and P.J. Feltovich. 2004. Ten Challenges for Making Automation a "Team Player" in Joint Human-Agent Activity. IEEE Intelligent Systems 19, 06 (Nov. 2004), 91–95. https://doi.org/10.1109/MIS.2004.74
[16]
Alexander Kunze, Stephen J. Summerskill, Russell Marshall, and Ashleigh J. Filtness. 2018. Augmented Reality Displays for Communicating Uncertainty Information in Automated Driving. In Proceedings of the 10th International Conference on Automotive User Interfaces and Interactive Vehicular Applications. ACM, Toronto ON Canada, 164–175. https://doi.org/10.1145/3239060.3239074
[17]
Alexander Kunze, Stephen J. Summerskill, Russell Marshall, and Ashleigh J. Filtness. 2019. Conveying Uncertainties Using Peripheral Awareness Displays in the Context of Automated Driving. In Proceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications. ACM, Utrecht Netherlands, 329–341. https://doi.org/10.1145/3342197.3344537
[18]
Bettina Laugwitz, Theo Held, and Martin Schrepp. 2008. Construction and Evaluation of a User Experience Questionnaire. In HCI and Usability for Education and Work, Andreas Holzinger (Ed.). Springer Berlin Heidelberg, Berlin, Heidelberg, 63–76.
[19]
Daniel Omeiza, Helena Webb, Marina Jirotka, and Lars Kunze. 2021. Explanations in Autonomous Driving: A Survey. IEEE Transactions on Intelligent Transportation Systems 23 (2021), 10142–10162.
[20]
Jakob Benedikt Peintner, Carina Manger, and Andreas Riener. 2022. “Can You Rely on Me?” Evaluating a Confidence HMI for Cooperative, Automated Driving. In Proceedings of the 14th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Seoul, Republic of Korea) (AutomotiveUI ’22). Association for Computing Machinery, New York, NY, USA, 340–348. https://doi.org/10.1145/3543174.3546976
[21]
Sebastiaan M. Petermeijer, David A. Abbink, Mark Mulder, and Joost C. F. de Winter. 2015. The Effect of Haptic Support Systems on Driver Performance: A Literature Survey. EEE Trans. Haptics 8, 4 (oct 2015), 467–479. https://doi.org/10.1109/TOH.2015.2437871
[22]
Sebastiaan M. Petermeijer, Joost C. F. de Winter, and Klaus J. Bengler. 2016. Vibrotactile Displays: A Survey With a View on Highly Automated Driving. IEEE Transactions on Intelligent Transportation Systems 17, 4 (2016), 897–907. https://doi.org/10.1109/TITS.2015.2494873
[23]
Jürgen Pichen, Tanja Stoll, and Martin Baumann. 2021. From SAE-Levels to Cooperative Task Distribution:An Efficient and Usable Way to Deal with System Limitations?. In 13th International Conference on Automotive User Interfaces and Interactive Vehicular Applications. ACM, Leeds United Kingdom, 109–115. https://doi.org/10.1145/3409118.3475127
[24]
Andreas Riener. 2010. Sensor-actuator supported implicit interaction in driver assistance systems. Springer, Wiesbaden, Germany. https://doi.org/10.1007/978-3-8348-9777-0
[25]
Tobias Schneider, Joana Hois, Alischa Rosenstein, Sabiha Ghellal, Dimitra Theofanou-Fülbier, and Ansgar R.S. Gerlicher. 2021. ExplAIn Yourself! Transparency for Positive UX in Autonomous Driving. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 161, 12 pages. https://doi.org/10.1145/3411764.3446647
[26]
Sonja Stockert, Natalie Tara Richardson, and Markus Lienkamp. 2015. Driving in an Increasingly Automated World – Approaches to Improve the Driver-automation Interaction. Procedia Manufacturing 3 (2015), 2889–2896. https://doi.org/10.1016/j.promfg.2015.07.797 6th International Conference on Applied Human Factors and Ergonomics (AHFE 2015) and the Affiliated Conferences, AHFE 2015.
[27]
Jinke D. Van Der Laan, Adriaan Heino, and Dick De Waard. 1997. A simple procedure for the assessment of acceptance of advanced transport telematics. Transportation Research Part C: Emerging Technologies 5, 1 (1997), 1–10. https://doi.org/10.1016/S0968-090X(96)00025-3
[28]
Marcel Walch, Mark Colley, and Michael Weber. 2019. CooperationCaptcha: On-The-Fly Object Labeling for Highly Automated Vehicles. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, Glasgow Scotland Uk, 1–6. https://doi.org/10.1145/3290607.3313022
[29]
Marcel Walch, Stacey Li, Ilan Mandel, David Goedicke, Natalie Friedman, and Wendy Ju. 2020. Crosswalk Cooperation: A Phone-Integrated Driver-Vehicle Cooperation Approach to Predict the Crossing Intentions of Pedestrians in Automated Driving. In 12th International Conference on Automotive User Interfaces and Interactive Vehicular Applications. ACM, Virtual Event DC USA, 74–77. https://doi.org/10.1145/3409251.3411727
[30]
Marcel Walch, Kristin Mühl, Johannes Kraus, Tanja Stoll, Martin Baumann, and Michael Weber. 2017. From Car-Driver-Handovers to Cooperative Interfaces: Visions for Driver–Vehicle Interaction in Automated Driving. In Automotive User Interfaces, Gerrit Meixner and Christian Müller (Eds.). Springer International Publishing, Cham, 273–294. https://doi.org/10.1007/978-3-319-49448-7 _10
[31]
Marcel Walch, Kristin Mühl, Johannes Kraus, Tanja Stoll, Martin Baumann, and Michael Weber. 2017. From Car-Driver-Handovers to Cooperative Interfaces: Visions for Driver–Vehicle Interaction in Automated Driving. In Automotive User Interfaces, Gerrit Meixner and Christian Müller (Eds.). Springer International Publishing, Cham, 273–294. https://doi.org/10.1007/978-3-319-49448-7 _10
[32]
Marcel Walch, Marcel Woide, Kristin Mühl, Martin Baumann, and Michael Weber. 09212019. Cooperative Overtaking. In Proceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications. ACM, New York, NY, USA, 144–155. https://doi.org/10.1145/3342197.3344531
[33]
Chao Wang, Matti Krüger, and Christiane B. Wiebel-Herboth. 2020. “Watch out!”: Prediction-Level Intervention for Automated Driving. In 12th International Conference on Automotive User Interfaces and Interactive Vehicular Applications. ACM, Virtual Event DC USA, 169–180. https://doi.org/10.1145/3409120.3410652
[34]
Gesa Wiegand, Malin Eiband, Maximilian Haubelt, and Heinrich Hussmann. 2020. “I’d like an Explanation for That!”Exploring Reactions to Unexpected Autonomous Driving. In 22nd International Conference on Human-Computer Interaction with Mobile Devices and Services (Oldenburg, Germany) (MobileHCI ’20). Association for Computing Machinery, New York, NY, USA, Article 36, 11 pages. https://doi.org/10.1145/3379503.3403554
[35]
Gesa Wiegand, Kai Holländer, Katharina Rupp, and Heinrich Hussmann. 09212020. The Joy of Collaborating with Highly Automated Vehicles. In 12th International Conference on Automotive User Interfaces and Interactive Vehicular Applications. ACM, New York, NY, USA, 223–232. https://doi.org/10.1145/3409120.3410643
[36]
Gesa Wiegand, Kai Holländer, Katharina Rupp, and Heinrich Hussmann. 09212020. The Joy of Collaborating with Highly Automated Vehicles. In 12th International Conference on Automotive User Interfaces and Interactive Vehicular Applications. ACM, New York, NY, USA, 223–232. https://doi.org/10.1145/3409120.3410643
[37]
Philipp Wintersberger, Hannah Nicklas, Thomas Martlbauer, Stephan Hammer, and Andreas Riener. 2020. Explainable Automation: Personalized and Adaptive UIs to Foster Trust and Understanding of Driving Automation Systems. In 12th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Virtual Event, DC, USA) (AutomotiveUI ’20). Association for Computing Machinery, New York, NY, USA, 252–261. https://doi.org/10.1145/3409120.3410659
[38]
Fred Zijlstra and L. Doorn. 1985. The Construction of a Scale to Measure Perceived Effort.
[39]
Markus Zimmermann, Stefan Bauer, Niklas Lutteken, Iris M. Rothkirch, and Klaus J. Bengler. 2014. Acting together by mutual control: Evaluation of a multimodal interaction concept for cooperative driving. In 2014 International Conference on Collaboration Technologies and Systems (CTS). IEEE, Minneapolis, MN, USA, 227–235. https://doi.org/10.1109/CTS.2014.6867569

Cited By

View all
  • (2024)How to Design Human-Vehicle Cooperation for Automated Driving: A Review of Use Cases, Concepts, and InterfacesMultimodal Technologies and Interaction10.3390/mti80300168:3(16)Online publication date: 26-Feb-2024
  • (2024)Driving Behavior Analysis: A Human Factors Perspective on Automated Driving Styles2024 IEEE Intelligent Vehicles Symposium (IV)10.1109/IV55156.2024.10588527(3312-3317)Online publication date: 2-Jun-2024

Index Terms

  1. Communication of Uncertainty Information in Cooperative, Automated Driving: A Comparative Study of Different Modalities

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      AutomotiveUI '23: Proceedings of the 15th International Conference on Automotive User Interfaces and Interactive Vehicular Applications
      September 2023
      352 pages
      ISBN:9798400701054
      DOI:10.1145/3580585
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 18 September 2023

      Permissions

      Request permissions for this article.

      Check for updates

      Badges

      • Honorable Mention

      Author Tags

      1. Confidence HMIs
      2. Cooperative Driving
      3. Explainable AI
      4. Interface Modalities
      5. Predictability
      6. Transparency

      Qualifiers

      • Research-article
      • Research
      • Refereed limited

      Funding Sources

      • German Federal Ministry of Education and Research (BMBF)

      Conference

      AutomotiveUI '23
      Sponsor:

      Acceptance Rates

      Overall Acceptance Rate 248 of 566 submissions, 44%

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)233
      • Downloads (Last 6 weeks)18
      Reflects downloads up to 10 Feb 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)How to Design Human-Vehicle Cooperation for Automated Driving: A Review of Use Cases, Concepts, and InterfacesMultimodal Technologies and Interaction10.3390/mti80300168:3(16)Online publication date: 26-Feb-2024
      • (2024)Driving Behavior Analysis: A Human Factors Perspective on Automated Driving Styles2024 IEEE Intelligent Vehicles Symposium (IV)10.1109/IV55156.2024.10588527(3312-3317)Online publication date: 2-Jun-2024

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      HTML Format

      View this article in HTML Format.

      HTML Format

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media