skip to main content
10.1145/3640792.3675712acmconferencesArticle/Chapter ViewAbstractPublication PagesautomotiveuiConference Proceedingsconference-collections
research-article

Designing Visual Signals to Support Situation Awareness Recovery in Conditional Automated Driving

Published: 22 September 2024 Publication History

Abstract

Conditionally automated driving systems face two main safety challenges: the inability to autonomously handle all situations the vehicle encounters, and the allowed inattention of drivers during these critical moments. Our study focuses on enhancing drivers’ situation awareness at such times by embedding information about system status and the road environment in the visual signals displayed when control is transferred from the automated driving system. Six visual signals, each including different levels of situation awareness information, were compared to examine how they influence drivers’ levels of situation awareness in a simulated environment. The results show that signals incorporating higher levels of situation awareness information about the environment significantly facilitate the recovery of situation awareness after engaging in non-driving related tasks. This research provides insights into how visual cues can be optimized to facilitate quicker recovery of situation awareness for drivers transitioning from non-driving tasks in conditionally automated vehicles.

References

[1]
Adam, E. C. (1993). Fighter cockpits of the future. AIAA/IEEE Digital Avionics Systems Conf., 318–323.
[2]
Bainbridge, E. (1983). Ironies of Automation. Automatica, 19(6), 775-779.
[3]
Endsley, M. R. (1995a). Toward a theory of situation awareness in dynamic systems. Human Factors, 37(1), 32-64.
[4]
Endsley, M. R. (1995b). Measurement of situation awareness in dynamic systems. Human Factors, 37(1), 65–84.
[5]
Endsley, M. R. (2015). Situation awareness misconceptions and misunderstandings. Jnl. Cognitive Engineering and Decision Making, 9(1), 4–32.
[6]
Endsley, M. R., Selcon, S. J., Hardiman, T. D., & Croft, D. G. (1998). A comparative analysis of SAGAT and SART for evaluations of situation awareness. Proc. Human Factors and Ergonomics Society Annual Meeting, 42(1), 82–86.
[7]
Eriksson, A., & Stanton, N. A. (2017). Takeover time in highly automated vehicles: noncritical transitions to and from manual control. Human factors, 59(4), 689-705.
[8]
Feibush, E., Gagvani, N., & Williams, D. (2000). Visualization for situational awareness. IEEE Computer Graphics and Applications, 20(5), 38–45.
[9]
Fu, E., Sibi, S., Miller, D., Johns, M., Mok, B., Fischer, M., & Sirkin, D. (2019). The car that cried wolf: Driver responses to missing, perfectly performing, and oversensitive collision avoidance systems. IEEE Intelligent Vehicles Symposium (IV), 1830–1836.
[10]
Goodall, N. (2024). Normalizing crash risk of partially automated vehicles under sparse data. Journal of Transportation Safety & Security, 16(1), 1-17.
[11]
Holländer, K., & Pfleging, B. (2018). Preparing drivers for planned control transitions in automated cars. Proc. 17th Intl. Conf. on Mobile and Ubiquitous Multimedia, 83–92.
[12]
Klein, G. (2008). Naturalistic decision making. Human factors, 50(3), 456-460.
[13]
Klein, G. A. (2017). Sources of power: How people make decisions. MIT press.
[14]
Körber, M., Cingel, A., Zimmermann, M., & Bengler, K. (2015). Vigilance decrement and passive fatigue caused by monotony in automated driving. Procedia Manufacturing, 3, 2403-2409.
[15]
Lee, S. C., Yoon, S. H., & Ji, Y. G. (2021). Effects of non-driving-related task attributes on takeover quality in automated vehicles. Intl. Jnl. of Human–Computer Interaction, 37(3), 211–219.
[16]
Mackworth, N. H. (1948). The breakdown of vigilance during prolonged visual search. Quarterly Jnl. of Experimental Psychology, 1(1), 6–21.
[17]
Marti, P., Jallais, C., Koustanaï, A., Guillaume, A., & Mars, F. (2022). Impact of the driver's visual engagement on situation awareness and takeover quality. Transportation Research Part F: Traffic Psychology and Behaviour, 87, 391–402.
[18]
McCafferty, M. M. (1999). Perceived readability, understandability, and hazardousness of prescription drug warning labels as a function of icon, font size, and color. University of Nevada, Las Vegas.
[19]
Miller, D., Sun, A., Johns, M., Ive, H., Sirkin, D., Aich, S., & Ju, W. (2015). Distraction becomes engagement in automated driving. Proc. Human Factors and Ergonomics Society Annual Meeting, 59(1), 1676–1680.
[20]
Mok, B., Johns, M., Lee, K. J., Miller, D., Sirkin, D., Ive, P., & Ju, W. (2015). Emergency, automation off: Unstructured transition timing for distracted drivers of automated vehicles. 2015 IEEE 18th Intl. Conf. on Intelligent Transportation Systems, 2458–2464.
[21]
Mok, B. K.-J., Johns, M., Lee, K. J., Ive, H. P., Miller, D., & Ju, W. (2015). Timing of unstructured transitions of control in automated driving. 2015 IEEE Intelligent Vehicles Symposium (IV), 1167–1172.
[22]
Mok, B., Johns, M., Gowda, N., Sibi, S., & Ju, W. (2016, June). Take the wheel: Effects of available modalities on driver intervention. In 2016 IEEE Intelligent Vehicles Symposium (IV) (pp. 1358-1365). IEEE.
[23]
Montgomery, J., Kusano, K. D., & Gabler, H. C. (2014). Age and gender differences in time to collision at braking from the 100-car naturalistic driving study. Traffic injury prevention, 15(sup1), S15-S20.
[24]
Orasanu, J., Calderwood, R., & Zsambok, C. E. (1993). Decision making in action: Models and methods (Vol. 3). G. A. Klein (Ed.). Norwood, NJ: Ablex.
[25]
Pampel, S. M., Large, D. R., Burnett, G., Matthias, R., Thompson, S., & Skrypchuk, L. (2019). Getting the driver back into the loop: the quality of manual vehicle control following long and short non-critical transfer-of-control requests: TI: NS. Theoretical Issues in ergonomics Science, 20(3), 265-283.
[26]
Parasuraman, R., & Riley, V. (1997). Humans and automation: Use, misuse, disuse, abuse. Human factors, 39(2), 230-253.
[27]
SAE international. (2021). Taxonomy and definitions for terms related to driving automation systems for on-road motor vehicles. SAE International, (J3016).
[28]
Shayesteh, S., & Jebelli, H. (2022). Enhanced situational awareness in worker-robot interaction in construction: assessing the role of Visual cues. In Construction Research Congress 2022, 422–430.
[29]
Van Den Beukel, A. P., & Van Der Voort, M. C. (2013). The influence of time-criticality on Situation Awareness when retrieving human control after automated driving. 16th Intl. IEEE Conf. on Intelligent Transportation Systems (ITSC 2013), 2000–2005.
[30]
Van Der Laan, J. D., Heino, A., & De Waard, D. (1997). A simple procedure for the assessment of acceptance of advanced transport telematics. Transportation Research Part C: Emerging Technologies, 5(1), 1-10.
[31]
Wogalter, M. S. (2006). Purposes and scope of warnings. Handbook of warnings, 864.
[32]
Wogalter, M. S., Silver, N. C., Leonard, S. D., & Zaikina, H. (2006). Warning symbols (Chap. 12). Handbook of warnings, 159-176.
[33]
Zaikina-Montgomery, H. (2011). The dilemma of minors’ access to adult content on the internet: A proposed warnings solution. University of Nevada, Las Vegas.
[34]
Zeeb, K., Buchner, A., & Schrauf, M. (2016). Is take-over time all that matters? The impact of visual-cognitive load on driver take-over quality after conditionally automated driving. Accident Analysis & Prevention, 92, 230–239.
[35]
Zhang, B., De Winter, J., Varotto, S., Happee, R., & Martens, M. (2019). Determinants of take-over time from automated driving: A meta-analysis of 129 studies. Transportation research part F: traffic psychology and behaviour, 64, 285-307.

Index Terms

  1. Designing Visual Signals to Support Situation Awareness Recovery in Conditional Automated Driving

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      AutomotiveUI '24: Proceedings of the 16th International Conference on Automotive User Interfaces and Interactive Vehicular Applications
      September 2024
      438 pages
      ISBN:9798400705106
      DOI:10.1145/3640792
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 22 September 2024

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. Automated Driving
      2. Situation Awareness
      3. Take Over Control
      4. Visual Signals

      Qualifiers

      • Research-article
      • Research
      • Refereed limited

      Conference

      AutomotiveUI '24
      Sponsor:

      Acceptance Rates

      Overall Acceptance Rate 248 of 566 submissions, 44%

      Upcoming Conference

      AutomotiveUI '25

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • 0
        Total Citations
      • 112
        Total Downloads
      • Downloads (Last 12 months)112
      • Downloads (Last 6 weeks)13
      Reflects downloads up to 15 Feb 2025

      Other Metrics

      Citations

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      HTML Format

      View this article in HTML Format.

      HTML Format

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media