skip to main content
10.1145/3411764.3445575acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

Little Road Driving HUD: Heads-Up Display Complexity Influences Drivers’ Perceptions of Automated Vehicles

Published: 07 May 2021 Publication History

Abstract

Modern vehicles are using AI and increasingly sophisticated sensor suites to improve Advanced Driving Assistance Systems (ADAS) and support automated driving capabilities. Heads-Up-Displays (HUDs) provide an opportunity to visually inform drivers about vehicle perception and interpretation of the driving environment. One approach to HUD design may be to reveal to drivers the vehicle’s full contextual understanding, though it is not clear if the benefits of additional information outweigh the drawbacks of added complexity, or if this balance holds across drivers. We designed and tested an Augmented Reality (AR) HUD in an online study (N = 298), focusing on the influence of HUD visualizations on drivers’ situation awareness and perceptions. Participants viewed two driving scenes with one of three HUD conditions. Results were nuanced: situation awareness declined with increasing driving context complexity, and contrary to expectation, also declined with the presence of a HUD compared to no HUD. Significant differences were found by varying HUD complexity, which led us to explore different characterizations of complexity, including counts of scene items, item categories, and illuminated pixels. Our analysis finds that driving style interacts with driving context and HUD complexity, warranting further study.

Supplementary Material

Supplementary Materials (3411764.3445575_supplementalmaterials.zip)
MP4 File (3411764.3445575_videofigure.mp4)
Supplemental video
MP4 File (3411764.3445575_videopreview.mp4)
Preview video

References

[1]
Jeffrey Jensen Arnett, Daniel Offer, and Mark A Fine. 1997. Reckless driving in adolescence:‘State’and ‘trait’factors. Accident Analysis & Prevention 29, 1 (1997), 57–63.
[2]
Zoe M Becerra, Brittany Holthausen, and Bruce N Walker. 2019. Bringing the thrill to automated vehicles: an evaluation of thrill-seeking driving displays. In Proceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications: Adjunct Proceedings. 381–386.
[3]
Zoe M Becerra, Brittany E Holthausen, and Bruce N Walker. 2019. Designing displays in automated vehicles for the thrill-seeking driver: Characterizing driving profiles to create personalized driving displays. Technology, Mind, and Society(2019).
[4]
J Alejandro Betancur. 2011. Physical Variable Analysis Involved in Head-Up Display Systems Applied to Automobiles. Augmented Reality-Some Emerging Application Areas (2011), 244–266.
[5]
Zheng Bian, Russell Pierce, and George Andersen. 2011. Eye movement patterns and driving performance. (2011).
[6]
Matthieu P Boisgontier and Boris Cheval. 2016. The anova to mixed model transition. Neuroscience & Biobehavioral Reviews 68 (2016), 1004–1005.
[7]
Brittisha N Boston and Curt C Braun. 1996. Clutter and display conformality: Changes in cognitive capture. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting, Vol. 40. SAGE Publications Sage CA: Los Angeles, CA, 57–61.
[8]
Eleonora Bottani and Giuseppe Vignali. 2019. Augmented reality technology in the manufacturing industry: A review of the last decade. IISE Transactions 51, 3 (2019), 284–310.
[9]
GE Burnett and RA Donkor. 2012. Evaluating the impact of Head-Up Display complexity on peripheral detection performance: a driving simulator study. Advances in transportation studies 28 (2012), 5–16.
[10]
JL Campbell, JL Brown, JS Graving, CM Richard, MG Lichty, T Sanquist, PL Bacon, R Woods, H Li, DN Williams, [n.d.]. “Human factors design guidance for driver-vehicle interfaces,”Report No. DOT HS 812([n. d.]), 360.
[11]
Monica S Castelhano and John M Henderson. 2007. Initial scene representations facilitate eye movement guidance in visual search.Journal of Experimental Psychology: Human Perception and Performance 33, 4(2007), 753.
[12]
Dennis M Donovan, Robert L Umlauf, and Philip M Salzberg. 1988. Derivation of personality subtypes among high-risk drivers.Alcohol, Drugs & Driving(1988).
[13]
Frank T Durso, Andrew R Dattel, S Banbury, and Sebastien Tremblay. 2004. SPAM: The real-time assessment of SA. A cognitive approach to situation awareness: Theory and application 1 (2004), 137–154.
[14]
Francis T Durso, Todd R Truitt, Carla A Hackworth, Jerry M Crutchfield, Danko Nikolic, Peter M Moertl, Daryl Ohrt, and Carol A Manning. 1995. Expertise and chess: A pilot study comparing situation awareness methodologies. Experimental analysis and measurement of situation awareness (1995), 295–303.
[15]
Martin Eckert, Julia Volmerg, and Christoph Friedrich. 2019. Augmented reality in medicine: Systematic and bibliographic review. JMIR mHealth and uHealth 7, 4 (2019), 1–17.
[16]
James Elander, Robert West, and Davina French. 1993. Behavioral correlates of individual differences in road-traffic crash risk: An examination of methods and findings.Psychological bulletin 113, 2 (1993), 279.
[17]
Mica R Endsley. 1995. Measurement of situation awareness in dynamic systems. Human factors 37, 1 (1995), 65–84.
[18]
Mica R Endsley. 1995. Toward a theory of situation awareness in dynamic systems. Human factors 37, 1 (1995), 32–64.
[19]
Mica R Endsley, Stephen J Selcon, Thomas D Hardiman, and Darryl G Croft. 1998. A comparative analysis of SAGAT and SART for evaluations of situation awareness. In Proceedings of the human factors and ergonomics society annual meeting, Vol. 42. SAGE Publications Sage CA: Los Angeles, CA, 82–86.
[20]
Davina J French, Robert J West, James Elander, and John Martin WILDING. 1993. Decision-making style, driving style, and self-reported involvement in road traffic accidents. Ergonomics 36, 6 (1993), 627–644.
[21]
F Freuli, G De Cet, M Gastaldi, F Orsini, M Tagliabue, R Rossi, and G Vidotto. 2020. Cross-cultural perspective of driving style in young adults: Psychometric evaluation through the analysis of the Multidimensional Driving Style Inventory. Transportation research part F: traffic psychology and behaviour 73 (2020), 425–432.
[22]
Michael A Gerber, Ronald Schroeter, Li Xiaomeng, and Mohammed Elhenawy. 2020. Self-Interruptions of Non-Driving Related Tasks in Automated Vehicles: Mobile vs Head-Up Display. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–9.
[23]
Leo Gugerty 2011. Situation awareness in driving. Handbook for driving simulation in engineering, medicine and psychology 1(2011).
[24]
E Gulian, G Matthews, Aleck Ian Glendon, DR Davies, and LM Debney. 1989. Dimensions of driver stress. Ergonomics 32, 6 (1989), 585–602.
[25]
Renate Haeuslschmid, Bastian Pfleging, and Florian Alt. 2016. A design space to support the development of windshield applications for the car. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. 5076–5091.
[26]
Niki Harré. 2000. Risk evaluation, driving, and adolescents: A typology. Developmental Review 20, 2 (2000), 206–226.
[27]
John M Henderson, James R Brockmole, Monica S Castelhano, and Michael Mack. 2007. Visual saliency does not account for eye movements during visual search in real-world scenes. In Eye movements. Elsevier, 537–III.
[28]
DJ Herrmann. 1984. Questionnaires about memory. Everyday memory, actions and absent-mindedness (1984), 133–151.
[29]
Andrei C Holman and Corneliu E Havârneanu. 2015. The Romanian version of the multidimensional driving style inventory: Psychometric properties and cultural specificities. Transportation research part F: traffic psychology and behaviour 35 (2015), 45–59.
[30]
Richie Jose, Gun A Lee, and Mark Billinghurst. 2016. A comparative study of simulated augmented reality displays for vehicle navigation. In Proceedings of the 28th Australian conference on computer-human interaction. 40–48.
[31]
Juffrizal Karjanto, Nidzamuddin Md Yusof, Jacques Terken, Muhammad Zahir Hassan, Frank Delbressine, Hanneke Hooft van Huysduynen, and Matthias Rauterberg. 2017. The identification of Malaysian driving styles using the multidimensional driving style inventory. In MATEC Web of Conferences, Vol. 90. EDP Sciences, 01004.
[32]
Abram J Knarr. 2018. Do Peripheral HUD Warnings Affect Driving Ability?California State University, Long Beach.
[33]
Jeamin Koo, Jungsuk Kwac, Wendy Ju, Martin Steinert, Larry Leifer, and Clifford Nass. 2015. Why did my car just do that? Explaining semi-autonomous driving actions to improve driver understanding, trust, and performance. International Journal on Interactive Design and Manufacturing (IJIDeM) 9, 4(2015), 269–275.
[34]
Yi-Ching Lee, John D Lee, and Linda Ng Boyle. 2007. Visual attention in driving: The effects of cognitive load and visual disruption. Human Factors 49, 4 (2007), 721–733.
[35]
Yung-Ching Liu and Ming-Hui Wen. 2004. Comparison of Head-Up Display (HUD) vs. Head-Down Display (HDD): Driving Performance of Commercial Vehicle Operators in Taiwan. International Journal of Human-Computer Studies 61, 5 (2004), 679–697.
[36]
Zhenji Lu, Xander Coster, and Joost De Winter. 2017. How much time do drivers need to obtain situation awareness? A laboratory-based study of automated driving. Applied ergonomics 60(2017), 293–304.
[37]
Zhenji Lu, Riender Happee, and Joost CF de Winter. 2020. Take over! A video-clip study measuring attention, situation awareness, and decision-making in the face of an impending hazard. Transportation research part F: traffic psychology and behaviour 72 (2020), 211–225.
[38]
Ruiqi Ma and David B Kaber. 2007. Situation awareness and driving performance in a simulated navigation task. Ergonomics 50, 8 (2007), 1351–1364.
[39]
Andrew K Mackenzie and Julie M Harris. 2015. Eye movements and hazard perception in active and passive driving. Visual cognition 23, 6 (2015), 736–757.
[40]
William L Mihal and Gerald V Barrett. 1976. Individual differences in perceptual information processing and their relation to automobile accident involvement.Journal of Applied Psychology 61, 2 (1976), 229.
[41]
Ronald R Mourant and Thomas H Rockwell. 1970. Mapping eye-movement patterns to the visual scene in driving: An exploratory study. Human factors 12, 1 (1970), 81–87.
[42]
Sohad Murrar and Markus Brauer. 2018. The SAGE encyclopedia of educational research, measurement, and evaluation. Mixed model analysis of variance(2018), 1075–1078.
[43]
Larry B Nabatilan, Fereydoun Aghazadeh, Ashish D Nimbarte, Craig C Harvey, and Suman K Chowdhury. 2012. Effect of driving experience on visual behavior and driving performance under different driving conditions. Cognition, technology & work 14, 4 (2012), 355–363.
[44]
Richard E Nisbett and Timothy D Wilson. 1977. Telling more than we can know: verbal reports on mental processes.Psychological review 84, 3 (1977), 231.
[45]
Hye Sun Park, Min Woo Park, Kwang Hee Won, Kyong-Ho Kim, and Soon Ki Jung. 2013. In-Vehicle AR-HUD System to Provide Driving-Safety Information. ETRI Journal 35, 6 (2013), 1038–1047.
[46]
Juhee Park and Woojin Park. 2019. Functional requirements of automotive head-up displays: A systematic review of literature from 1994 to present. Applied Ergonomics 76(2019), 130–146.
[47]
So Yeon Park, Dylan James Moore, and David Sirkin. 2020. What a Driver Wants: User Preferences in Semi-Autonomous Vehicle Decision-Making. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–13.
[48]
Fernando M Poó, Orit Taubman-Ben-Ari, Rubén D Ledesma, and Carlos M Díaz-Lázaro. 2013. Reliability and validity of a Spanish-language version of the multidimensional driving style inventory. Transportation research part F: traffic psychology and behaviour 17 (2013), 75–87.
[49]
R Core Team. 2013. R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria.
[50]
James Reason, Antony Manstead, Stephen Stradling, James Baxter, and Karen Campbell. 1990. Errors and violations on the roads: a real distinction?Ergonomics 33, 10-11 (1990), 1315–1332.
[51]
Miguel A Recarte and Luis M Nunes. 2000. Effects of verbal and spatial-imagery tasks on eye fixations while driving.Journal of experimental psychology: Applied 6, 1 (2000), 31.
[52]
RStudio Team. 2020. RStudio: Integrated Development Environment for R. RStudio, PBC, Boston, MA.
[53]
Fridulv Sagberg, Selpi, Giulio Francesco Bianchi Piccinini, and Johan Engström. 2015. A review of research on driving styles and road safety. Human factors 57, 7 (2015), 1248–1275.
[54]
Paul Salmon, Neville Stanton, Guy Walker, and Damian Green. 2006. Situation awareness measurement: A review of applicability for C4i environments. Applied ergonomics 37, 2 (2006), 225–238.
[55]
Gerald E Schneider. 1967. Contrasting visuomotor functions of tectum and cortex in the golden hamster. Psychologische Forschung 31, 1 (1967), 52–62.
[56]
Stephen J Selcon and RM Taylor. 1990. Evaluation of the Situational Awareness Rating Technique(SART) as a tool for aircrew systems design. AGARD, Situational Awareness in Aerospace Operations 8 p(SEE N 90-28972 23-53) (1990).
[57]
Jami Shah, Noe Vargas-Hernandez, Joshua Summers, and Santosh Kulkarni. 2001. Collaborative Sketching (C‐Sketch) An Idea Generation Technique for Engineering Design. Journal of Creative Behavior 35, 3 (2001), 168–198.
[58]
Qonita Shahab, Jacques Terken, and Berry Eggen. 2013. Development of a questionnaire for identifying driver’s personal values in driving. In Proceedings of the 5th International Conference on Automotive User Interfaces and Interactive Vehicular Applications. 202–208.
[59]
Yumiko Shinohara, Rebecca Currano, Wendy Ju, and Yukiko Nishizaki. 2017. Visual attention during simulated autonomous driving in the US and Japan. In Proceedings of the 9th International Conference on Automotive User Interfaces and Interactive Vehicular Applications. 144–153.
[60]
David Sirkin, Nikolas Martelaro, Mishel Johns, and Wendy Ju. 2017. Toward measurement of situation awareness in autonomous vehicles. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. 405–415.
[61]
M. W. Smolensky. 1993. Toward the physiological measurement of situation awareness The case for eye movement measurements. In Proceedings of the Human Factors and Ergonomics Society 37th annual meeting, Vol. 23.
[62]
Orit Taubman-Ben-Ari, Mario Mikulincer, and Omri Gillath. 2004. The multidimensional driving style inventory—scale construct and validation. Accident Analysis & Prevention 36, 3 (2004), 323–332.
[63]
Orit Taubman-Ben-Ari and Dalia Yehiel. 2012. Driving styles and their associations with personality and motivation. Accident Analysis & Prevention 45 (2012), 416–422.
[64]
Richard M Taylor. 2017. Situational awareness rating technique (SART): The development of a tool for aircrew systems design. In Situational awareness. Routledge, 111–128.
[65]
Geoffrey Underwood, Athy Ngai, and Jean Underwood. 2013. Driving experience and situation awareness in hazard detection. Safety science 56(2013), 29–35.
[66]
Hanneke Hooft van Huysduynen, Jacques Terken, Jean-Bernard Martens, and Berry Eggen. 2015. Measuring driving styles: a validation of the multidimensional driving style inventory. In Proceedings of the 7th International Conference on Automotive User Interfaces and Interactive Vehicular Applications. 257–264.
[67]
Yuchen Wang, Weina Qu, Yan Ge, Xianghong Sun, and Kan Zhang. 2018. Effect of personality traits on driving style: Psychometric adaption of the multidimensional driving style inventory in a Chinese sample. PLoS one 13, 9 (2018), e0202126.
[68]
Nicholas J Ward, Andrew Parkes, and Peter R Crone. 1995. Effect of background scene complexity and field dependence on the legibility of head-up displays for automotive applications. Human factors 37, 4 (1995), 735–745.
[69]
M. Weihrauch, G. Meloeny, and T. Goesch. 1989. The first head up display introduced by General Motors. In SAE Technical Paper 890288. SAE International.
[70]
Daniel J Weintraub. 1987. HUDs, HMDs and Common Sense Polishing Virtual Images. Human Factors Society Bulletin 30, 10 (1987), 1–3.
[71]
Robert West, Davina French, Richard Kemp, and James Elander. 1993. Direct observation of driving, self reports of driver behaviour, and accident involvement. Ergonomics 36, 5 (1993), 557–567.
[72]
Christopher D Wickens. 2002. Multiple resources and performance prediction. Theoretical issues in ergonomics science 3, 2 (2002), 159–177.
[73]
Earl L Wiener and Renwick E Curry. 1980. Flight-deck automation Promises and problems. Ergonomics 23, 10 (1980), 995–1011.
[74]
Jiawei Xu, Shigang Yue, Federica Menchinelli, and Kun Guo. 2017. What has been missed for predicting human attention in viewing driving clips?PeerJ 5(2017), e2946.

Cited By

View all
  • (2024)Design and Evaluation of Ecological Interface of Driving Warning System Based on AR-HUDSensors10.3390/s2424801024:24(8010)Online publication date: 15-Dec-2024
  • (2024)Impact of Dual-Depth Head-Up Displays on Vehicle Driver PerformanceApplied Sciences10.3390/app1415644114:15(6441)Online publication date: 24-Jul-2024
  • (2024)Immersive insights: evaluating augmented reality interfaces for pedestrians in a CAVE-based experimentFrontiers in Virtual Reality10.3389/frvir.2024.13539415Online publication date: 26-Jul-2024
  • Show More Cited By

Index Terms

  1. Little Road Driving HUD: Heads-Up Display Complexity Influences Drivers’ Perceptions of Automated Vehicles
      Index terms have been assigned to the content through auto-classification.

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems
      May 2021
      10862 pages
      ISBN:9781450380966
      DOI:10.1145/3411764
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 07 May 2021

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. augmented reality
      2. heads-up-display
      3. interaction design
      4. situation awareness
      5. user interface
      6. vehicle interface

      Qualifiers

      • Research-article
      • Research
      • Refereed limited

      Conference

      CHI '21
      Sponsor:

      Acceptance Rates

      Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

      Upcoming Conference

      CHI 2025
      ACM CHI Conference on Human Factors in Computing Systems
      April 26 - May 1, 2025
      Yokohama , Japan

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)423
      • Downloads (Last 6 weeks)31
      Reflects downloads up to 15 Feb 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)Design and Evaluation of Ecological Interface of Driving Warning System Based on AR-HUDSensors10.3390/s2424801024:24(8010)Online publication date: 15-Dec-2024
      • (2024)Impact of Dual-Depth Head-Up Displays on Vehicle Driver PerformanceApplied Sciences10.3390/app1415644114:15(6441)Online publication date: 24-Jul-2024
      • (2024)Immersive insights: evaluating augmented reality interfaces for pedestrians in a CAVE-based experimentFrontiers in Virtual Reality10.3389/frvir.2024.13539415Online publication date: 26-Jul-2024
      • (2024)Deep-Sea VR Simulator Design for Evaluating HUD ContentsThe Journal of Korean Institute of Information Technology10.14801/jkiit.2024.22.11.7122:11(71-78)Online publication date: 30-Nov-2024
      • (2024)Move, Connect, Interact: Introducing a Design Space for Cross-Traffic InteractionProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785808:3(1-40)Online publication date: 9-Sep-2024
      • (2024)Development and Evaluation of Advanced Cyclist Assistance Systems on a Bicycle SimulatorProceedings of the 16th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3640792.3675721(283-293)Online publication date: 22-Sep-2024
      • (2024)A Review on the Development of the In-Vehicle Human-Machine Interfaces in Driving Automation: A Design PerspectiveProceedings of the 16th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3640792.3675718(160-174)Online publication date: 22-Sep-2024
      • (2024)‘Talking with your Car’: Design of Human-Centered Conversational AI in Autonomous VehiclesProceedings of the 16th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3640792.3675713(338-349)Online publication date: 22-Sep-2024
      • (2024)AdaptiveVoice: Cognitively Adaptive Voice Interface for Driving AssistanceProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642876(1-18)Online publication date: 11-May-2024
      • (2024)One Size Does Not Fit All: Designing and Evaluating Criticality-Adaptive Displays in Highly Automated VehiclesProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642648(1-15)Online publication date: 11-May-2024
      • Show More Cited By

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      HTML Format

      View this article in HTML Format.

      HTML Format

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media