skip to main content
10.1145/3313831.3376300acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

Is Too Much System Caution Counterproductive? Effects of Varying Sensitivity and Automation Levels in Vehicle Collision Avoidance Systems

Published: 23 April 2020 Publication History

Abstract

Autonomous vehicle system performance is limited by uncertainties inherent in the driving environment and challenges in processing sensor data. Engineers thus face the design decision of biasing systems toward lower sensitivity to potential threats (more misses) or higher sensitivity (more false alarms). We explored this problem for Automatic Emergency Braking systems in Level 3 autonomous vehicles, where the driver is required to monitor the system for failures. Participants (N=48) drove through a simulated suburban environment and experienced detection misses, perfect performance, or false alarms. We found that driver vigilance was greater for less-sensitive braking systems, resulting in improved performance during a potentially fatal failure. In addition, regardless of system bias, greater levels of autonomy resulted in significantly worse driver performance. Our results demonstrate that accounting for the effects of system bias on driver vigilance and performance will be critical design considerations as vehicle autonomy levels increase.

References

[1]
Arakawa, Toshiya. 2017. Trial verification of human reliance on autonomous vehicles from the viewpoint of human factors. International Journal of Innovative Computing, Information and Control 14, 2 (April 2018), 491--501. http://www.ijicic.org/ijicic140207.pdf
[2]
Arakawa, Toshiya and Kunihiko Oi. (2016). Verification of autonomous vehicle over-reliance. In Proceedings of the Measuring Behavior 2016, 177-- 182. https://www.measuringbehavior.org/mb2016/files/2016 /MB2016_Proceedings.pdf
[3]
Breznitz, Shlomo. 1984. Cry wolf: the psychology of false alarms. Lawrence Erlbaum Associates.
[4]
Casner, Stephen M. and Edwin L. Hutchins. 2019. What do we tell the drivers? Toward minimum driver training standards for partially automated cars. Journal of Cognitive Engineering and Decision Making 13, 2 (2019), 55--66. http://doi.org/10.1177/1555343419830901
[5]
Casner, Stephen M. and Jonathan W. Schooler. 2013. Thoughts in flight: automation use and pilots' taskrelated and task-unrelated thought. Human Factors: The Journal of the Human Factors and Ergonomics Society 56, 3 (2013), 433--442. http://doi.org/10.1177/0018720813501550
[6]
Casner, Stephen M., Richard W. Geven, Matthias P. Recker, and Jonathan W. Schooler. 2014. The retention of manual flying skills in the automated cockpit. Human Factors: The Journal of the Human Factors and Ergonomics Society 56, 8 (2014), 1506--1516. http://doi.org/10.1177/0018720814535628
[7]
Coelingh, Erik, Andreas Eidehall, and Mattias Bengtsson. 2010. Collision Warning with Full Auto Brake and Pedestrian Detection - A practical Example of Automatic Emergency Braking. 13th International IEEE Conference on Intelligent Transportation Systems (2010), 155--160. http://doi.org/10.1109/itsc.2010.5625077
[8]
Corder, Gregory W. and Dale I. Foreman. 2014. Nonparametric Statistics: A Step-by-Step Approach. John Wiley & Sons.
[9]
Cummings, M.L., Ryan M. Kilgore, Enlie Wang, Louis Tijerina, and Dev S. Kochhar. 2007. Effects of single versus multiple warnings on driver performance. Human Factors: The Journal of the Human Factors and Ergonomics Society 49, 6 (2007), 1097--1106. http://doi.org/10.1518/001872007x249956
[10]
Endsley, Mica R. 2017. Level of automation forms a key aspect of autonomy design. Journal of Cognitive Engineering and Decision Making 12, 1 (2018), 29--34. http://doi.org/10.1177/1555343417723432
[11]
Everett Collection. 1950s. Driverless Car of the Future, America's Electric Light and Power Companies, Saturday Evening Post. Retrieved August 16, 2019 from https://www.computerhistory.org/atchm/whereto-a-history-of-autonomous-vehicles/
[12]
Forlizzi, Jodi and Carl Disalvo. 2006. Service robots in the domestic environment: A study of the roomba vacuum in the home. In Proceeding of the 1st ACM SIGCHI/SIGART Conference on Human-Robot Interaction - HRI 06. http://doi.org/10.1145/1121241.1121286
[13]
Frederickson, H. George and Todd R. Laporte. 2002. Airport security, high reliability, and the problem of rationality. Public Administration Review 62, s1 (2002), 33--43. http://doi.org/10.1111/15406210.62.s1.7
[14]
Fu, Ernestine, Srinath Sibi, David Miller, Mishel Johns, Brian Mok, Martin Fischer, and David Sirkin. 2019. The car that cried wolf: Driver responses to missing, perfectly performing, and oversensitive collision avoidance systems. 2019 IEEE Intelligent Vehicles Symposium (IV), 1830--1836. http://doi.org/10.1109/ivs.2019.8814190
[15]
Gade, Rikke and Thomas B. Moeslund. 2013. Thermal cameras and applications: A survey. Machine Vision and Applications 25, 1 (2013), 245--262. http://doi.org/10.1007/s00138-013-0570--5
[16]
Hall, Sue, Martin Bobrow, and Theresa M. Marteau. 2000. Psychological consequences for parents of false negative results on prenatal screening for Downs syndrome: Retrospective interview study. BMJ 320 (2000), 407--412. http://doi.org/10.1136/bmj.320.7232.407
[17]
Hubele, Norma and Kathryn Kennedy. 2018. Forward collision warning system impact. Traffic Injury Prevention 19, sup2. http://doi.org/10.1080/15389588.2018.1490020
[18]
Jian, Jiun-Yin, Ann M. Bisantz, and Colin G. Drury. 2000. Foundations for an empirically determined scale of trust in automated systems. International Journal of Cognitive Ergonomics 4, 1 (2000), 53--71. http://doi.org/10.1207/s15327566ijce0401_04
[19]
Jiménez, Felipe, José Naranjo, Sofía Sánchez, et al. 2018. Communications and driver monitoring aids for fostering SAE level-4 road vehicles automation. Electronics 7, 10 (2018), 228. http://doi.org/10.3390/electronics7100228
[20]
Johns, Mishel, David B Miller, Annabel C Sun, Shawnee Baughman, Tongda Zhang, and Wendy Ju. 2015. The driver has control: Exploring driving performance with varying automation capabilities. In Proceedings of the 8th International Driving Symposium on Human Factors in Driver Assessment, Training, and Vehicle Design: driving assessment 2015. http://doi.org/10.17077/drivingassessment.1600
[21]
Johns, Mishel, Srinath Sibi, and Wendy Ju. 2014. Effect of cognitive load in autonomous vehicles on driver performance during transfer of control. In Proceedings of the 6th International Conference on Automotive User Interfaces and Interactive Vehicular Applications - AutomotiveUI 14. http://doi.org/10.1145/2667239.2667296
[22]
Johnson-Laird, P.N. 1980. Mental models in cognitive science. Cognitive Science 4, 1 (1980), 71--115. http://doi.org/10.1207/s15516709cog0401_4
[23]
Kaber, David B. 2017. Issues in human - automation interaction modeling: Presumptive aspects of frameworks of types and levels of automation. Journal of Cognitive Engineering and Decision Making 12, 1 (2018), 7--24. http://doi.org/10.1177/1555343417737203
[24]
Kawanaka, Tenma and Tsukasa Kudo. 2018. Inventory satisfaction discrimination method utilizing images and deep learning. Procedia Computer Science 126 (2018), 937--946. http://doi.org/10.1016/j.procs.2018.08.028
[25]
Kieras, David E. and Susan Bovair. 1984. The role of a mental model in learning to operate a device. Cognitive Science 8, 3 (1984), 255--273. http://doi.org/10.1207/s15516709cog0803_3
[26]
Kivelevitch, Elad H., Greg Dionne, Trevor Roose, et al. 2019. Sensor Fusion Tools in Support of Autonomous Systems. AIAA Scitech 2019 Forum. http://doi.org/10.2514/6.2019-0384
[27]
Lee, Hyuck-Kee, Seong-Geun Shin, and Dong-Soo Kwon. 2017. Design of emergency braking algorithm for pedestrian protection based on multi-sensor fusion. International Journal of Automotive Technology 18, 6 (2017), 1067--1076. http://doi.org/10.1007/s12239-0170104--7
[28]
Lee, John D. and Katrina A. See. 2004. Trust in automation: Designing for appropriate reliance. Human Factors: The Journal of the Human Factors and Ergonomics Society 46, 1 (2004), 50--80. http://doi.org/10.1518/hfes.46.1.50.30392
[29]
Lin, Patrick. 2016. Tesla Autopilot Crash: Why We Should Worry about a Single Death. IEEE Spectrum: Technology, Engineering, and Science News. 2016. Retrieved September 8, 2019 from https://spectrum.ieee.org/cars-thatthink/transportation/self-driving/tesla-autopilot-crashwhy-we-should-worry-about-a-single-death
[30]
Macmillan, Neil A. 2002. Signal detection theory. In Stevens' Handbook of Experimental Psychology, Vol. 4, Methodology in Experimental Psychology (3rd. ed.), Hal Pashler and John T. Wixted (eds.). John Wiley & Sons, NY, 42--90.
[31]
Mayer, Roger C., James H. Davis, and F. David Schoorman. 1995. An integrative model of organizational trust. The Academy of Management Review 20, 3 (1995), 709. http://doi.org/10.2307/258792
[32]
Neigel, Alexis R., Justine P. Caylor, Sue E. Kase, Michelle T. Vanni, and Jefferson Hoye. 2018. The role of trust and automation in an intelligence analyst decisional guidance paradigm. Journal of Cognitive Engineering and Decision Making 12, 4 (2018), 239-- 247. http://doi.org/10.1177/1555343418799601
[33]
Norman, Donald A. 1982. Some observations on mental models. In Mental Models, Dedre Gentner and Albert L. Stevens (eds.). Lawrence Erlbaum Associates, Hillsdale, NJ, 7--14.
[34]
Palmer, Everett A., Edwin L. Hutchins, Richard D. Ritter, and Inge vanCleemput. (1993). Altitude Deviations: Breakdowns of an Error-Tolerant System. NASA Technical Memorandum 108788. http://ntrs.nasa.gov/archive/nasa/casi.ntrs.nasa.gov/199 40011077.pdf
[35]
Parasuraman, Raja, Anthony J. Masalonis, and Peter A. Hancock. 2000. Fuzzy signal detection theory: Basic postulates and formulas for analyzing human and machine performance. Human Factors: The Journal of the Human Factors and Ergonomics Society 42, 4 (2000), 636--659. http://doi.org/10.1518/001872000779697980
[36]
Petticrew, M., A. Sowden, D. Lister-Sharp, and K. Wright. 2000. False-negative results in screening programmes: Systematic review of impact and implications. Health Technology Assessment 4, 5 (2000), 1--120. http://doi.org/10.3310/hta4050
[37]
SAE. 2014. Taxonomy and Definitions for Terms Related to On-Road Motor Vehicle Automated Driving Systems. SAE Standard J3016_201401. http://doi.org/10.4271/j3016_201401
[38]
Sawyer, Ben D. and Peter A Hancock. 2013. Performance degradation due to automation in texting while driving. In Proceedings of the 7th International Driving Symposium on Human Factors in Driver Assessment, Training, and Vehicle Design: driving assessment 2013. http://doi.org/10.17077/drivingassessment.1525
[39]
Sawyer, Ben D. and Peter A. Hancock. 2018. Hacking the human: The prevalence paradox in cybersecurity. Human Factors: The Journal of the Human Factors and Ergonomics Society 60, 5 (2018), 597--609. http://doi.org/10.1177/0018720818780472
[40]
Sawyer, Ben D., Victor S. Finomore, Andres A. Calvo, and P. A. Hancock. 2014. Google Glass: A driver distraction cause or cure? Human Factors: The Journal of the Human Factors and Ergonomics Society 56, 7 (2014), 1307--1321. http://doi.org/10.1177/0018720814555723
[41]
Shanmugapriya, D., and G. Padmavathi. 2009. A Survey of Biometric Keystroke Dynamics: Approaches, Security and Challenges. https://arxiv.org/ftp/arxiv/papers/0910/0910.0817.pdf
[42]
Sheridan, Thomas B. 2002. Humans and Automation: System Design and Research Issues. John Wiley & Sons, NY.
[43]
Sheridan, Thomas B. 2006. Supervisory control. In Handbook of Human Factors and Ergonomics (3rd. ed.), Gavriel Salvendy (ed.). John Wiley & Sons, Hoboken, NJ, 1025-052. https://doi.org/10.1002/0470048204.ch38
[44]
Sheridan, Thomas B. 2017. Comments on "Issues in human--automation interaction modeling: Presumptive aspects of frameworks of types and levels of automation" by David B. Kaber. Journal of Cognitive Engineering and Decision Making 12, 1 (2018), 25--28. http://doi.org/10.1177/1555343417724964
[45]
Sheridan, Thomas B. and William L. Verplank. 1978. Human and Computer Control of Undersea Teleoperators. Technical Report. http://doi.org/10.21236/ada057655
[46]
Singh, Additi Mrinal, Soumyasree Bera, and Rabindranath Bera. 2018. Review on Vehicular Radar for Road Safety. Advances in Communication, Cloud, and Big Data Lecture Notes in Networks and Systems, 41- 47. http://doi.org/10.1007/978--981--10--8911--4_5
[47]
Sung, Ja-Young, Lan Guo, Rebecca E. Grinter, and Henrik I. Christensen. (2007). "My Roomba is Rambo": Intimate home appliances. UbiComp 2007: Ubiquitous Computing Lecture Notes in Computer Science, 145--162. http://doi.org/10.1007/978--3--54074853--3_9
[48]
Takeda, Yuji, Toshihisa Sato, Kenta Kimura, Hidehiko Komine, Motoyuki Akamatsu, and Jun Sato. 2016. Electrophysiological evaluation of attention in drivers and passengers: Toward an understanding of drivers' attentional state in autonomous vehicles. Transportation Research Part F: Traffic Psychology and Behaviour 42 (2016), 140--150. http://doi.org/10.1016/j.trf.2016.07.008
[49]
Tanner, Wilson P. and John A. Swets. 1954. A decision-making theory of visual detection. Psychological Review 61, 6 (1954), 401--409. http://doi.org/10.1037/h0058700
[50]
Tuzlukov, Vyacheslav P. 2013. Signal Detection Theory. Springer Science & Business Media.
[51]
U.S. DOT and IIHS Announce Historic Commitment of 20 Automakers to Make Automatic Emergency Braking Standard on New Vehicles. 2016. IIHS. Retrieved September 8, 2019 from https://www.iihs.org/news/detail/u-s-dot-and-iihsannounce-historic-commitment-of-20-automakers-tomake-automatic-emergency-braking-standard-on-newvehicles
[52]
Wallis, Thomas S.A. and Mark S. Horswill. 2007. Using fuzzy signal detection theory to determine why experienced and trained drivers respond faster than novices in a hazard perception test. Accident Analysis & Prevention 39, 6 (2007), 1177--1185. http://doi.org/10.1016/j.aap.2007.03.003
[53]
Wheeler, W. A. and T. J. Trigs. 1995. A task analytical view of simulator based training for drivers. Road Safety Research and Enforcement Conference (1996), Coogee Beach, New South Wales, Australia.
[54]
Wiener, Earl L. 1985. Human Factors of Cockpit Automation: A Field Study of Flight Crew Transition. NASA Contractor Report 177333. http://ntrs.nasa.gov/archive/nasa/casi.ntrs.nasa.gov/198 50021625.pdf
[55]
Xia, Likun, Tran Duc Chung, and Khairil Anwar Bin Abu Kassim. 2013. A review of automated emergency braking system and the trending for future vehicles. In Proceedings of the Southeast Asia Safer Mobility Symposium 2013 (SAEM 2013-010). https://www.saemalaysia.org.my/wpcontent/uploads/2017/03/SAEM-2013-010.pdf

Cited By

View all
  • (2024)Move, Connect, Interact: Introducing a Design Space for Cross-Traffic InteractionProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785808:3(1-40)Online publication date: 9-Sep-2024
  • (2023)The WACDT, a modern vigilance task for network defenseFrontiers in Neuroergonomics10.3389/fnrgo.2023.12154974Online publication date: 21-Nov-2023
  • (2023)How does HCI Understand Human Agency and Autonomy?Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580651(1-18)Online publication date: 19-Apr-2023
  • Show More Cited By

Index Terms

  1. Is Too Much System Caution Counterproductive? Effects of Varying Sensitivity and Automation Levels in Vehicle Collision Avoidance Systems

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems
      April 2020
      10688 pages
      ISBN:9781450367080
      DOI:10.1145/3313831
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 23 April 2020

      Permissions

      Request permissions for this article.

      Check for updates

      Badges

      • Honorable Mention

      Author Tags

      1. automated emergency braking
      2. autonomous vehicles
      3. controlled experiment
      4. human machine interaction
      5. simulation

      Qualifiers

      • Research-article

      Conference

      CHI '20
      Sponsor:

      Acceptance Rates

      Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)80
      • Downloads (Last 6 weeks)8
      Reflects downloads up to 22 Jan 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)Move, Connect, Interact: Introducing a Design Space for Cross-Traffic InteractionProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785808:3(1-40)Online publication date: 9-Sep-2024
      • (2023)The WACDT, a modern vigilance task for network defenseFrontiers in Neuroergonomics10.3389/fnrgo.2023.12154974Online publication date: 21-Nov-2023
      • (2023)How does HCI Understand Human Agency and Autonomy?Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580651(1-18)Online publication date: 19-Apr-2023
      • (2023)Characterizing Drivers’ Peripheral Vision via the Functional Field of View for Intelligent Driving Assistance2023 IEEE Intelligent Vehicles Symposium (IV)10.1109/IV55152.2023.10186746(1-8)Online publication date: 4-Jun-2023
      • (2022)The Subjective Feeling in Human-machine Joint-controlヒューマン・マシン・ジョイントコントロールにおける人間の主観的感覚Journal of the Robotics Society of Japan10.7210/jrsj.40.58940:7(589-592)Online publication date: 2022
      • (2022)Explanations in Autonomous Driving: A SurveyIEEE Transactions on Intelligent Transportation Systems10.1109/TITS.2021.312286523:8(10142-10162)Online publication date: Aug-2022
      • (2022)Cohesion in human–autonomy teams: an approach for future researchTheoretical Issues in Ergonomics Science10.1080/1463922X.2022.203387623:6(687-724)Online publication date: 8-Feb-2022
      • (2021)How to Evaluate Trust in AI-Assisted Decision Making? A Survey of Empirical MethodologiesProceedings of the ACM on Human-Computer Interaction10.1145/34760685:CSCW2(1-39)Online publication date: 18-Oct-2021
      • (2021)AutoPreview: A Framework for Autopilot Behavior UnderstandingExtended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411763.3451591(1-6)Online publication date: 8-May-2021
      • (undefined)Advancing Explainable Autonomous Vehicle Systems: A Comprehensive Review and Research RoadmapACM Transactions on Human-Robot Interaction10.1145/3714478

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      HTML Format

      View this article in HTML Format.

      HTML Format

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media