Sara Hong
ABSTRACT
In several circumstances, a level-three automated vehicle cannot continue driving in an automated driving mode and requests a human driver to take over. In this study, a series of experiments to examine how to provide a TOR was conducted. First, for forty-one persons, a HUD icon, earcon, seat vibration, and combinations were compared. The results indicated that the HUD icon-earcon and HUD icon-seat vibration were the most effective. Second, the combinations of A-pillar LED light and cluster icon (visual), earcon and speech message (auditory), and presence/absence of seat vibration (haptic) were compared. Thirty-six volunteers participated in the ADS failure and forty in the highway exit experiment. In the ADS failure, the combination of A-pillar LED light and seat vibration (AH) reduced the RT but can induce stress. In the highway exit, a speech message is recommended due to control stability, and the AH is not recommended due to longitudinal instability.
- Alexander Eriksson, Sebastiaan M. Petermeijeret, Markus Zimmermann, Joost C. F. de Winter, Klaus J. Bengler and Neville A. Stanton. 2018. Rolling out the red (and green) carpet: supporting driver decision making in automation-to-manual transitions. IEEE Transactions on Human-Machine Systems. 49 (February 2018), 20-31. 10.1109/THMS.2018.2883862Google Scholar
- Christian Gold, Daniel Damböck, Lutz Lorenz, Klaus Bengler. 2013. “Take over!” How long does it take to get the driver back into the loop?. In Proceedings of the human factors and ergonomics society 57th annual meeting. Sage CA: Los Angeles, CA: Sage Publications. 57, 1, 1938-1942. https://doi.org/10.1177/1541931213571433Google ScholarCross Ref
- Daniel V. McGehee, John D.Lee, Matthew Rizzo, Jeffrey Dawson and Kirk Bateman. 2004. Quantitative analysis of steering adaptation on a high performance fixed-base driving simulator. Transportation Research Part F: Traffic Psychology and Behaviour, 7, 3 (May 2007), 181-196. https://doi.org/10.1016/j.trf.2004.08.001Google ScholarCross Ref
- Dongyeon Yu, Chanho Park, Hoseung Choi, Donggyu Kim and Sung-Ho Hwang. 2021. Takeover Safety Analysis with Driver Monitoring Systems and Driver-Vehicle Interfaces in Highly Automated Vehicles. Applied Sciences, 11, 15 (July 2021), 6685. https://doi.org/10.3390/app11156685Google Scholar
- Frederik Naujoks, Christoph Mai and Alexandra Neukum. 2014. The effect of urgency of take-over requests during highly automated driving under distraction conditions. Advances in human aspects of transportation, 7(Part I), 431-438.Google Scholar
- Frederik Naujoks, Katharina Wiedemann, Nadja Schömig, Sebastian Hergeth and Andreas Keinath. 2019. Towards guidelines and verification methods for automated vehicle HMIs. Transportation research part F: traffic psychology and behaviour, 60 (January 2019), 121-136. https://doi.org/10.1016/j.trf.2018.10.012Google Scholar
- Gustav Markkula and Johan Engström. 2006. A steering wheel reversal rate metric for assessing effects of visual and cognitive secondary task load. In Proceedings of the 13th ITS World Congress, The University of Leeds, London, UK.Google Scholar
- Hanna Yun and Ji Hyun Yang. 2020. Multimodal warning design for take-over request in conditionally automated driving. European transport research review, 12, 1 (May 2020), 1-11. https://doi.org/10.1186/s12544-020-00427-5Google Scholar
- Hanna Yun, Ji Won Lee, Hee Dong Yang and Ji Hyun Yang. 2018. Experimental design for multi-modal take-over request for automated driving. In International Conference on Human-Computer Interaction (HCI International 2018). 418–425.10.1007/978-3-319-92285-0_57Google ScholarCross Ref
- Hanna Yun, Sung Lae Kim, Ji Won Lee and Ji Hyun Yang. 2018. Analysis of Cause of Disengagement Based on U.S. California DMV Autonomous Driving Disengagement Report. Transaction of the Korean Society of Automotive Engineers, 26, 4 (Jun 2018), 464-475. https://doi.org/10.7467/KSAE.2018.26.4.464Google Scholar
- Haozheong Zuo and Ji Hyun Yang. 2021.Analysis of Cause of Disengagement Based on U.S. California DMV Autonomous Driving Disengagement Report (2017-2019). In proceeding of the Korean Society of Automotive Engineers. (November 2021), 423.Google Scholar
- Harsh Sanghavi, Yiqi Zhang and Myounghoon Jeon. 2020. Effects of anger and display urgency on takeover performance in semi-automated vehicles. In Proceedings of the 12th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI '20), 48-56. https://doi.org/10.1145/3409120.3410664Google ScholarDigital Library
- Hyung Jun Kim and Ji Hyun Yang. 2017. Takeover requests in simulated partially autonomous vehicles considering human factors. IEEE Transactions on Human-Machine Systems. 47, 5 (March 2017), 735–740. https://doi.org/10.1109/THMS.2017.2674998.Google ScholarCross Ref
- ISO 15006. 2011. Road vehicles - Ergonomic aspects of transport information and control system - specifications for in-vehicle auditory presentation.Google Scholar
- J.J. Scott and Robert Gray. 2008. A comparison of tactile, visual, and auditory warnings for rear-end collision prevention in simulated driving. Human factors. 50, 2 (April 2008), 264-275. https://doi.org/10.1518/001872008X250674Google Scholar
- Jae Won Kim and Ji Hyun Yang. 2020. Understanding metrics of vehicle control take-over requests in simulated automated vehicles. International journal of automotive technology, 21, 3 (February 2020), 757-770. https://doi.org/10.1007/s12239-020-0074-zGoogle ScholarCross Ref
- Ji Hyun Yang, Seul Chan Lee, Chihab Nadri, Jaewon Kim, Jaekon Shin and Myounghoon Jeon. Multimodal displays for takeover requests. In User Experience Design in the Era of Automated Driving. Springer, 2022, 397–424. 10.1007/978-3-030-77726-5_15Google Scholar
- Jiwon Lee and Ji Hyun Yang. 2020. Analysis of driver's EEG given take-over alarm in SAE level 3 automated driving in a simulated environment. International journal of automotive technology, 21, 3 (February 2020), 719-728. https://doi.org/10.1007/s12239-020-0070-3Google ScholarCross Ref
- Jiwon Lee, Hanna Yun, Jeawon Kim, Sujin Baek, Hyunseo Han, S. Maryam Fakhr Hosseini, Eric Vasey, Okkeun Lee, Myounghoon Jeon and Ji Hyun Lee. 2019. Design of Single-modal Take-over Request in SAE Level 2 & 3 Automated Vehicle. Transaction of the Korean Society of Automotive Engineers, 27, 3 (March 2019), 171-183. http://doi.org/10.7467/KSAE.2019.27.3.171Google Scholar
- Joakim Östlund, Lena Nilsson, Jan Törnros and Åsa Forsman. 2006. Effects of cognitive and visual load in real and simulated driving. Swedish National Road and Transport Research Institute.Google Scholar
- John L. Campbell, James L. Brown. Justin S. Graving, Christian M. Richard, Monica G. Lichty, Thomas Sanquist, L. Paige Bacon, Robert Woods, Hong Li, Diane N. Williams and Justin F. Morgan. 2016. Human factors design guidance for driver-vehicle interfaces. Report No. DOT HS, 812 360. National Highway Traffic Safety Administraion.Google Scholar
- Jonas Radlmayr, Christian Gold, Lutz Lorenz, Mehdi Farid and Klaus Bengler. 2014. How traffic situations and non-driving related tasks affect the take-over quality in highly automated driving. In Proceedings of the human factors and ergonomics society 58th annual meeting. 2063-2067. https://doi.org/10.1177/1541931214581434Google ScholarCross Ref
- Joris C Verster and Thomas Roth. 2011. Standard operation procedures for conducting the on-the-road driving test, and measurement of the standard deviation of lateral position (SDLP). International journal of general medicine, 4 (May 2011), 359-371. 10.2147/IJGM.S19639Google ScholarCross Ref
- Jusuf Çapalar and & Cristina Olaverri-Monreal. 2017. Hypovigilance in limited self-driving automation: Peripheral visual stimulus for a balanced level of automation and cognitive workload. In 2017 IEEE 20th International Conference on Intelligent Transportation Systems (ITSC). 27-31.10.1109/ITSC.2017.8317925Google ScholarDigital Library
- Karel A. Brookhuis, Gerbrand de Vries and Dick De Waard. 1991. The effects of mobile telephoning on driving performance. Accident Analysis & Prevention. 23, 4 (August 1991), 309-316. https://doi.org/10.1016/0001-4575(91)90008-SGoogle ScholarCross Ref
- M. Mulder, S. Kitazaki, S. Hijikata, Max. Mulder, M.M. van Paassen and E.R. Boer. 2004. Reaction-time task during car-following with an active gas pedal. In 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No. 04CH37583). 3, 2465-2470. 10.1109/ICSMC.2004.1400700Google ScholarCross Ref
- Myounghoon Jeon. 2017. Emotions and affect in human factors and human–computer interaction: Taxonomy, theories, approaches, and methods. In Emotions and affect in human factors and human-computer interaction. (April 2017), 3-26. https://doi.org/10.1016/B978-0-12-801851-4.00001-XGoogle ScholarCross Ref
- Myounghoon Jeon. 2019. Multimodal displays for take-over in level 3 automated vehicles while playing a game. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems. (May 2019). 1-6. https://doi.org/10.1145/3290607.3313056Google ScholarDigital Library
- Reiner Nikula. 1991. Psychological correlates of nonspecific skin conductance responses. Psychophysiology, 28, 1 (January 1991), 86-90. https://doi.org/10.1111/j.1469-8986.1991.tb03392.xGoogle ScholarCross Ref
- SAE On-Road Automated Vehicle Standards Committee. 2021. Taxonomy and definitions for terms related to driving automation systems for on-road motor vehicles. Warrendale: SAE International. https://www.sae.org/standards/content/j3016_202104/Google Scholar
- Sara Hong and Ji Hyun Yang. 2022. Effect of multimodal takeover request issued through A-pillar LED light, earcon, speech message, and haptic seat in conditionally automated driving (UNDER REVIEW).Google Scholar
- Sara Hong, Ho Yung Shim and Ji Hyun Yang. 2020. Simulator study on take-over request under ADS system failure and highway exit situation. KSAE Annual Conference Proceedings, 516.Google Scholar
- Sara Hong, Ho Yung Shim and Ji Hyun Yang. 2021. Simulator study and guidelines for take-over request in partially automated vehicle. In Proceedings of 2021 Spring Conference of ESK, 79–80.Google Scholar
- Sara Hong, Jae Won Kim, Su Jin Baek and Ji Hyun Yang. 2020. Simulator Study on Take-over Request in Partially Automated Vehicle Using Auditory and Haptic Modality. Transaction of the Korean Society of Automotive Engineers, 28, 6 (June 2020), 401-411. https://doi.org/10.7467/KSAE.20120.28.6.401Google Scholar
- Sol Hee Yoon, Young Woo Kim and Yong Gu Ji. 2019. The effects of takeover request modalities on highly automated car control transitions. Accident Analysis & Prevention. 123 (February 2019), 150-158. https://doi.org/10.1016/j.aap.2018.11.018Google Scholar
- Su Jin Baek, Hanna Yun, and Ji Hyun Yang. 2019. How do humans respond when automated vehicles request an immediate vehicle control take-over?. In Proceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications: Adjunct Proceedings (AutomotiveUI '19). 341-345. https://doi.org/10.1145/3349263.3351496Google ScholarDigital Library
- Tania Dukic, Lars Hanson and Torbjörn Falkmer. 2006. Effect of drivers' age and push button locations on visual time off road, steering wheel deviation and safety perception. Ergonomics, 49, 1 (Feb 2007), 78–92. https://doi.org/10.1080/00207540500422320Google ScholarCross Ref
- Tilman Dingler, Jeffrey Lindsay and Bruce N Walker. 2008. Learnability of sound cues for environmental features: Auditory icons, earcons, spearcons, and speech. In proceedings of the 14th International Conference on Auditory Display (ICAD2008), Paris, France, 24-27. http://hdl.handle.net/1853/49940Google Scholar
- Yannick Forster, Frederik Naujoks, Alexandra Neukum and LynnHuestegge. 2017. Driver compliance to take-over requests with different auditory outputs in conditional automation. Accident Analysis & Prevention, 109 (December 2017), 18-28. https://doi.org/10.1016/j.aap.2017.09.019Google Scholar
- Yong Gu Ji, Kwangil Lee and Wonil Hwang. 2011. Haptic perceptions in the vehicle seat. Human Factors and Ergonomics in Manufacturing & Service Industries, 21, 3 (May/June 2011), 305-325. https://doi.org/10.1002/hfm.20235Google ScholarDigital Library
- Youngseok Lee, Yeppeun Lee and Changhyun Jeong. 2019. Development of evaluation environment for driver-vehicle interaction research in Level 3 automated vehicle based on a real road. KSAE Annual Conference Proceedings, 673.Google Scholar
- Yutong Li, Chen Lv and Junliang Xue. 2019. A novel predictive haptic control interface for automation-to-human takeover of automated vehicles. In 2019 IEEE Intelligent Vehicles Symposium (IV). (June 2019), 994-999. 10.1109/IVS.2019.8814252Google ScholarDigital Library
Index Terms
- Development of Warning Methods for Planned and Unplanned Takeover Requests in a Simulated Automated Driving Vehicle
Recommendations
Manual takeover after highly automated driving: Influence of budget time and Lane Change Assist on takeover performance
ECCE '21: Proceedings of the 32nd European Conference on Cognitive ErgonomicsThe current study aimed at investigating the effectiveness of additional assistance system to support driver performance during a takeover request in a conditionally automated vehicle, that is, Level 3 of SAE taxonomy. Seventy drivers participated in ...
The Relationship Between Drowsiness Level and Takeover Performance in Automated Driving
HCI in Mobility, Transport, and Automotive Systems. Driving Behavior, Urban and Smart MobilityAbstractAlthough automated driving systems can perform dynamic driving tasks, at its lower levels, human drivers must still take over control of the vehicle whenever a Take Over Request (TOR) is issued. Human factors such as drowsiness may affect driver ...
Architecture for intelligent transport system for automated vehicle
ACAI '11: Proceedings of the International Conference on Advances in Computing and Artificial IntelligenceAn ITS Automated Vehicle is a vehicle equipped with an autopilot system, which is capable of driving from one point to another without input from a human operator (Driver). It is a proposed system depends on infrastructure-based guidance systems (i.e. ...
Comments