Abstract
There is a high possibility that the driver who is relieved from driving will suffer from sleepiness and there is a limit to keeping the driver awake in the system, which may cause a loss in comfort during autonomous driving. In this study, we propose a method for a comfortable awakening by installing a device that can wake up the driver as a safety function in case the driver falls asleep during autonomous driving. We have used existing devices to investigate the stimulation to the driver's five senses through the use of vibration, aroma and facial stimulation and we have evaluated a human machine interface (HMI) device that allows the driver to comfortably wake up from sleep using a driving simulator. The accuracy of driver operation was evaluated as well as physiological indices for heart rate changes before/after awakening and eyelid opening/closing times after waking up. Facial stimulation with air blowing devices (such as air conditioners) was the quickest way for the driver to return from autonomous driving to manual driving. We have shown that existing devices can be used as an HMI for comfortable awakening by applying airflow to the face.












Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Henze, R., Atabay, O., Raksincharoensak, P.: Monitoring Driver - Vehicle Control in Automated Driving Applications. IFAC-PapersOnLine 49(3), 285–290 (2016)
Stapel, J.: Freddy Antony Mullakkal-Babu, Riender Happee, Automated driving reduces perceived workload, but monitoring causes higher cognitive load than manual driving. Transport. Res. F: Traffic Psychol. Behav. 60, 590–605 (January 2019)
Charles A Czeisler,Emerson M Wickwire, Laura K Barger, William C Dement, Karen Gamble, Natalie Hartenbaum, Maurice M Ohayon, Rafael Pelayo, Barbara Phillips, Kingman Strohl, Brian Tefft, Shantha M W Rajaratnam, Raman Malhotra, Kaitlyn Whiton, Max Hirshkowitz, Sleep-deprived motor vehicle operators are unfit to drive: a multidisciplinary expert consensus statement on drowsy driving, Sleep Health Vol. 2, Issue 2 Pages 94–99 (2016)
Johanna Wörle, Barbara Metz, Ina Othersen, Martin Baumann, Sleep in highly automated driving: Takeover performance after waking up, Accident Analysis & Prevention, DOI: https://doi.org/10.1016/j.aap.2020.105617, 2020
Takehiro Yamakoshi, Peter Rolfe, Yasuhiro Yamakoshi, Hajime Hirose, A novel physiological index for Driver’s Activation State derived from simulated monotonous driving studies, Transportation Research Part C: Emerging Technologies February 2009 Volume 17, Issue 1Pages 69–80
Xuxin Zhang, Xuesong Wang, Xiaohan Yang, Chuan Xu, Xiaohui Zhu, JiaohuaWei, Driver drowsiness detection using mixed-effect ordered logit model considering time cumulative effect, Analytic Methods in Accident Research, Volume 26, June 2020
Gromer, M., Salb, D., Walzer, T.: Natividad Martínez Madrid, Ralf Seepold, ECG sensor for detection of driver’s drowsiness. Procedia Computer Science 159, 1938–1946 (2019)
Boverie, S., Giralt, A.: Driver vigilance diagnostic based on eyelid movement observation. IFAC Proceedings Volumes 41(2), 12831–12836 (2008)
Rami, N.: Khushaba, Sarath Kodagoda, Sara Lal, Gamini Dissanayake, Uncorrelated fuzzy neighborhood preserving analysis based feature projection for driver drowsiness recognition. Fuzzy Sets Syst. 221(16), 90–111 (June 2013)
Junhua Wang, Shuaiyi Sun, Shouen Fang, Ting Fu, Joshua Stipancic, Predicting drowsy driving in real-time situations: Using an advanced driving simulator, accelerated failure time model, and virtual location-based services, Accident Analysis & Prevention Volume 99, Part A, February 2017, Pages 321–329
Murray WJohns, A sleep physiologist's view of the drowsy driver, Transportation Research Part F: Traffic Psychology and Behaviour Volume 3, Issue 4, December 2000, Pages 241–249
Yanbin Wu, Ken Kihara, Yuji Takeda, Toshihisa Sato, Motoyuki Akamatsu, Satoshi Kitazaki, Effects of scheduled manual driving on drowsiness and response to take over request: A simulator study towards understanding drivers in automated driving, Accident Analysis & Prevention, March 2019 Volume 124 Pages 202–209
Takehiro Yamakoshi, Peter Rolfe, Yasuhiro Yamakoshi, Hajime Hirose, A novel physiological index for Driver’s Activation State derived from simulated monotonous driving studiesTransportation Research Part C: Emerging Technologies February 2009 Volume 17, Issue 1Pages 69–80
Rosenbloom, T., Grossman, E.S.: Assessment of performance impairment after short naps with and without sleep inertia. Transport. Res. F: Traffic Psychol. Behav. 52, 1–13 (2018)
Jiao, Y., Deng, Y., Luo, Y., Bao-Liang, Lu.: Driver sleepiness detection from EEG and EOG signals using GAN and LSTM networks. Neurocomputing 408(30), 100–111 (September 2020)
Borghini, G., Astolfi, L., Vecchiato, G., Mattia, D., Babiloni, F.: Measuring neurophysiological signals in aircraft pilots and car drivers for the assessment of mental workload, fatigue and drowsiness. Neurosci. Biobehav. Rev. 44, 58–75 (July 2014)
Hong J. Eoh, Min K. Chung, Seong-Han Kim, Electroencephalographic study of drowsiness in simulated driving with sleep deprivation, International Journal of Industrial ErgonomicsApril 2005Volume 35, Issue 4Pages 307–320
Sadegh Arefnezhad, Sajjad Samiee, Arno Eichberger, Matthias Frühwirth, Clemens Kaufmann, Emma Klotz, Applying deep neural networks for multi-level classification of driver drowsiness using Vehicle-based measures, Expert Systems with Applications Volume 162, 30 December 2020, 113778
Alexander P.Wolkow, Shantha M.W.Rajaratnam, Vanessa Wilkinson, Dexter Shee, Angela Baker, Teri LillingtonB.M.B.S, F.A.F.O.E.M (RACP), Peter Roest, Bernd MarxBBAE, Carmen Chew, Andrew Tucker, Shamsul Haque, Alexandre Schaefer, Mark E.Howard, The impact of heart rate-based drowsiness monitoring on adverse driving events in heavy vehicle drivers under naturalistic conditions, Sleep Health, Volume 6, Issue 3, June 2020, Pages 366–373
Hirsch, M., Diederichs, F., Widlroither, H., Graf, R., Bischoff, S.: Sleep and take-over in automated driving, International Journal of Transportation. Science and Technology 9(1), 42–51 (2020)
T.T. Postolache, U.K. Raheja, Body Rhythms / Biological Clocks, Encyclopedia of Mental Health (Second Edition) 193–203 (2016).
Sohoglu, E., Neuroscience, A.: Sounding Out the Brain Basis of Speech Perception. Curr. Biol. 29(12), R582–R584 (2019)
Eto, K., Yamazaki, A.K., Mukuda, M., Kabasawa, Y., Yoshida, H., Ito, K., Ogiwara, M.: Analysis of Effects of Aroma Foot Care Using Functional Near-infrared Spectroscopy. Procedia Computer Science 35, 1539–1546 (2014)
Nadia Mullen, Judith Charlton, Anna Devlin, Michel Bedard, Simulator validity: Behaviours observed on the simulator and on the road, Handbook of Driving Simulation for Engineering, Medicine and Psychology, 1–18 (2011).
Ashis Kumar Das, Prashant Kumar, Suman Halder, Anwesha Banerjee, D.N. Tibarewala, A Laboratory Based Experimental Evaluation of Ocular Parameters as Fatigue and Drowsiness Measures, Procedia Computer Science 167 (2020) 2051–2059.
Wilbert G. Aguilar, Jorge I. Estrella, William López, Vanessa Abad, Driver Fatigue Detection Based on Real-Time Eye Gaze Pattern Analysis, ICIRA 2017: Intelligent Robotics and Applications pp 683–694
Fukuda, K., Hayami, T., Shidoji, K., Matsuo, T.: The effect of stimulus location and Inter-Stimulus Intervals (ISI) upon blink activity. Int. J. Psychophysiol. 69(3), 229–230 (2008)
Mortazavi, A., Eskandarian, A., Sayed, R.A.: Effect of drowsiness on driving performance variables of commercial vehicle drivers. Int. J. Automot. Technol. 10, 391–404 (2009)
Jasper S. Wijnands, Jason Thompson, Kerry A. Nice, Gideon D. P. A. Aschwanden & Mark Stevenson, Real-time monitoring of driver drowsiness on mobile platforms using 3D neural networks, Neural Computing and Applications volume 32, pages9731?9743(2020)
D. Selvathi, FPGA Based Human Fatigue and Drowsiness Detection System Using Deep Neural Network for Vehicle Drivers in Road Accident Avoidance System, Human Behaviour Analysis Using Intelligent Systems pp 69–91
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interest
The authors declare that they have no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Yamabe, S., Kawaguchi, S. & Anakubo, M. Comfortable awakening method for sleeping driver during autonomous driving. Int. J. ITS Res. 20, 266–278 (2022). https://doi.org/10.1007/s13177-021-00291-0
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s13177-021-00291-0