Skip to main content

Advertisement

Log in

Comfortable awakening method for sleeping driver during autonomous driving

  • Published:
International Journal of Intelligent Transportation Systems Research Aims and scope Submit manuscript

Abstract

There is a high possibility that the driver who is relieved from driving will suffer from sleepiness and there is a limit to keeping the driver awake in the system, which may cause a loss in comfort during autonomous driving. In this study, we propose a method for a comfortable awakening by installing a device that can wake up the driver as a safety function in case the driver falls asleep during autonomous driving. We have used existing devices to investigate the stimulation to the driver's five senses through the use of vibration, aroma and facial stimulation and we have evaluated a human machine interface (HMI) device that allows the driver to comfortably wake up from sleep using a driving simulator. The accuracy of driver operation was evaluated as well as physiological indices for heart rate changes before/after awakening and eyelid opening/closing times after waking up. Facial stimulation with air blowing devices (such as air conditioners) was the quickest way for the driver to return from autonomous driving to manual driving. We have shown that existing devices can be used as an HMI for comfortable awakening by applying airflow to the face.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

References

  1. Henze, R., Atabay, O., Raksincharoensak, P.: Monitoring Driver - Vehicle Control in Automated Driving Applications. IFAC-PapersOnLine 49(3), 285–290 (2016)

    Article  Google Scholar 

  2. Stapel, J.: Freddy Antony Mullakkal-Babu, Riender Happee, Automated driving reduces perceived workload, but monitoring causes higher cognitive load than manual driving. Transport. Res. F: Traffic Psychol. Behav. 60, 590–605 (January 2019)

    Article  Google Scholar 

  3. Charles A Czeisler,Emerson M Wickwire, Laura K Barger, William C Dement, Karen Gamble, Natalie Hartenbaum, Maurice M Ohayon, Rafael Pelayo, Barbara Phillips, Kingman Strohl, Brian Tefft, Shantha M W Rajaratnam, Raman Malhotra, Kaitlyn Whiton, Max Hirshkowitz, Sleep-deprived motor vehicle operators are unfit to drive: a multidisciplinary expert consensus statement on drowsy driving, Sleep Health Vol. 2, Issue 2 Pages 94–99 (2016)

  4. Johanna Wörle, Barbara Metz, Ina Othersen, Martin Baumann, Sleep in highly automated driving: Takeover performance after waking up, Accident Analysis & Prevention, DOI: https://doi.org/10.1016/j.aap.2020.105617, 2020

  5. Takehiro Yamakoshi, Peter Rolfe, Yasuhiro Yamakoshi, Hajime Hirose, A novel physiological index for Driver’s Activation State derived from simulated monotonous driving studies, Transportation Research Part C: Emerging Technologies February 2009 Volume 17, Issue 1Pages 69–80

  6. Xuxin Zhang, Xuesong Wang, Xiaohan Yang, Chuan Xu, Xiaohui Zhu, JiaohuaWei, Driver drowsiness detection using mixed-effect ordered logit model considering time cumulative effect, Analytic Methods in Accident Research, Volume 26, June 2020

  7. Gromer, M., Salb, D., Walzer, T.: Natividad Martínez Madrid, Ralf Seepold, ECG sensor for detection of driver’s drowsiness. Procedia Computer Science 159, 1938–1946 (2019)

    Article  Google Scholar 

  8. Boverie, S., Giralt, A.: Driver vigilance diagnostic based on eyelid movement observation. IFAC Proceedings Volumes 41(2), 12831–12836 (2008)

    Article  Google Scholar 

  9. Rami, N.: Khushaba, Sarath Kodagoda, Sara Lal, Gamini Dissanayake, Uncorrelated fuzzy neighborhood preserving analysis based feature projection for driver drowsiness recognition. Fuzzy Sets Syst. 221(16), 90–111 (June 2013)

    Google Scholar 

  10. Junhua Wang, Shuaiyi Sun, Shouen Fang, Ting Fu, Joshua Stipancic, Predicting drowsy driving in real-time situations: Using an advanced driving simulator, accelerated failure time model, and virtual location-based services, Accident Analysis & Prevention Volume 99, Part A, February 2017, Pages 321–329

  11. Murray WJohns, A sleep physiologist's view of the drowsy driver, Transportation Research Part F: Traffic Psychology and Behaviour Volume 3, Issue 4, December 2000, Pages 241–249

  12. Yanbin Wu, Ken Kihara, Yuji Takeda, Toshihisa Sato, Motoyuki Akamatsu, Satoshi Kitazaki, Effects of scheduled manual driving on drowsiness and response to take over request: A simulator study towards understanding drivers in automated driving, Accident Analysis & Prevention, March 2019 Volume 124 Pages 202–209

  13. Takehiro Yamakoshi, Peter Rolfe, Yasuhiro Yamakoshi, Hajime Hirose, A novel physiological index for Driver’s Activation State derived from simulated monotonous driving studiesTransportation Research Part C: Emerging Technologies February 2009 Volume 17, Issue 1Pages 69–80

  14. Rosenbloom, T., Grossman, E.S.: Assessment of performance impairment after short naps with and without sleep inertia. Transport. Res. F: Traffic Psychol. Behav. 52, 1–13 (2018)

    Article  Google Scholar 

  15. Jiao, Y., Deng, Y., Luo, Y., Bao-Liang, Lu.: Driver sleepiness detection from EEG and EOG signals using GAN and LSTM networks. Neurocomputing 408(30), 100–111 (September 2020)

    Article  Google Scholar 

  16. Borghini, G., Astolfi, L., Vecchiato, G., Mattia, D., Babiloni, F.: Measuring neurophysiological signals in aircraft pilots and car drivers for the assessment of mental workload, fatigue and drowsiness. Neurosci. Biobehav. Rev. 44, 58–75 (July 2014)

    Article  Google Scholar 

  17. Hong J. Eoh, Min K. Chung, Seong-Han Kim, Electroencephalographic study of drowsiness in simulated driving with sleep deprivation, International Journal of Industrial ErgonomicsApril 2005Volume 35, Issue 4Pages 307–320

  18. Sadegh Arefnezhad, Sajjad Samiee, Arno Eichberger, Matthias Frühwirth, Clemens Kaufmann, Emma Klotz, Applying deep neural networks for multi-level classification of driver drowsiness using Vehicle-based measures, Expert Systems with Applications Volume 162, 30 December 2020, 113778

  19. Alexander P.Wolkow, Shantha M.W.Rajaratnam, Vanessa Wilkinson, Dexter Shee, Angela Baker, Teri LillingtonB.M.B.S, F.A.F.O.E.M (RACP), Peter Roest, Bernd MarxBBAE, Carmen Chew, Andrew Tucker, Shamsul Haque, Alexandre Schaefer, Mark E.Howard, The impact of heart rate-based drowsiness monitoring on adverse driving events in heavy vehicle drivers under naturalistic conditions, Sleep Health, Volume 6, Issue 3, June 2020, Pages 366–373

  20. Hirsch, M., Diederichs, F., Widlroither, H., Graf, R., Bischoff, S.: Sleep and take-over in automated driving, International Journal of Transportation. Science and Technology 9(1), 42–51 (2020)

    Google Scholar 

  21. T.T. Postolache, U.K. Raheja, Body Rhythms / Biological Clocks, Encyclopedia of Mental Health (Second Edition) 193–203 (2016).

  22. Sohoglu, E., Neuroscience, A.: Sounding Out the Brain Basis of Speech Perception. Curr. Biol. 29(12), R582–R584 (2019)

    Article  Google Scholar 

  23. Eto, K., Yamazaki, A.K., Mukuda, M., Kabasawa, Y., Yoshida, H., Ito, K., Ogiwara, M.: Analysis of Effects of Aroma Foot Care Using Functional Near-infrared Spectroscopy. Procedia Computer Science 35, 1539–1546 (2014)

    Article  Google Scholar 

  24. Nadia Mullen, Judith Charlton, Anna Devlin, Michel Bedard, Simulator validity: Behaviours observed on the simulator and on the road, Handbook of Driving Simulation for Engineering, Medicine and Psychology, 1–18 (2011).

  25. Ashis Kumar Das, Prashant Kumar, Suman Halder, Anwesha Banerjee, D.N. Tibarewala, A Laboratory Based Experimental Evaluation of Ocular Parameters as Fatigue and Drowsiness Measures, Procedia Computer Science 167 (2020) 2051–2059.

  26. Wilbert G. Aguilar, Jorge I. Estrella, William López, Vanessa Abad, Driver Fatigue Detection Based on Real-Time Eye Gaze Pattern Analysis, ICIRA 2017: Intelligent Robotics and Applications pp 683–694

  27. Fukuda, K., Hayami, T., Shidoji, K., Matsuo, T.: The effect of stimulus location and Inter-Stimulus Intervals (ISI) upon blink activity. Int. J. Psychophysiol. 69(3), 229–230 (2008)

    Article  Google Scholar 

  28. Mortazavi, A., Eskandarian, A., Sayed, R.A.: Effect of drowsiness on driving performance variables of commercial vehicle drivers. Int. J. Automot. Technol. 10, 391–404 (2009)

    Article  Google Scholar 

  29. Jasper S. Wijnands, Jason Thompson, Kerry A. Nice, Gideon D. P. A. Aschwanden & Mark Stevenson, Real-time monitoring of driver drowsiness on mobile platforms using 3D neural networks, Neural Computing and Applications volume 32, pages9731?9743(2020)

  30. D. Selvathi, FPGA Based Human Fatigue and Drowsiness Detection System Using Deep Neural Network for Vehicle Drivers in Road Accident Avoidance System, Human Behaviour Analysis Using Intelligent Systems pp 69–91

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Shigeyuki Yamabe.

Ethics declarations

Conflict of Interest

The authors declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Yamabe, S., Kawaguchi, S. & Anakubo, M. Comfortable awakening method for sleeping driver during autonomous driving. Int. J. ITS Res. 20, 266–278 (2022). https://doi.org/10.1007/s13177-021-00291-0

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s13177-021-00291-0

Keywords

Navigation