Skip to main content

Long Short-Term Memory Networks for Driver Drowsiness and Stress Prediction

  • Conference paper
  • First Online:
Intelligent Computing and Optimization (ICO 2020)

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 1324))

Included in the following conference series:

Abstract

Road safety is crucial to prevent traffic deaths and injuries of drivers, passengers, and pedestrians. Various regulations and policies have been proposed to aim at reducing the number of traffic deaths and injuries. However, these figures have remained steady in recent decade. There has been an increasing number of research works on the prediction of driver status which gives warning before undesired status, for instance drowsiness and stress. In this paper, a long short-term memory networks is proposed for generic design of driver drowsiness prediction and driver stress prediction models using electrocardiogram (ECG) signals. The proposed model achieves sensitivity, specificity, and accuracy of 71.0–81.1%, 72.9–81.9%, and 72.2–81.5%, respectively, for driver drowsiness prediction. They are 68.2–79.3%, 71.6–80.2%, and 70.8–79.7%, for driver stress prediction. The results have demonstrated the feasibility of generic model for both drowsiness and stress prediction. Future research directions have been shared to enhance the model performance.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Global Status Report on Road Safety 2018, World Health Organization. https://www.who.int/publications/i/item/global-status-report-on-road-safety-2018

  2. Transforming Our World: The 2030 Agenda for Sustainable Development, United Nations. http://sustainabledevelopment.un.org

  3. Das, S., Geedipally, S.R., Dixon, K., Sun, X., Ma, C.: Measuring the effectiveness of vehicle inspection regulations in different states of the US. Transp. Res. Rec. 2673, 208–219 (2019)

    Article  Google Scholar 

  4. Alonso, F., Esteban, C., Useche, S., Colomer, N.: Effect of road safety education on road risky behaviors of Spanish children and adolescents: findings from a national study. Int. J. Environ. Res. Public Health 15, 2828 (2018)

    Article  Google Scholar 

  5. Castillo-Manzano, J.I., Castro-Nuño, M., López-Valpuesta, L., Pedregal, D.J.: From legislation to compliance: the power of traffic law enforcement for the case study of Spain. Transp. Policy 75, 1–9 (2019)

    Article  Google Scholar 

  6. Silvano, A.P., Koutsopoulos, H.N., Farah, H.: Free flow speed estimation: a probabilistic, latent approach. Impact of speed limit changes and road characteristics. Transport. Res. A-Pol. 138, 283–298 (2020)

    Google Scholar 

  7. Choi, J., Lee, K., Kim, H., An, S., Nam, D.: Classification of inter-urban highway drivers’ resting behavior for advanced driver-assistance system technologies using vehicle trajectory data from car navigation systems. Sustainability 12, 5936 (2020)

    Article  Google Scholar 

  8. Royal, D., Street, F., Suite, N.W.: National Survey of Distracted and Drowsy Driving Attitudes and Behavior. Technical report, National Highway Traffic Safety Administration (2002)

    Google Scholar 

  9. Pfeiffer, J.L., Pueschel, K., Seifert, D.: Interpersonal violence in road rage. Cases from the medico-legal center for victims of violence in Hamburg. J. Forens. Leg. Med. 39, 42–45 (2016)

    Google Scholar 

  10. Dua, M., Singla, R., Raj, S., Jangra, A.: Deep CNN models-based ensemble approach to driver drowsiness detection. Neural Comput. Appl. 32, 1–14 (2020)

    Google Scholar 

  11. Zhang, X., Wang, X., Yang, X., Xu, C., Zhu, X., Wei, J.: Driver drowsiness detection using mixed-effect ordered logit model considering time cumulative effect. Anal. Meth. Accid. Res. 26, 100114 (2020)

    Google Scholar 

  12. Chung, W.Y., Chong, T.W., Lee, B.G.: Methods to detect and reduce driver stress: a review. Int. J. Automot. Technol. 20, 1051–1063 (2019)

    Google Scholar 

  13. Kyriakou, K., Resch, B., Sagl, G., Petutschnig, A., Werner, C., Niederseer, D., Liedlgruber, M., Wilhelm, F.H., Osborne, T., Pykett, J.: Detecting moments of stress from measurements of wearable physiological sensors. Sensors 19, 3805 (2019)

    Google Scholar 

  14. Dickerson, A.E., Reistetter, T.A., Burhans, S., Apple, K.: Typical brake reaction times across the life span. Occup. Ther. Health Care 30, 115–123 (2016)

    Article  Google Scholar 

  15. Arbabzadeh, N., Jafari, M., Jalayer, M., Jiang, S., Kharbeche, M.: A hybrid approach for identifying factors affecting driver reaction time using naturalistic driving data. Transp. Res. Part C Emerg. Technol. 100, 107–124 (2019)

    Article  Google Scholar 

  16. Saurav, S., Mathur, S., Sang, I., Prasad, S.S., Singh, S.: Yawn detection for driver’s drowsiness prediction using bi-directional LSTM with CNN features. In: International Conference on Intelligent Human Computer Interaction, pp. 189–200. Springer, Cham (2019)

    Google Scholar 

  17. Gwak, J., Hirao, A., Shino, M.: An investigation of early detection of driver drowsiness using ensemble machine learning based on hybrid sensing. Appl. Sci. 10, 2890 (2020)

    Article  Google Scholar 

  18. Nguyen, T., Ahn, S., Jang, H., Jun, S.C., Kim, J.G.: Utilization of a combined EEG/NIRS system to predict driver drowsiness. Sci. Rep. 7, 43933 (2017)

    Article  Google Scholar 

  19. de Naurois, C.J., Bourdin, C., Bougard, C., Vercher, J.L.: Adapting artificial neural networks to a specific driver enhances detection and prediction of drowsiness. Accid. Anal. Prev. 121, 118–128 (2018)

    Article  Google Scholar 

  20. Hadi, W.E., El-Khalili, N., AlNashashibi, M., Issa, G., AlBanna, A.A.: Application of data mining algorithms for improving stress prediction of automobile drivers: a case study in Jordan. Comput. Biol. Med. 114, 103474 (2019)

    Article  Google Scholar 

  21. Alharthi, R., Alharthi, R., Guthier, B., El Saddik, A.: CASP: context-aware stress prediction system. Multimed. Tools Appl. 78, 9011–9031 (2019)

    Article  Google Scholar 

  22. Bitkina, O.V., Kim, J., Park, J., Park, J., Kim, H.K.: Identifying traffic context using driving stress: a longitudinal preliminary case study. Sensors 19, 2152 (2019)

    Article  Google Scholar 

  23. Magana, V.C., Munoz-Organero, M.: Toward safer highways: predicting driver stress in varying conditions on habitual routes. IEEE Veh. Technol. Mag. 12, 69–76 (2017)

    Article  Google Scholar 

  24. Terzano, M.G., Parrino, L., Sherieri, A., Chervin, R., Chokroverty, S., Guilleminault, C., Hirshkowitz, M., Mahowald, M., Moldofsky, H., Rosa, A., et al.: Atlas, rules, and recording techniques for the scoring of cyclic alternating pattern (CAP) in human sleep. Sleep Med. 2, 537–553 (2001)

    Article  Google Scholar 

  25. Goldberger, A.L., Amaral, L.A.N., Glass, L., Hausdorff, J.M., Ivanov, P.C.H., Mark, R.G., Mietus, J.E., Moody, G.B., Peng, C.K., Stanley, H.E.: PhysioBank, PhysioToolkit, and PhysioNet: components of a new research resource for complex physiologic signals. Circulation 101, e215–e220 (2003)

    Google Scholar 

  26. Healey, J.A., Picard, R.W.: Detecting stress during real-world driving tasks using physiological sensors. IEEE Trans. Intell. Transp. 6, 156–166 (2005)

    Article  Google Scholar 

  27. Tompkins, W.J.: Biomedical Digital Signal Processing C-Language Examples and Laboratory Experiments for the IBM®PC. pp. 236–264. Prentice Hall, Upper Saddle River (2000)

    Google Scholar 

  28. Kohler, B.U., Hennig, C., Orglmeister, R.: The principles of software QRS detection. IEEE Eng. Med. Biol. 21, 42–57 (2002)

    Article  Google Scholar 

  29. Azbari, P.G., Abdolghaffar, M., Mohaqeqi, S., Pooyan, M., Ahmadian, A., Gashti, N.G.: A novel approach to the extraction of fetal electrocardiogram based on empirical mode decomposition and correlation analysis. Aust. Phys. Eng. Sci. Med. 40, 565–574 (2017)

    Google Scholar 

  30. Chui, K.T., Fung, D.C.L., Lytras, M.D., Lam, T.M.: Predicting at-risk university students in a virtual learning environment via a machine learning algorithm. Comput. Hum. Behav. 107, 105584 (2020)

    Article  Google Scholar 

  31. Wong, T.T., Yeh, P.Y.: Reliable accuracy estimates from k-fold cross validation. IEEE Trans. Knowl. Data Eng. 32, 1586–1594 (2020)

    Article  Google Scholar 

  32. Sun, Y., Yu, X.: An innovative nonintrusive driver assistance system for vital signal monitoring. IEEE J. Biomed. Health Inform. 18, 1932–1939 (2014)

    Article  Google Scholar 

  33. Savku, E., Weber, G.W.: A stochastic maximum principle for a Markov regime-switching jump-diffusion model with delay and an application to finance. J. Optim. Theory Appl. 179, 696–721 (2018)

    Google Scholar 

  34. Vasant, P., Zelinka, I., Weber, G.W. (eds.): Intelligent Computing & Optimization, vol. 866. Springer, Cham (2018)

    Google Scholar 

  35. Vasant, P., Zelinka, I., Weber, G.W. (eds.): Intelligent computing and optimization. In: Proceedings of the 2nd International Conference on Intelligent Computing and Optimization 2019. Springer, Cham (2019)

    Google Scholar 

Download references

Acknowledgments

The work described in this paper was fully supported by the Open University of Hong Kong Research Grant (No. 2019/1.7).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Kwok Tai Chui .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Chui, K.T., Zhao, M., Gupta, B.B. (2021). Long Short-Term Memory Networks for Driver Drowsiness and Stress Prediction. In: Vasant, P., Zelinka, I., Weber, GW. (eds) Intelligent Computing and Optimization. ICO 2020. Advances in Intelligent Systems and Computing, vol 1324. Springer, Cham. https://doi.org/10.1007/978-3-030-68154-8_58

Download citation

Publish with us

Policies and ethics