Skip to main content
SpringerLink
Log in
Book cover

Proceedings of SAI Intelligent Systems Conference

IntelliSys 2020: Intelligent Systems and Applications pp 710–723Cite as

Detecting Cues of Driver Fatigue on Facial Appearance

  • Conference paper
  • First Online:

  • 1064 Accesses

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 1250))

Abstract

Driver fatigue causes tragic events and hazardous consequences in transportation systems. Especially, in developing countries, drivers have longer working hours and drive longer distances with short breaks to gain more money. This paper develops a new real time, low cost, and non-intrusive system that detects the features of fatigue drivers. It detects cues from the face of people who didn’t sleep the right hours or who have over worked. It identifies eye-related cues such as red eyes and skin-related cues who have like dark areas under the eye. This work uses CascadeObjectDetector that supports the Haar Cascade Classifier, Local Binary Patterns (LBP) and Histograms of Oriented Gradients (HOG) to develop a new algorithm, and locates the areas under the eye and reference areas on the face to compare the skin color tone. It uses the semi-supervised anomaly detection algorithm to recognize abnormality of the area under the eyes and eye redness. The system was evaluated with 7 participants with different skin colors and various light conditions. The results are very promising. The accuracy is quite high. All cues are detected correctly.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Toyota: Toyota Safety Sensee. https://www.toyota-europe.com/world-of-toyota/safety/toyota-safety-sense. Accessed 28 Mar 2019

  2. Volkswagen: Driver Assist. https://www.volkswagen.co.uk/technology/driver-assist. Accessed 28 Mar 2019

  3. Nissan: Driver Attention Alert. http://www.nissantechnicianinfo.mobi/htmlversions/2015_June-July_Issue2/Driver_Attention_Alert.html. Accessed 28 Mar 2019

  4. F.I. Release and H. I. Works: Nissan’s ‘Driver Attention Alert’ Helps Detect Erratic Driving Caused By Drowsiness and Inattention, pp. 1–2 (2016)

    Google Scholar 

  5. Nosseir, A., Hamad, A., Wahdan, A.: Detecting drivers’ fatigue in different conditions using real time non-intrusive system. In: Fourth International Congress on Information and Communication Technology - ICICT 2019, London, vol. 2, pp. 156–164. Springer, Singapore (2019)

    Google Scholar 

  6. Rastgoo, M.N., Nakisa, B., Rakotonirainy, A., Chandran, V., Tjondronegoro, D.: A critical review of proactive detection of driver stress levels based on multimodal measurements. ACM Comput. Surv. 51(5), 1–35 (2018)

    Article  Google Scholar 

  7. Sundelin, T., Lekander, M., Kecklund, G., Van Someren, E.J.W., Olsson, A., Axelsson, J.: Cues of fatigue: effects of sleep deprivation on facial appearance. Sleep 36(9), 1355–1360 (2013)

    Article  Google Scholar 

  8. Hodge, V.J., Austin, J.: A survey of outlier detection methodologies. Artif. Intell. Rev. 22, 85–126 (2004)

    Article  Google Scholar 

  9. Chowdhury, A., Shankaran, R., Kavakli, M., Haque, M.M.: Sensor applications and physiological features in drivers’ drowsiness detection: a review. IEEE Sens. J. 18(8), 3055–3067 (2018)

    Article  Google Scholar 

  10. Chen, L., Zhao, Y., Zhang, J., Zou, J.: Automatic detection of alertness/drowsiness from physiological signals using wavelet-based nonlinear features and machine learning. Expert Syst. Appl. 42, 7344–7355 (2015)

    Article  Google Scholar 

  11. Chen, J., Wang, H., Hua, C.: Assessment of driver drowsiness using electroencephalogram signals based on multiple functional brain networks. Int. J. Psychophysiol. 133(July), 120–130 (2018)

    Article  Google Scholar 

  12. Wang, P., Min, J., Hu, J.: Ensemble classifier for driver’s fatigue detection based on a single EEG channel. IET Intell. Transp. Syst. 12(10), 1322–1328 (2018)

    Article  Google Scholar 

  13. Wang, F., Wang, H., Fu, R.: Real-time ECG-based detection of fatigue driving using sample entropy. Entropy 20(3), 196 (2018)

    Article  Google Scholar 

  14. Affanni, A., Bernardini, R., Piras, A., Rinaldo, R., Zontone, P.: Driver’s stress detection using skin potential response signals. Meas. J. Int. Meas. Confed. 122, 264–274 (2018)

    Article  Google Scholar 

  15. Papadelis, C., Chen, Z., Kourtidou-papadeli, C.: Monitoring sleepiness with on-board electrophysiological recordings for preventing sleep-deprived traffic accidents. Clin. Neurophysiol. 118, 1906–1922 (2007)

    Article  Google Scholar 

  16. Magaña, V.C., Organero, M.M., Álvarez-García, J.A., Rodríguez, J.Y.F.: Estimation of the optimum speed to minimize the driver stress based on the previous behavior. In: Advances in Intelligent Systems and Computing, vol. 476, pp. 31–39 (2016)

    Google Scholar 

  17. Ramodhine, K., Panchoo, S.: Emerging trends in electrical, electronic and communications engineering. In: Emerging Trends in Electrical, Electronic and Communications Engineering, Lecture Notes in Electrical Engineering, vol. 416 (2017)

    Google Scholar 

  18. Wathiq, O., Ambudkar, B.D.: Optimized driver safety through driver fatigue detection methods. In: International Conference on Trends in Electronics and Informatics ICEI 2017, pp. 68–73 (2017)

    Google Scholar 

  19. Abtahi, S., Hariri, B., Shirmohammadi, S.: Driver Drowsiness Monitoring Based on Yawning Detection, July 2015

    Google Scholar 

  20. Face Recognition Technology (FERET). https://www.nist.gov/programs-projects/face-recognition-technology-feret

  21. Dalal, N. et al.: Histograms of Oriented Gradients for Human Detection To cite this version: HAL Id: inria-00548512 Histograms of Oriented Gradients for Human Detection (2010)

    Google Scholar 

  22. Viola, P., Way, O.M., Jones, M.J.: Robust real-time face detection. Int. J. Comput. Vis. 57(2), 137–154 (2004)

    Article  Google Scholar 

  23. He, D.-C., Wang, L.I.: Texture unit, texture spectrum, and texture analysis. IEEE Trans. Geosci. Remote Sens. 28(4), 509–512 (1990)

    Article  Google Scholar 

  24. Train a Cascade Object Detector. https://uk.mathworks.com/help/vision/ug/train-a-cascade-object-detector.html

Download references

Author information

Authors and Affiliations

  1. British University Egypt, Cairo, Egypt

    Ann Nosseir & Mohamed Esmat El-sayed

  2. Institute of National Planning, Cairo, Egypt

    Ann Nosseir

Authors
  1. Ann Nosseir
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mohamed Esmat El-sayed
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ann Nosseir .

Editor information

Editors and Affiliations

  1. Saga University, Saga, Japan

    Kohei Arai

  2. The Science and Information (SAI) Organization, Bradford, West Yorkshire, UK

    Supriya Kapoor

  3. The Science and Information (SAI) Organization, Bradford, West Yorkshire, UK

    Rahul Bhatia

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Nosseir, A., El-sayed, M.E. (2021). Detecting Cues of Driver Fatigue on Facial Appearance. In: Arai, K., Kapoor, S., Bhatia, R. (eds) Intelligent Systems and Applications. IntelliSys 2020. Advances in Intelligent Systems and Computing, vol 1250. Springer, Cham. https://doi.org/10.1007/978-3-030-55180-3_54

Download citation

Publish with us

Policies and ethics

Search

Navigation