Skip to main content
SpringerLink
Log in

Dynamic set point model for driver alert state using digital image processing

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

The driver fatigue and lose of attention while driving are the most important causes of traffic accidents. Each year more than one million of deaths occur due to these facts. Thus, this problem has been converted into a serious social issue with high impact not only in economic terms, but also in the public health sector all around the world. Several approaches based on computer vision systems have been proposed to deal with this severe situation, but none of them have fully considered the non-fatigue state as a primary knowledge to detect an unusual event of a person while driving. In fact, typical approaches to deal with the problem of fatigue detection, are based on the analysis of behavioral features extracted with digital image processing such as frequency of blinking, yawning, among others. However, the huge limitation is the short interval of time between each analysis, that generally is few frames per second. Furthermore, all available methods are focus in modeling the fatigue, instead of representing the set point alert state of the driver, which is the main core of the proposed strategy. Hence, in this paper a dynamic set point model for alert state while driving using digital image processing and machine learning techniques is presented. The approach uses an embedded system build with a Raspberry prototyping board and a USB HD camera. Raspbian operative system controls OPEN CV libraries written in Python to detect face parts with an algorithm running Harr descriptors. The features extracted were the position and orientation of the head throw several minutes. Then, a mixture of Gaussians model with its learning and updating stages is used to represent the behaviour of features. Also, a dataset was built considering professional and non-professional drivers under two main scenarios: real and simulated conditions. Experimental results show the viability of the method for posterior analysis of unusual events while driving like fatigue detection, cellphone call or chat detection, or any other distraction not related to the driving process.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  1. Abdulin E, Komogortsev O (2015) User eye fatigue detection via eye movement behavior. In: Proceedings of the 33rd annual ACM conference extended abstracts on human factors in computing systems, pp 1265–1270

  2. Abulkhair M, Alsahli AH, Taleb KM, Bahran AM, Alzahrani FM, Alzahrani HA, Ibrahim LF (2015) Mobile platform detect and alerts system for driver fatigue. Procedia Comput Sci 62:555--564

    Article  Google Scholar 

  3. Bradski G, Kaehler A (2008) Learning OpenCV: Computer vision with the OpenCV library. “O’Reilly Media, Inc.”

  4. Chai R, Naik GR, Tran Y, Ling SH, Craig A, Nguyen HT (2015) Classification of driver fatigue in an electroencephalography-based countermeasure system with source separation module. In: 2015 37th annual international conference of the IEEE engineering in medicine and biology society (EMBC), pp 514–517

  5. Chan AB, Mahadevan V, Vasconcelos N (2011) Generalized Stauffer–Grimson background subtraction for dynamic scenes. Mach Vis Appl 22(5):751–766

    Article  Google Scholar 

  6. Craye C, Rashwan A, Kamel MS, Karray F (2016) A multi-modal driver fatigue and distraction assessment system. Int J Intell Transp Syst Res 14(3):173–194

    Google Scholar 

  7. Consejo Nacional para la Prevención de Accidentes (2013) Tercer informe sobre la situación de la seguridad vial, Mé,xico 2013, Accessed 1 December 2015

  8. Dahiphale VE, Sathyanarayana R, Mukhedkar MM (2015) Computer vision system for driver fatigue detection. Computer, IJARECE 4(9):2331–2334

    Google Scholar 

  9. Eskandarian A, Sayed R, Delaigue P, Mortazavi A, Blum J (2007) Advanced driver fatigue research. U.S. Department of Transportation, Accessed 1 December 2015

  10. Freund Y, Schapire RE (1996) Experiments with a new boosting algorithm. Int Conf Mach Learn 96:148–156

    Google Scholar 

  11. Gao XY, Zhang YF, Zheng WL, Lu BL (2015) Evaluating driving fatigue detection algorithms using eye tracking glasses. In: 2015 7th international IEEE/EMBS conference on neural engineering (NER), pp 767–770

  12. Goyal R (2015) Fatigue Detection Using Artificial Intelligence and Computer Vision Algorithms. 2015 AAAS Annual Meeting (12–16 February 2015)

  13. Ji Q, Yang X (2002) Real-time eye, gaze, and face pose tracking for monitoring driver vigilance. Real-Time Imaging 8(5):357–377

    Article  MATH  Google Scholar 

  14. Kong W, Zhou L, Wang Y, Zhang J, Liu J, Gao S (2015) A system of driving fatigue detection based on machine vision and its application on smart device. J Sens 2015:1–11

    Article  Google Scholar 

  15. Li Z, Sun G, Zhang F, Jia L, Zheng K, Zhao D (2015) Smartphone-based fatigue detection system using progressive locating method. IET Intelligent Transport Systems

  16. Liu Y, Nie L, Liu L, Rosenblum DS (2016) From action to activity: sensor-based activity recognition. Neurocomputing 181:108–115

    Article  Google Scholar 

  17. Liu YE, Nie L, Han L, Zhang L, Rosenblum DS (2015) Action2Activity: Recognizing complex activities from sensor data. IJCAI, pp 1617–1623

  18. McLachlan GJ, Basford KE (1988) Mixture models marcel Dekker. New York

  19. Moon TK (1996) The expectation-maximization algorithm. IEEE Signal Process Mag 13(6):47–60

    Article  Google Scholar 

  20. Mu Z (2015) Fatigue Detection Method based on Common Spatial Subspace Decomposition. In: 2015 international conference on education, management, information and medicine, pp 1031--1034

  21. Papadelis C, Kourtidou-Papadeli C, Bamidis PD, Chouvarda I, Koufogiannis D, Bekiaris E, Maglaveras N (2006) Indicators of sleepiness in an ambulatory EEG study of night driving. In: 28th annual international conference of the IEEE engineering in medicine and biology society, 2006. EMBS’06, pp 6201–6204

  22. Patel SP, Patel BP, Sharma M, Shukla N, Patel HM (2015) Detection of Drowsiness and Fatigue level of Driver. Int J Innovative Res Sci Technol 1(11):133–138

    Google Scholar 

  23. Reynolds DA, Quatieri TF, Dunn RB (2000) Speaker verification using adapted Gaussian mixture models. Digital Signal Process 10(1–3):19–41

    Article  Google Scholar 

  24. Shen HM, Xu MH (2015) Design and implementation of embedded driver fatigue monitor system. In: 2015 international conference on artificial intelligence and industrial engineering AIIE, vol 2015, pp 103–106

  25. Sigari MH, Pourshahabi MR, Soryani M, Fathy M (2014) A review on driver face monitoring systems for fatigue and distraction detection. Int J Adv Sci Technol 64:73–100

    Article  Google Scholar 

  26. Stauffer C, Grimson W (1999) Adaptive background mixture models for real-time tracking. In: CVPR, pp 246–52

  27. Sun KJ, Yang XX, Yang L, Cui JX, Zhang S, Lu Y (2015) Research on the progress of physiological signal-based method for fatigue driving risks detection. In: Proceedings of the 2014 international conference on multimedia, communication and computing application MCCA, vol 2014, pp 269--271

  28. Tanaka M Face detection parts, Accessed 1 December 2015. http://like.silk.to/matlab/detectFaceParts. html

  29. Tansakul W, Tangamchit P (2016) Fatigue driver detection system using a combination of blinking rate and driving inactivity. J Auto Control Eng 4(1):33–39

    Google Scholar 

  30. Viola P, Jones MJ (2004) Robust real-time face detection. Int J Comput Vis 57(2):137–154

    Article  Google Scholar 

  31. Wang P, Mu Z (2015) Studies of brain fatigue detection method based on second-order blind identification. In: 2015 international conference on education, managementm information and medicine, pp 538–541

  32. Wang Q, Tang L, Yang K (2015) Driver fatigue detection algorithm research based on the characteristics of eyes. Appl Mech Mater 701:30–35

    Article  Google Scholar 

  33. Wang YQ (2014) An analysis of the Viola-Jones face detection algorithm. Image Process Line 4:128–148

    Article  Google Scholar 

  34. Wilson PI, Fernandez J (2006) Facial feature detection using Haar classifiers. J Comput Sci Coll 21(4):127–133

    Google Scholar 

  35. World Health Organization (2013) Global status report on road safety 2013. supporting a decade of action, Accessed 1 December 2015

  36. Zhang L, Liu F, Tang J (2015) Real-time system for driver fatigue detection by RGB-D camera. ACM Trans Intell Syst Technol (TIST) 6(2):22:1–22:17

    Google Scholar 

Download references

Acknowledgments

Authors would like to acknowledge the financial support of this work by grants from Consejo Nacional de Ciencia y Tecnologia (CONACYT), Mexico, under Sistema Nacional de Investigadores (SNI) program.

The paper was made in memory ofPhD. Miguel Angel Flores.

Author information

Authors and Affiliations

  1. Universidad Politécnica de Querétaro, Carretera Estatal 420-S/N, El Marqués, Qro, México

    Cesar Isaza, Karina Anaya, Carlos Fuentes-Silva, Jonny Paul Zavala de Paz, Amilcar Rizzo & Angel-Ivan Garcia-Moreno

Authors
  1. Cesar Isaza
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Karina Anaya
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Carlos Fuentes-Silva
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jonny Paul Zavala de Paz
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Amilcar Rizzo
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Angel-Ivan Garcia-Moreno
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Cesar Isaza.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

This research was partially supported with a grant from Secretaria de Educacion Publica under grant Nuevos PTC F-PROMEP-38/Rev-03-SEP-23-005

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Isaza, C., Anaya, K., Fuentes-Silva, C. et al. Dynamic set point model for driver alert state using digital image processing. Multimed Tools Appl 78, 19543–19563 (2019). https://doi.org/10.1007/s11042-019-7218-z

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-019-7218-z

Keywords

Search

Navigation