Abstract
Drowsiness is a transition state between being awake and asleep and can have serious consequences when occurring in tasks that require sustained attention such as driving. During the state of drowsiness, reaction time is slower, vigilance is reduced, and information processing is less efficient, which may cause accidents. The proposed Driver Fatigue Detection System (called FDS) aims to monitor the alertness of drivers to prevent them from falling asleep at the wheel. The system monitors the driver’s face using Haar feature classifiers with an increased training set to detect changes in the face of the driver quickly. A correlation matching algorithm is used to accurately provide the target’s position and track the target’s eyes according to the intensity, shape, and size of the pupils. FDS uses an IR illuminator to produce the desired bright pupil effect when the driver is wearing sunglasses. The resulting system operates in real-time, and is more accurate and less intrusive to the driver than other systems currently available.









Similar content being viewed by others
References
Adolf F (2003) How-to build a cascade of boosted classifiers based on Haar-like features. http://lab.cntl.kyutech.ac.jp/~kobalab/nishida/opencv/OpenCV_ObjectDetection_HowTo.pdf Accessed 12 Jan 2012
Boyraz P, Hansen J (2008) Active accident avoidance case study: integrating drowsiness monitoring system with lateral control and speed regulation in passenger vehicles. In: IEEE International Conference on Vehicular Electronics and Safety, ICVES 2008, pp 293–298
Breuer J (2008) Attention assist: Don’t fall asleep! Daimler Tech Report
Cho J, Mirzaei S, Oberg J, Kastner R (2009) FPGA-based face detection system using Haar classifiers. ACM/SIGDA International Symposium on Field-Programmable Gate Arrays, FPGA’09, pp xx–xx
Coetzer RC, Hancke GP (2009) Driver fatigue detection: a survey. In: Proceedings of the AFRICON ’09 Conference, pp 8587–8591
Coetzer RC, Hancke GP (2011) Eye detection for a real-time vehicle driver fatigue monitoring system. In: IEEE Intelligent Vehicles Symposium (IV 2011), pp 66–71
Devi MS, Bajaj PR (2008) Driver fatigue detection based on eye tracking. In: International Conference on Emerging Trends in Engineering and Technology, pp 649–652
Dinges DF, Mallis MM, Maislin G, Powell JW (1998) Evaluation of techniques for ocular measurement as an index of fatigue and the basis for alertness management. Department of transport safety 808(762)
Dollar P et al (2009) Pedestrian detection a benchmark. In: IEEE Conference on Computer Vision and Pattern Recognition, pp 304–311
Eskandarian A, Mortazavi A (2007) Evaluation of a smart algorithm for commercial vehicle driver drowsiness detection. In: IEEE Intelligent Vehicles Symposium, pp 553–559
Freund Y, Schapire RE (1997) A decision-theoretic generalization of on-line learning and application to boosting. J Comput Syst Sci 55:119–139
Grace G (2012) Drowsy Driver Monitor and Warning System. http://www.attentiontechnology.com/docs/DrowsyDriverMonitor.pdf. Accessed 15 Jan
Hong T, Qin H, Sun Q (2007) An improved real time eye state identification system in driver drowsiness detection. In: IEEE International Conference on Control and Automation, pp 1449–1453
Intel Corporation (2001) Open Computer Vision Library Reference Manual, CCSC: South Central Conference
Kaufman J (2006) Practical usability testing. Digital Web Magazine. http://www.digital-web.com/articles/practical_usability_testing/. Accessed 29 March 2012
Konstantin P (2010) Statistics related to drowsy driver crashes. www.americanindian.net. Accessed 7 July 2010
Lal S, Craig A, Boord P, Kirkup L, Nguyen H (2003) Development of an algorithm for an EEG-based driver fatigue countermeasure. J Saf Res 1(34):321–328
Rasolzadeh B et al (2006) Response binning: improved weak classifiers for boosting. In: IEEE Intelligent Vehicles Symposium, pp 344–349
Sangkyun P, Seonyoung L, Soojin K, Kyeongsoon C (2011) Design of AdaBoost classifier circuit using Haar-like features for automobile applications. In: International SoC Design Conference (ISOCC 2011), pp 262–265
Seeing Machines (2007) Driver state sensor. User Manual 2.0
Seong K, Haet L, Jung K, Jae B, Suk B, Suk K (2007) ECG, EOG detection from helmet based system. In: International Special Topic Conference on Information Technology Applications in Biomedicine, ITAB 2007, pp 191–193
Sivaraman S, Trivedi M (2009) Active learning based robust monocular vehicle detection for on-road safety systems. In: IEEE Intelligent Vehicles Symposium, pp 399–404
Smart Eye White Paper (2004) http://www.smarteye.se/smarteyepro3.html. Accessed 12 Jan 2011
SmartEye (2010) Antisleep 2.0. http://www.detna.com/shop/anti-sleep-driving-alarm Accessed 11 November 2011
Sun Z (2006) On-road vehicles detection: a review. IEEE Trans Pattern Anal 28(5):649–711
Syed R, Eskandarian A (2001) Unobtrusive drowsiness detection by neural network learning of driver steering. In: Proceedings of the Institution of Mechanical Engineers, Part D: Journal of Automobile Engineering 215(9): 969–975
Tabrizi PR, Zoroofi RA (2009) Drowsiness detection based on brightness and numeral features of eye image. In: Fifth International Conference on Intelligent Information Hiding and Multimedia Signal Processing, Kyoto, 2009, IIH-MSP ’09, pp 1310–1313
Viola P, Jones M (2004) Robust real-time face detection. Int J Comput Vis 57(2):137–154
Viola P et al (2003) Detecting pedestrians using patterns of motion and appearance. In: IEEE International Conference on Computer Vision, 2:734–741
Wang X, Wang Z, Sun J, Zhang H (2005) The correlation template matching algorithm based TD filter and ESO filter. In: Proceedings of International Conference on Machine Learning and Cybernetics, Guangzhou, China, 2005. © IEEE Xplore, 9:5361–5365
Wierwille W, Ellsworth L, Wreggit S, Fairbanks R, Kim C (1994) Research on vehicle-based driver status/performance monitoring: development, validation and refinement of algorithms for detection of driver drowsiness. National highway traffic safety administration 808(247)
Wilson P, Fernandez J (2005) Establishing a face recognition research environment using open source software. ASEE Gulf-Southwest Annual Conference, pp xx–xx
Zhang Z, Zhang JS (2006) Driver fatigue detection based intelligent vehicle control. In: IEEE International Conference on Pattern Recognition, pp 1262–1265
Zheng W, Liang L (2009) Fast car detection using image strip features. In: IEEE Conference on Computer Vision and Pattern Recognition, pp 2703–2710
Acknowledgment
This work was funded by the Deanship of Scientific Research (DSR), King Abdulaziz University, Jeddah, under grant No. (611-008-D1433). The authors, therefore, acknowledge with thanks DSR technical and financial support.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Ibrahim, L.F., Abulkhair, M., AlShomrani, A.D. et al. Using Haar classifiers to detect driver fatigue and provide alerts. Multimed Tools Appl 71, 1857–1877 (2014). https://doi.org/10.1007/s11042-012-1308-5
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-012-1308-5