Abstract
Statistics have shown that \(20\%\) of all road accidents are fatigue-related, and drowsy detection is a car safety algorithm that can alert a snoozing driver in hopes of preventing an accident. This paper proposes a deep architecture referred to as deep drowsiness detection (DDD) network for learning effective features and detecting drowsiness given a RGB input video of a driver. The DDD network consists of three deep networks for attaining global robustness to background and environmental variations and learning local facial movements and head gestures important for reliable detection. The outputs of the three networks are integrated and fed to a softmax classifier for drowsiness detection. Experimental results show that DDD achieves \(73.06\%\) detection accuracy on NTHU-drowsy driver detection benchmark dataset.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. In: NIPS, pp. 1097–1105 (2012)
Parkhi, O.M., Vedaldi, A., Zisserman, A.: Deep face recognition. In: BMVC, vol. 1, p. 6 (2015)
Donahue, J., Anne Hendricks, L., Guadarrama, S., Rohrbach, M., Venugopalan, S., Saenko, K., Darrell, T.: Long-term recurrent convolutional networks for visual recognition and description. In: CVPR, pp. 2625–2634 (2015)
Brox, T., Bruhn, A., Papenberg, N., Weickert, J.: High accuracy optical flow estimation based on a theory for warping. In: Pajdla, T., Matas, J. (eds.) ECCV 2004. LNCS, vol. 3024, pp. 25–36. Springer, Heidelberg (2004). doi:10.1007/978-3-540-24673-2_3
Soomro, K., Zamir, A.R., Shah, M.: UCF101: a dataset of 101 human actions classes from videos in the wild. arXiv preprint arXiv:1212.0402 (2012)
Li, W., He, Q.C., Fan, X.M., Fei, Z.M.: Evaluation of driver fatigue on two channels of EEG data. Neurosci. Lett. 506, 235–239 (2012)
Patel, M., Lal, S.K.L., Kavanagh, D., Rossiter, P.: Applying neural network analysis on heart rate variability data to assess driver fatigue. Expert Syst. Appl. 38, 7235–7242 (2011)
Mattsson, K.: In vehicle prediction of truck driver sleepiness. Master’s thesis, Luleå University of Technology, vol. 107 (2007)
Boyle, L.N., Tippin, J., Paul, A., Rizzo, M.: Driver performance in the moments surrounding a microsleep. Transp. Res. Part F: Traffic Psychol. Behav. 11, 126–136 (2008)
Friedrichs, F., Yang, B.: Drowsiness monitoring by steering and lane data based features under real driving conditions. In: 2010 18th European Signal Processing Conference, pp. 209–213 (2010)
Forsman, P.M., Vila, B.J., Short, R.A., Mott, C.G., Dongen, H.P.: Efficient driver drowsiness detection at moderate levels of drowsiness. Accid. Anal. Prev. 50, 341–350 (2013)
Dwivedi, K., Biswaranjan, K., Sethi, A.: Drowsy driver detection using representation learning. In: 2014 IEEE International Advance Computing Conference (IACC), pp. 995–999 (2014)
Lee, S.J., Jo, J., Jung, H.G., Park, K.R., Kim, J.: Real-time gaze estimator based on driver’s head orientation for forward collision warning system. IEEE Trans. Intell. Transp. Syst. 12, 254–267 (2011)
Choi, I.H., Hong, S.K., Kim, Y.G.: Real-time categorization of driver’s gaze zone using the deep learning techniques. In: International Conference on Big Data and Smart Computing (BigComp), pp. 143–148 (2016)
Singh, M., Kaur, G.: Drowsy detection on eye blink duration using algorithm. Int. J. Emerg. Tech. Adv. Eng. 2, 363–365 (2012)
Saito, H., Ishiwaka, T., Okabayashi, S.: Applications of driver’s line of sight to automobiles-what can driver’s eye tell. In: 1994 Proceedings of Vehicle Navigation and Information Systems Conference, pp. 21–26 (1994)
Horng, W.B., Chen, C.Y., Chang, Y., Fan, C.H.: Driver fatigue detection based on eye tracking and dynamk, template matching. In: 2004 IEEE International Conference on Networking, Sensing and Control, vol. 1, pp. 7–12 (2004)
Smith, P., Shah, M., da Vitoria Lobo, N.: Monitoring head/eye motion for driver alertness with one camera. In: ICPR, p. 4636 (2000)
Polikar, R.: Ensemble based systems in decision making. IEEE Circuits Syst. Mag. 6, 21–45 (2006)
Rokach, L.: Ensemble-based classifiers. Artif. Intell. Rev. 33, 1–39 (2010)
Opitz, D., Maclin, R.: Popular ensemble methods: an empirical study. J. Artif. Intell. Res. 11, 169–198 (1999)
Fan, R.E., Chang, K.W., Hsieh, C.J., Wang, X.R., Lin, C.J.: LIBLINEAR: a library for large linear classification. J. Mach. Learn. Res. 9, 1871–1874 (2008)
Vedaldi, A., Lenc, K.: Matconvnet: convolutional neural networks for matlab. In: Proceedings of the 23rd ACM International Conference on Multimedia, pp. 689–692 (2015)
Sahayadhas, A., Sundaraj, K., Murugappan, M.: Electromyogram signal based hypovigilance detection. Biomed. Res. 25, 281–288 (2014)
Chieh, T.C., Mustafa, M.M., Hussain, A., Hendi, S.F., Majlis, B.Y.: Development of vehicle driver drowsiness detection system using electrooculogram (EOG). In: 1st International Conference on Computers, Communications, Signal Processing with Special Track on Biomedical Engineering, pp. 165–168 (2005)
Acknowledgement
This work was partly supported by Institute for Information & communications Technology Promotion (IITP) grant funded by the Korea government (MSIP) (No. B0101-16-0307, Basic Software Research in Human-level Lifelong Machine Learning (Machine Learning Center)) and supported by the National Research Foundation of Korea (NRF) grant funded by the Korea government (MSIP) (No. 2010-0028680).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Park, S., Pan, F., Kang, S., Yoo, C.D. (2017). Driver Drowsiness Detection System Based on Feature Representation Learning Using Various Deep Networks. In: Chen, CS., Lu, J., Ma, KK. (eds) Computer Vision – ACCV 2016 Workshops. ACCV 2016. Lecture Notes in Computer Science(), vol 10118. Springer, Cham. https://doi.org/10.1007/978-3-319-54526-4_12
Download citation
DOI: https://doi.org/10.1007/978-3-319-54526-4_12
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-54525-7
Online ISBN: 978-3-319-54526-4
eBook Packages: Computer ScienceComputer Science (R0)