Abstract
Drivers provide a wide range of focus characteristics that can evaluate their attention level and analyze their behavioral states while driving. This information is critical for the development of new automated driving functionalities that support and assist the driver according to his/her state, ensuring safety for them and other users on the road. In this sense, this paper proposes a Driver Monitoring System (DMS) based on image processing and Convolutional Neural Networks (CNN), that analyzes two important driver distraction aspects: inattention of the road and drowsiness. Our approach makes use of CNN models for detecting the gaze and the head direction, which involves training datasets with different pre-defined labels. Additionally, the system is complemented with the drowsiness level measurement, using face features to detect the time that the eyes are closed or opened, and the blinking rate. Crossing the inference results of these models, the system can provide an accurate estimation of driver attention level. The different parts of the presented DMS have been trained in a Hardware-in-the-loop driving simulator with an eye fish camera. It has been tested as a real-time application recording driver with different characteristics.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
NHTSA: Research Note Distracted Driving in Fatal Crashes, 2017. NHTSA’s National Center for Statistics and Analysis, DOT HS, vol. 812, no. April, pp. 1–8 (2019)
Fountas, G., et al.: FINAL REPORT factors affecting perceived and observed aggressive driving behavior: an empirical analysis of driver fatigue, and distracted driving. Technical report (2019)
Prat, F., Gras, M.E., Planes, M., Font-Mayolas, S., Sullman, M.J.M.: Driving distractions: an insight gained from roadside interviews on their prevalence and factors associated with driver distraction. Transp. Res. Part F: Traff. Psychol. Behav. 45, 194–207 (2017)
Rolison, J.J., Regev, S., Moutari, S., Feeney, A.: What are the factors that contribute to road accidents? An assessment of law enforcement views, ordinary drivers’ opinions, and road accident records. Accident Anal. Prevent. 115, 11–24 (2018)
Magdalena Nowara, E., Marks, T.K., Mansour, H., Veeraraghavany, A.: SparsePPG: towards driver monitoring using camera-based vital signs estimation in near-infrared. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, vol. 2018-June, pp. 1353–1362 (2018)
Raman, K.J., et al.: Fatigue monitoring based on Yawning and head movement. In: 2018 6th International Conference on Information and Communication Technology, ICoICT 2018, pp. 343–347. IEEE, May 2018
Zhang, C., Wang, W., Chen, C., Zeng, C., Anderson, D.E., Cheng, B.: Determination of optimal electroencephalography recording locations for detecting drowsy driving. IET Intel. Transp. Syst. 12(5), 345–350 (2018)
Choi, I.H., Jeong, C.H., Kim, Y.G.: Tracking a driver’s face against extreme head poses and inference of drowsiness using a hidden Markov model. Appl. Sci. 6(5), 137 (2016)
Naz, S., Ziauddin, S., Shahid, A.: Driver fatigue detection using mean intensity, SVM, and SIFT. Int. J. Interact. Multimed. Artif. Intell. 5(4), 86 (2019)
Lupu, D., Necoara, I.: Primal and dual first order methods for SVM: applications to driver monitoring. In: 2018 22nd International Conference on System Theory, Control and Computing, ICSTCC 2018 - Proceedings, pp. 565–570. Institute of Electrical and Electronics Engineers Inc., November 2018
Eraqi, H.M., Abouelnaga, Y., Saad, M.H., Moustafa, M.N.: Driver distraction identification with an ensemble of convolutional neural networks. J. Adv. Transp. 2019 (2019)
Vora, S., Rangesh, A., Trivedi, M.M.: Driver gaze zone estimation using convolutional neural networks: a general framework and ablative analysis. IEEE Trans. Intell. Veh. 3(3), 254–265 (2018)
Desmet, C., Diependaele, K.: An eye-tracking study on the road examining the effects of handsfree phoning on visual attention. Transp. Res. Part F: Traff. Psychol. Behav. 60, 549–559 (2019)
Gourier, N., Hall, D., Crowley, J.L.: Estimating face orientation from robust detection of salient facial structures. In: FG Net Workshop on Visual Observation of Deictic Gestures (POINTING), pp. 17–25 (2004)
Chollet, F., et al.: Applications - Keras documentation (2015)
Dlib: D-lib C++ library (2016)
Haq, Z.A., Hasan, Z.: Eye-blink rate detection for fatigue determination. In: India International Conference on Information Processing, IICIP 2016 - Proceedings. Institute of Electrical and Electronics Engineers Inc., July 2017
Naqvi, R.A., Arsalan, M., Batchuluun, G., Yoon, H.S., Park, K.R.: Deep learning-based gaze detection system for automobile drivers using a NIR camera sensor. Sensors (Switzerland) 18(2), 456 (2018)
Panicker, A.D., Nair, M.S.: Open-eye detection using iris-sclera pattern analysis for driver drowsiness detection. Sadhana - Acad. Proc. Eng. Sci. 42(11), 1835–1849 (2017)
Vicente, F., Huang, Z., Xiong, X., De La Torre, F., Zhang, W., Levi, D.: Driver gaze tracking and eyes off the road detection system. IEEE Trans. Intell. Transp. Syst. 16(4), 2014–2027 (2015)
Kingma, D.P., Ba, J.L.: Adam: a method for stochastic optimization. In: 3rd International Conference on Learning Representations, ICLR 2015 - Conference Track Proceedings. International Conference on Learning Representations, ICLR (2015)
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Vaca-Recalde, M.E., Pérez, J., Echanobe, J. (2020). Driver Monitoring System Based on CNN Models: An Approach for Attention Level Detection. In: Analide, C., Novais, P., Camacho, D., Yin, H. (eds) Intelligent Data Engineering and Automated Learning – IDEAL 2020. IDEAL 2020. Lecture Notes in Computer Science(), vol 12490. Springer, Cham. https://doi.org/10.1007/978-3-030-62365-4_56
Download citation
DOI: https://doi.org/10.1007/978-3-030-62365-4_56
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-62364-7
Online ISBN: 978-3-030-62365-4
eBook Packages: Computer ScienceComputer Science (R0)