Abstract
This paper provides initial results on developing a deep neural network-based system for driver distraction detection which is operational at daytime as well as nightime. Unlike other existing methods that rely on only RGB images for daytime detection, the proposed system consists of two operating modes. The daytime mode uses a convolutional neural network to classify drivers’ states based on their body poses in RGB images. The nighttime mode classifies Near Infrared images using a different neural network-based model and trained under different circumstances. To the best of our knowledge, this is the first work that explicitly addresses driver behavior detection at night using end-to-end convolutional neural networks. With initial experimental results, we empirically demonstrate that, with a relatively modest model complexity, the proposed system achieves high performance on driver distraction detection for both modes. Furthermore, we discuss the feasibility of developing a system with a small footprint and design structure but accurate enough to be deployed on a memory-restricted computing platform environment.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Dinges, D.F., Perclos, R.G.: A valid psychophysiological measure of alertness as assessed by psychomotor vigilance. US Department of Transportation, Federal Highway Administration, Publication Number FHWA-MCRT-98-006 (1998)
Damousis, I.G., Tzovaras, D.: Fuzzy fusion of eyelid activity indicators for hypovigilance-related accident prediction. IEEE Trans. Intell. Transp. Syst. 9(3), 491–500 (2008)
Smith, P., Shah, M., da Vitoria Lobo, N.: Determining driver visual attention with one camera. IEEE Trans. Intell. Transp. Syst. 4(4), 205–218 (2003)
Hssayeni, M.D., Saxena, S., Ptucha, R., Savakis, A.: Distracted driver detection: deep learning vs handcrafted features. Electron. Imaging 2017(10), 20–26 (2017)
Koesdwiady, A., Bedawi, S.M., Ou, C., Karray, F.: End-to-end deep learning for driver distraction recognition. In: Karray, F., Campilho, A., Cheriet, F. (eds.) ICIAR 2017. LNCS, vol. 10317, pp. 11–18. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-59876-5_2
Ou, C., Ouali, C., Bedawi, S.M., Karray, F.: Driver behavior monitoring using tools of deep learning and fuzzy inferencing. In: IEEE International Conference on Fuzzy Systems, pp. 1–7 (2018)
Ou, C., Ouali, C., Karray, F.: Transfer learning based strategy for improving driver distraction recognition. In: Campilho, A., Karray, F., ter Haar Romeny, B. (eds.) ICIAR 2018. LNCS, vol. 10882, pp. 443–452. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-93000-8_50
Ngan Le, T.H., Zheng, Y., Zhu, C., Luu, K., Savvides, M.: Multiple scale faster-RCNN approach to driver’s cell-phone usage and hands on steering wheel detection. In: IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 46–53 (2016)
Artan, Y., Bulan, O., Loce, R.P., Paul, P.: Driver cell phone usage detection from HOV/HOT NIR images. In: IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 225–230 (2014)
What counts as distracted driving. https://www.ontario.ca/page/distracted-driving. Accessed at 3 Dec 2019
LeCun, Y., Bengio, Y., Hinton, G.: Deep learning. Nature 521(7553), 436–444 (2015)
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., Li, F.-F.: A large-scale hierarchical image database, Imagenet (2009)
Kingma, D.P., Ba, J.: Adam: a method for stochastic optimization. arXiv preprint. arXiv:1412.6980 (2014)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Ou, C., Zhao, Q., Karray, F., Khatib, A.E. (2019). Design of an End-to-End Dual Mode Driver Distraction Detection System. In: Karray, F., Campilho, A., Yu, A. (eds) Image Analysis and Recognition. ICIAR 2019. Lecture Notes in Computer Science(), vol 11663. Springer, Cham. https://doi.org/10.1007/978-3-030-27272-2_17
Download citation
DOI: https://doi.org/10.1007/978-3-030-27272-2_17
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-27271-5
Online ISBN: 978-3-030-27272-2
eBook Packages: Computer ScienceComputer Science (R0)