Abstract
With the onset of the new technological age, the distractions caused due to handheld devices have been a major cause of traffic accidents as they affect the decision-making capabilities of the driver and give them less time to react to difficult situations. Often drivers try to multitask which reduces their reaction time leading to accidents which could have been easily avoided if they had been attentive. As such problems are related to the driver’s negligence toward safety, a possible solution is to monitor driver’s behavior and notify if they are distracted. We propose a CapsNet-based approach for detecting the distracted driver which is a novel approach. The proposed method scores perform well on the real-world environment inputs when compared to other famous methods used for the same. Our proposed methods get high scores for all the most commonly used metrics for classification. On the testing set, the proposed method gets an accuracy of 0.90, 0.92 as precision score, 0.90 as recall score and 0.91 as F-measure.
Similar content being viewed by others
Abbreviations
- CNN:
-
Convolutional neural network
- ANN:
-
Artificial neural network
- MSE:
-
Mean squared error
- SVM:
-
Support vector machine
- RNN:
-
Recurrent neural network
- IMU:
-
Inertial measurement unit
- LSTM:
-
Long short-term memory
- ELM:
-
Extreme learning machine
- KNN:
-
K-nearest neighbors
References
Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. In: Advances in neural information processing systems, pp 1097–1105
Van Hal B, Rhodes S, Dunne B, Bossemeyer R (2014, August). Low-cost EEG-based sleep detection. In: 2014 36th Annual international conference of the IEEE engineering in medicine and biology society, IEEE, pp4571–4574
Imprialou M, Quddus M (2017) Crash data quality for road safety research: current state and future directions. Accident Anal Prev 130:84–90
Kim W, Choi HK, Jang BT, Lim J (2017, October). Driver distraction detection using single convolutional neural network. In: 2017 International conference on information and communication technology convergence (ICTC), IEEE, pp 1203–1205
Russakovsky O, Deng J, Su H, Krause J, Satheesh S, Ma S, Huang Z, Karpathy A, Khosla A, Bernstein M, Berg AC (2015) Imagenet large scale visual recognition challenge. Int J Comput Vision 115(3):211–252
Koesdwiady A, Bedawi SM, Ou C, Karray, F. (2017, July). End-to-end deep learning for driver distraction recognition. In: International conference image analysis and recognition, Springer, Cham, pp 11–18
Chen T, Guestrin C (2016, August). Xgboost: A scalable tree boosting system. In: Proceedings of the 22nd acm sigkdd international conference on knowledge discovery and data mining, ACM, pp 785–794
Masood S, Rai A, Aggarwal A, Doja MN, Ahmad M (2018) Detecting distraction of drivers using convolutional neural network. Pattern Recognit Lett. https://doi.org/10.1016/j.patrec.2017.12.023
Bhardwaj R, Natrajan P, Balasubramanian V (2018, December) Study to determine the effectiveness of deep learning classifiers for ECG based driver fatigue classification. In: 2018 IEEE 13th international conference on industrial and information systems (ICIIS), IEEE, pp 98–102
Alippi C, Disabato S, Roveri M (2018, April) Moving convolutional neural networks to embedded systems: the alexnet and VGG-16 case. In: Proceedings of the 17th ACM/IEEE international conference on information processing in sensor networks, IEEE Press, pp 212–223
Liu T, Yang Y, Huang GB, Yeo YK, Lin Z (2015) Driver distraction detection using semi-supervised machine learning. IEEE Trans Intell Transp Syst 17(4):1108–1120
Streiffer C, Raghavendra R, Benson T, Srivatsa M (2017, December). Darnet: a deep learning solution for distracted driving detection. In: Proceedings of the 18th ACM/IFIP/USENIX Middleware Conference: Industrial Track, ACM, pp 22–28
Abouelnaga Y, Eraqi HM, Moustafa MN (2017) Real-time distracted driver posture classification. arXiv preprint arXiv:1706.09498
Liao Y, Li SE, Wang W, Wang Y, Li G, Cheng B (2016) Detection of driver cognitive distraction: a comparison study of stop-controlled intersection and speed-limited highway. IEEE Trans Intell Transp Syst 17(6):1628–1637
Hoogendoorn R, Harms I, Hoogendoorn S, Brookhuis K (2012) Dynamic maximum speed limits: perception, mental workload, and compliance. Transp. Res. Rec. J. Transp. Res. Board 2321:46–54
Xu J, Min J, Hu J (2018) Real-time eye tracking for the assessment of driver fatigue. Healthc Technol Lett 5(2):54–58
Meyer D, Wien FT (2015) Support vector machines. The Interface to libsvm in package e1071, 28
Liu T (2018) Clustering and semi-supervised classification with application to driver distraction detection (Doctoral dissertation)
Majdi MS, Ram S, Gill JT, Rodriguez JJ (2018, April) Drive-net: Convolutional network for driver distraction detection. In: 2018 IEEE southwest symposium on image analysis and interpretation (SSIAI), IEEE, pp 1–4
Vasconez JP, Cheein FA (2018, April) Sleepiness detection for cooperative vehicle navigation strategies. In: 2018 5th International conference on control, decision and information technologies (CoDIT), IEEE, pp 940–945
Jiang J, Zhao Q, Wu Y, Yi J (2018, August) Driver fatigue detection based on machine vision. In: 2018 IEEE International conference on information and automation (ICIA), IEEE, pp 570–574
Xi E, Bing S, Jin Y (2017) Capsule network performance on complex data. arXiv preprint arXiv:1712.03480
Balandong RP, Ahmad RF, Saad MNM, Malik AS (2018) A review on EEG-based automatic sleepiness detection systems for driver. IEEE Access 6:22908–22919
Deshmukh SV, Dehzangi O (2019) Characterization and identification of driver distraction during naturalistic driving: an analysis of ECG dynamics. In: Advances in Body Area Networks I, Springer, Cham, pp 1–13
Wang R, Li G, Chu D (2019, October) Capsules encoder and capsgan for image inpainting. In: 2019 international conference on artificial intelligence and advanced manufacturing (AIAM), IEEE, pp 325–328
Pang Y, Sun M, Jiang X, Li X (2017) Convolution in convolution for network in network. IEEE Trans Neural Netw Learn Syst 29(5):1587–1597
Sasikala R, Suresh S, Chandramohan J, Valanrajkumar M (2018) Driver drowsiness detection system using image processing technique by the human visual system. Int J Emerg Technol Eng Res (IJETER) 6(6):1–11
Sabour S, Frosst N, Hinton GE (2017) Dynamic routing between capsules. In: Advances in neural information processing systems, pp 3856–3866
Ma W, Lu J (2017) An equivalence of fully connected layer and convolutional layer. arXiv preprint arXiv:1712.01252
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
There is no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Jain, D.K., Jain, R., Lan, X. et al. Driver distraction detection using capsule network. Neural Comput & Applic 33, 6183–6196 (2021). https://doi.org/10.1007/s00521-020-05390-9
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00521-020-05390-9