Skip to main content
SpringerLink
Log in

Real-Time Distraction Detection from Driving Data Based Personal Driving Model Using Deep Learning

  • Published:
International Journal of Intelligent Transportation Systems Research Aims and scope Submit manuscript

Abstract

Distracted driving is one of the main cause of traffic accidents. Car manufacurers are now developing various driving support systems to ensure safe driving because it is an important activity of people as their major means of transportation. In this work, we have examined the method of detecting distracted driving from the driving data collected from different sensors attached to a driving simulator while driving with various road conditions and cognitive loads. In our study, we used a driving simulator for collecting data of drivers while driving in normal state with concentration and in distracted state by imposing cognitive load to simulate cognitive distraction. Based on the collected data, we developed driver specific model of driving behaviour in several scenario with increasing cognitive load and attempted to detect distracted driving in real time from the individual driving model to send alert to the driver. We explored machine learning algorithms including deep neural networks for the proposed development of real time cognitive distraction detection method from driving data. It is found that different drivers have different driving behaviour and use of personal driving model is important for the detection of distracted driving in real time. It is also found that convolutional neural network (CNN) is a promising tool for the development of a personalized driving assistance system which can detect distracted driving for alerting a driver in real time.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  1. NHTSA: Distracted driving. Available at https://www.nhtsa.gov/riskydriving/distracted-driving

  2. Tran, D., Do, H.M., Sheng, W., Bai, H., Chowdhary, G.: Real-time detection of distracted driving based on deep learning. IET Intelligent Transport System 12(10), 1210–1219 (2018)

    Article  Google Scholar 

  3. Jo, J., Jung, H.G., Park, K.R., Kim, J.: Vision-based method for detecting driver drowsiness and distraction in driver monitoring system. Optical Engineering 50(12), 127202 (2011)

    Article  Google Scholar 

  4. Tango, F., Botta, M.: Real-time detection system of driver distraction using machine learning. IEEE Transactions on Intelligent Transportation Systems 14(2), 894–905 (2013)

    Article  Google Scholar 

  5. Jin, L., Niu, Q., Hou, H., Xian, H., Wang, Y., Shi, D.: Driver cognitive distraction detection using driving performance measures. Discrete Dynamics in Nature and Society, Hindawi Publishing Corporation 2012(2 Article ID 432634), 12 (2012)

    Google Scholar 

  6. Streiffer, C., Raghavendra, R., Benson, T., Srivatsa, M.: Darnet: A deep learning solution for distracted driving detection. In: Proceedings of the ACM/IFIP/USENIX Middleware Conference, pp. 22–28. Las Vegas, NV, USA, 11–15 (2017)

  7. Eraqi, H.M., Abouelnaga, Y.Y., Saad, M.H., Moustafa, M.N.: Driver distraction identification with an ensemble of convolutional neural networks. Journal of Advanced Transportation 2019(Article ID 4125865), 12 (2019). https://doi.org/10.1155/2019/4125865

    Article  Google Scholar 

  8. Liang, Y., et al.: Real-time detection of driver cognitive distraction using support vector machines. IEEE Transactions on Intelligent Transportation Systems 8(2), 340–350 (2007)

    Article  Google Scholar 

  9. Liao, Y., Li, S.E., Li, G., Wang,W., Cheng, B., Chen, F.: Detection of driver cognitive distraction: An SVM based real-time algorithm and its comparison study in typical driving scenarios. 2016 IEEE Intelligent Vehicles Symposium (IV), pp. 394–399. Gothenburg (2016). https://doi.org/10.1109/IVS.2016.7535416

  10. Garcia-Constantino, M., et al.: Measuring the impact of cognitive distractions on driving performance using time series analysis. Proc. of 17th IEEE Intelligent Transport Systems Conference, pp. 2047–2053 (2014)

  11. Guo, Z., Pan, Y., Zhao, G., Cao, S., Zhang, J.: Detection of driver vigilance level using EEG signals and driving contexts. IEEE Transactions on Reliability 8(2), 340–350 (2017)

    Google Scholar 

  12. Rajendra, V., Dehzangi, O.: Detection of distraction under naturalistic driving using Galvanic Skin Responses. 2017 IEEE 14th International Conference on Wearable and Implantable Body Sensor Networks (BSN), pp. 157–160. Eindhoven (2017). https://doi.org/10.1109/BSN.2017.7936031

  13. Yuzoff, N.M., Ahmad, R.F., Guillet, C., Malik, A.S., Saad, N.M., et al.: Selection of measurement method for detection of driver visual cognitive distraction: A review. IEEE Access 5, 22844–22854 (2017)

    Article  Google Scholar 

  14. LeCun, Y., Bengio, Y.: Convolutional networks for images, speech, and time-series. In: Arbib, M.A. (ed.) The Handbook of Brain Theory and Neural Networks. MIT Press, Cambridge (1995)

    Google Scholar 

  15. Abouelnaga, Y., Eraqi, H.M., Moustafa, M.N.: Real-time distracted driver posture classification. (2017). arXiv:1706.09498

  16. Baheti, B., Gajre, S., Talbar, S.: Detection of distracted driver using convolutional neural network. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops (2018)

  17. Li, N., Jain, J., Busso, C.: Modeling of driver behavior in real world scenarios using multiple noninvasive sensors. IEEE. Trans. On Multimedia 5(5), 1223–1225 (2013)

    Google Scholar 

  18. Chakraborty, B, Yusuke, M., Yoshida, S., Nakano, K.: Effect of cognitive distraction on driving behaviour. In: Proceedings of FITAT 2016. Zuhai, China (2016)

  19. Chakraborty, B., Nakano, K.: Automatic detection of drivers awareness with cognitive task from driving behavior. Proceedings of IEEE SMC 2016. Budapest, Hungary (2016)

  20. Nakano, K., Chakraborty, B.: Effective feature extraction from driving data for detection of danger awareness. IEEE 10th International Conference on Awareness Science and Technology (iCAST). Morioka, Japan (2019)

  21. Krizhevsky, A.: Learning multiple layers of features from tiny images. Tech Report (2009)

  22. Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. Advances in Neural Information Processing Systems (2012)

  23. Wang, Z., Yan, W., Oates, T.: Time series classification from scratch with deep neural networks: A strong baseline. InterNational Joint Conference on Neural Networks (IJCNN) (2017)

  24. He, K., et al.: Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2016)

  25. Nakano, K., Chakraborty, B.: Effect of data representation for time series classification-A comparative study and a new proposal. Machine Learning and Knowledge Extraction 1(4), 1100–1120 (2019). https://doi.org/10.3390/make1040062

    Article  Google Scholar 

Download references

Acknowledgements

This research was funded and supported by Research and Regional Cooperative Division, Iwate Prefectural University, Iwate, Japan.

Author information

Authors and Affiliations

  1. Research and Regional Coperative Division, Iwate Prefectural University, 152-52 Sugo, Takizawa, Iwate, Japan

    Kotaro Nakano

  2. Faculty of Software and Information Science, Iwate Prefectural University, 152-52 Sugo, Takizawa, Iwate, Japan

    Basabi Chakraborty

Authors
  1. Kotaro Nakano
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Basabi Chakraborty
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Basabi Chakraborty.

Ethics declarations

Conflicts of interest

We have no conflicts of interest to disclose.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Nakano, K., Chakraborty, B. Real-Time Distraction Detection from Driving Data Based Personal Driving Model Using Deep Learning. Int. J. ITS Res. 20, 238–251 (2022). https://doi.org/10.1007/s13177-021-00288-9

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s13177-021-00288-9

Keywords

Search

Navigation