Skip to main content

Advertisement

Springer Nature Link
Log in

Towards driver distraction detection: a privacy-preserving federated learning approach

  • Published:
Peer-to-Peer Networking and Applications Aims and scope Submit manuscript

Abstract

Driver distraction is the chief reason for road accidents, and the auto-detection system for driver distraction could significantly reduce such misfortune. Sufficient valid samples are the prerequisite for designing a such system, and privacy protection is the restrictive condition to utilize these samples. To address this problem, a privacy-preserving federated learning algorithm for detecting driver distractions during driving is proposed. To prevent gradient leakage of the global model during training and leakage of sensitive data, an adaptive gradient clipping (AGC) mechanism is introduced to protect privacy while reducing the communication load. In addition, a differential privacy technique with a Gaussian mechanism is adopted to further protect the privacy of the participants. Then, a restriction term is added to the objective function to ensure the similarity between the local and global models and to improve the model convergence speed. To overcome the problems of diverse backgrounds and small targets for driver distraction detection, a bounding box loss function SIoU and a self-attention mechanism are used in an improved YOLOv5 detector to promote the model performance. Finally, the effectiveness of the algorithm is validated through experiments on real datasets. Compared with the centralized data training model, the improved YOLOv5 detector effectively improves the performance of driver distraction detection with higher accuracy and robustness.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Algorithm 1
Algorithm 2
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

Availability of data and materials

All data generated or analysed during this study are included in this published article.

References

  1. Guo F, Klauer SG, Fang Y, Hankey JM, Antin JF, Perez MA, Lee SE, Dingus TA (2017) The effects of age on crash risk associated with driver distraction. International journal of epidemiology 46(1):258–265

    Google Scholar 

  2. Aksjonov A, Nedoma P, Vodovozov V, Petlenkov E, Herrmann M (2018) Detection and evaluation of driver distraction using machine learning and fuzzy logic. IEEE Transactions on Intelligent Transportation Systems 20(6):2048–2059

    Article  Google Scholar 

  3. Cunningham ML, Regan MA (2018) Driver distraction and inattention in the realm of automated driving. IET Intelligent Transport Systems 12(6):407–413

    Article  Google Scholar 

  4. Zhang C, Eskandarian A (2021) A Survey and Tutorial of EEG-Based Brain Monitoring for Driver State Analysis. IEEE/CAA J Autom Sin 8(7):1222–1242

    Article  Google Scholar 

  5. Sun Y, Yu X (2014) An innovative nonintrusive driver assistance system for vital signal monitoring. IEEE journal of biomedical and health informatics 18(6):1932–1939

    Article  Google Scholar 

  6. Daza IG, Bergasa LM, Bronte S, Yebes JJ, Almazán J, Arroyo R (2014) Fusion of optimized indicators from advanced driver assistance systems (adas) for driver drowsiness detection. Sensors 14(1):1106–1131

    Article  Google Scholar 

  7. Deshmukh SV, Dehzangi O (2017) Ecg-based driver distraction identification using wavelet packet transform and discriminative kernel-based features. In: 2017 IEEE International Conference on Smart Computing (SMARTCOMP), p 1–7. IEEE, Hong Kong

  8. Dong Y, Hu Z, Uchimura K, Murayama N (2010) Driver inattention monitoring system for intelligent vehicles: A review. IEEE transactions on intelligent transportation systems 12(2):596–614

    Article  Google Scholar 

  9. Peng Y, Boyle LN, Hallmark SL (2013) Driver’s lane keeping ability with eyes off road: Insights from a naturalistic study. Accident Analysis & Prevention 50(2):628–634

    Article  Google Scholar 

  10. Seshadri K, Juefei-Xu F, Pal DK, Savvides M, Thor CP (2015) Driver cell phone usage detection on strategic highway research program (shrp2) face view videos. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, p 35–43

  11. Alam L, Hoque MM (2019) Real-time distraction detection based on driver’s visual features. 2019 International Conference on Electrical, vol 5. Computer and Communication Engineering (ECCE). IEEE, New York, p 1–6

  12. Moslemi N, Soryani M, Azmi R (2021) Computer vision-based recognition of driver distraction: A review. Concurrency and Computation: Practice and Experience 33(24):6475

    Article  Google Scholar 

  13. McMahan B, Moore E, Ramage D, Hampson S, y Arcas BA (2017) Communication-efficient learning of deep networks from decentralized data. In: Singh, A., Zhu, J. (eds.) Artificial Intelligence and Statistics, vol. 54, p 1273–1282. PMLR, New York

  14. Xu J, Glicksberg BS, Su C, Walker P, Bian J, Wang F (2021) Federated learning for healthcare informatics. Journal of Healthcare Informatics Research 5(2):1–19

    Article  Google Scholar 

  15. Long G, Shen T, Tan Y, Gerrard L, Clarke A, Jiang J (2021) Federated learning for privacy-preserving open innovation future on digital health. Humanity Driven AI: Productivity. Well-being, Sustainability and Partnership. Springer, New York, p 113–133

  16. Kumar R, Khan AA, Kumar J, Golilarz NA, Zhang S, Ting Y, Zheng C, Wang W et al (2021) Blockchain-federated-learning and deep learning models for covid-19 detection using ct imaging. IEEE Sensors Journal 21(14):16301–16314

    Article  Google Scholar 

  17. Posner J, Tseng L, Aloqaily M, Jararweh Y (2021) Federated learning in vehicular networks: Opportunities and solutions. IEEE Network 35(2):152–159

    Article  Google Scholar 

  18. Duan S, Wang D, Ren J, Lyu F, Zhang Y, Wu H, Shen X (2023) Distributed artificial intelligence empowered by end-edge-cloud computing: A survey. IEEE Communications Surveys & Tutorials 25(1):591–624

    Article  Google Scholar 

  19. Zafar A, Prehofer C, Cheng C-H (2021) Federated learning for driver status monitoring. In: 2021 IEEE International Intelligent Transportation Systems Conference (ITSC), p 1463–1469. IEEE, Singapore

  20. Zhang L, Saito H, Yang L, Wu J (2022) Privacy-preserving federated transfer learning for driver drowsiness detection. IEEE Access 10(2):80565–80574

    Article  Google Scholar 

  21. Bonawitz K, Ivanov V, Kreuter B, Marcedone A, McMahan HB, Patel S, Ramage D, Segal A, Seth K (2017) Practical secure aggregation for privacy-preserving machine learning. In: Proceedings of the 2017 ACM SIGSAC Conference on Computer and Communications Security, p 1175–1191. Association for Computing Machinery, Dallas, Texas, USA

  22. Ghazi B, Pagh R, Velingker A (2021) Scalable and differentially private distributed aggregation in the shuffled model. Int Conf Mach Learn 6(8):32–48

    Google Scholar 

  23. Deng Y, Lyu F, Ren J, Chen Y, Yang P, Zhou Y, Zhang Y (2022) Improving federated learning with quality-aware user incentive and auto-weighted model aggregation. IEEE Transactions on Parallel and Distributed Systems 33(12):4515–4529

    Article  Google Scholar 

  24. Deng Y, Lyu F, Ren J, Zhang Y, Zhou Y, Zhang Y, Yang Y (2021) Share: Shaping data distribution at edge for communication-efficient hierarchical federated learning. In: 2021 IEEE 41st International Conference on Distributed Computing Systems (ICDCS) 23:24–34

  25. Geyer RC, Klein T, Nabi M (2017) Differentially private federated learning. A Client Level Perspective 12(2):157–175

    Google Scholar 

  26. Bhowmick A, Duchi J, Freudiger J, Kapoor G, Rogers R (2018) Protection against reconstruction and its applications in private federated learning. Mach Learn 76(2):812–824

    Google Scholar 

  27. Agarwal N, Suresh AT, Yu FXX, Kumar S, McMahan B (2018) cpsgd: Communication-efficient and differentially-private distributed sgd. Adv Neural Inf Process Syst 31(2):7575–7586

    Google Scholar 

  28. Reddi S, Charles Z, Zaheer M, Garrett Z, Rush K, Koneˇcn`y J, Kumar S, McMahan HB, (2021) Adaptive federated optimization. Int Conf Learn Represent 8(3):295–323

    Google Scholar 

  29. Ding X, Wang C, Choo K-KR, Jin H (2019) A novel privacy preserving framework for large scale graph data publishing. IEEE transactions on knowledge and data engineering 33(2):331–343

    Google Scholar 

  30. Deng Y, Lyu F, Ren J, Wu H, Zhou Y, Zhang Y, Shen X (2021) Auction: Automated and quality-aware client selection framework for efficient federated learning. IEEE Transactions on Parallel and Distributed Systems 33(8):1996–2009

    Article  Google Scholar 

  31. Li T, Sahu AK, Zaheer M, Sanjabi M, Talwalkar A, Smith V (2020) Federated optimization in heterogeneous networks. Proceedings of Machine learning and systems 2(2):429–450

    Google Scholar 

  32. Jocher G, Chaurasia A, Borovec J (2021) ultralytics/yolov5: v6.0 - YOLOv5n ’Nano’ models. Roboflow Integ OpenCV DNN Supp 28(7):657-671

  33. Gevorgyan Z (2019) Siou loss: More powerful learning for bounding box regression. 2019 IEEE/CVF Conf Comput Vis Pattern Recognit (CVPR) 89(2):658–666 http://arxiv.org/abs/2205.12740

  34. Hou Q, Zhou D, Feng J (2021) Coordinate attention for efficient mobile network design. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, p 13713–13722. IEEE, Nashville, TN, USA

  35. Rezatofighi H, Tsoi N, Gwak J, Sadeghian A, Reid I, Savarese S (2019) Generalized intersection over union: A metric and a loss for bounding box regression. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, p 658–666. IEEE, Salt Lake City, UT, USA

  36. Montoya A, Holman D, Smith T, Kan W (2016) State farm distracted driver detection. Publish at https://kaggle.com/competitions/state-farm-distracted-driver-detection

  37. Redmon J, Farhadi A (2016) You Only Look Once: Unified, Real-Time Object Detection. 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 36(2):779–788

    Article  Google Scholar 

  38. Ren S, He K, Girshick R, Sun J (2015) Faster r-cnn: Towards real-time object detection with region proposal networks. Advances in neural information processing systems 28(2):152–161

    Google Scholar 

  39. Redmon J, Farhadi A (2018) Yolov3: An incremental improvement 36(2):78–84. arXiv preprint arXiv:1804.02767

  40. Wang C-Y, Bochkovskiy A, Liao H-YM (2023) Yolov7: Trainable bag-offreebies sets new state-of-the-art for real-time object detectors. Proc IEEE/CVF Conf Comput Vis Pattern Recognit 34(12):7464–7475

    Google Scholar 

  41. Jocher G, Chaurasia A, Qiu J (2023) YOLO by Ultralytics, 8.0.0. Publish at https://github.com/ultralytics/ultralytics

  42. Carion N, Massa F, Synnaeve G, Usunier N, Kirillov A, Zagoruyko S (2020) End-to-end object detection with transformers. In: Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part I 16, p 213–229. Springer

Download references

Acknowledgements

This work was supported by the Postgraduate Scientific Research Innovation Project of Hunan Province(CX20210796) and the National Natural Science Foundation of China(62103063) and the Research Foundation of Education Bureau of Hunan Province in china(Grant No.23A0255). We would like to thank the funding agency for their financial support.

Funding

Postgraduate Scientific Research Innovation Project of Hunan Province, China, Grant/Award Numbers: CX20210796. National Natural Science Foundation, China, Grant/Award Numbers: 62103063. Research Foundation of Education Bureau of Hunan Province, China, Grant/Award Numbers: 23A0255.

Author information

Authors and Affiliations

  1. State Key Laboratory of Disaster Prevention & Reduction for Power Grid, Changsha University of Science and Technology, Changsha, Hunan Province, 410114, China

    Wenguang Zhou, Zhiwei Jia, Chao Feng & Ling Li

  2. School of Computer Science and Engineering, Central South University, Changsha, Hunan Province, 410083, China

    Huali Lu & Feng Lyu

Authors
  1. Wenguang Zhou
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Zhiwei Jia
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. Chao Feng
    View author publications

    You can also search for this author inPubMed Google Scholar

  4. Huali Lu
    View author publications

    You can also search for this author inPubMed Google Scholar

  5. Feng Lyu
    View author publications

    You can also search for this author inPubMed Google Scholar

  6. Ling Li
    View author publications

    You can also search for this author inPubMed Google Scholar

Contributions

Wenguang Zhou: Writing - Original Draft, Software, Validation, Formal analysis; Zhiwei Jia: Conceptualization, Methodology, Supervision; Chao Feng: Investigation, Data Curation; Huali Liu: Visualization; Feng Lyu: Writing - Review & Editing; Ling Li: Funding acquisition, Project administration.

Corresponding author

Correspondence to Zhiwei Jia.

Ethics declarations

Ethical approval

Not applicable.

Competing interests

The authors declare no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhou, W., Jia, Z., Feng, C. et al. Towards driver distraction detection: a privacy-preserving federated learning approach. Peer-to-Peer Netw. Appl. 17, 896–910 (2024). https://doi.org/10.1007/s12083-024-01639-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12083-024-01639-5

Keywords