Skip to main content
SpringerLink
Log in

Driving Assistance: Pedestrians and Bicycles Accident Risk Estimation using Onboard Front Camera

  • Published:
International Journal of Intelligent Transportation Systems Research Aims and scope Submit manuscript

Abstract

In this study, we propose a collision detection system by detecting and estimating the risk posed by pedestrians and bicycles in the images captured by a monocular onboard camera. In the proposed intrusion system, after initial detection, the pedestrians and bicycles are tracked to obtain their location, the direction of movement, and posture information using lane detection information, velocity calculation and, pose estimation respectively. Finally, this information is evaluated using fuzzy rules to estimate the risk the pedestrian and/or bicycle poses. The results are transmitted to the driver using voice and sound. We tested the system using 89 video scenes and achieved recall and precision accuracies of 0.94 and 0.87 respectively.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

References

  1. The Japan Times: Road Deaths in Japan fell to record low in 2020 amid COVID-19 stay home requests. https://www.japantimes.co.jp/news/2021/06/15/national/japan-traffic-accidents-covid-19/ (Retrieved 2022–1–20)

  2. Papageorgiou, C., Poggio,  T.: A trainable pedestrian detection system. Int. J. Comput. Vis. (IJCV) 1, 15–33 (2000)

  3. Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. (CVPR), 1, 886–893 (2005)

  4. Solichin, A., Harjoko, A., Agfianto E.P.: A survey of Pedestrian Detection in video. Int. J. Adv. Sci. Appl. (IJACSAI) 5(10), 41–47 (2014)

  5. Wu, B., Nevatia, R.: Detection of multiple, partially occluded humans in a single image by Bayesian Combination of Edgelet Part Detectors. IEEE Int. Conf. Comput. Vis. (ICCV) 1, 90–97 (2005)

  6. Mikolajczyk, K., Schmid, C., Zisserman, A.: Human detection based on a probabilistic assembly of robust part detectors. The European Conference on Computer Vision (ECCV), 3021(2004), 69–82 (2005)

    MATH  Google Scholar 

  7. Piérard, S., Lejeune, A., Droogenbroeck, M.V.: A probabilistic pixel-based approach to detect humans in video streams. IEEE Int. Conf. Acoust. Speech Signal Process. (ICASSP) 921–924 (2011)

  8. Fleuret, F., Berclaz, J., Lengagne, R., Fua, P.: Multi-camera people tracking with a probabilistic occupancy map. IEEE Trans. Pattern Anal. Mach. Intell. 30(2), 267–282 (2008)

    Article  Google Scholar 

  9. Girshick, R., Donahue, J., Darrell, T. et al.: Rich feature hierarchies for accurate object detection and semantic segmentation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 580–587, Columbus, OH, USA (2014)

  10. He, K., Gkioxari, G., Dollar, P., et al.: Mask r-cnn. In: Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV), pp. 2980–2988. Long Beach, CA, USA (2017)

  11. Girshick, R.: Fast r-cnn. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 1440–1448, Barcelona, Spain (2015)

  12. Ren, S., He, K., Girshick, R., et al.: Faster R-CNN: towards real-time object detection with region proposal networks. Adv. Neural. Inf. Process. Syst. 39(6), 91–99 (2015)

    Google Scholar 

  13. Redmon, J., Divvala, S., Girshick, R. et al.: You only look once: unified, real-time object detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 779–788, Las Vegas, NV, USA (2016)

  14. Redmon, J., Farhadi, A.: Yolo9000: better, faster, stronger. In: Proceedings of 30th IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA (2017)

  15. Redmon, J., Farhadi, A.: Yolov3: an incremental improvement (2018). http://arxiv.org/abs/1804.02767. Accessed 10 Nov 2020

  16. Liu, W., Anguelov, D., Erhan, D. et al.: Ssd: single shot multibox detector. In: Proceedings of the European Conference on Computer Vision, pp. 21–37. Springer (2016)

  17. Liu, W., Liao, S., Hu, W., et al.: Learning efficient single-stage pedestrian detectors by asymptotic localization fitting. In: Proceedings Of the European Conference on Computer Vision, pp. 643–659, Munich, Germany (2018)

  18. Zheng, Z., Wang, P., Liu, W., et al.: Distance-IoU Loss: Faster and Better Learning for Bounding Box Regression (2019).https://arxiv.org/abs/1911.08287. Accessed 20 Dec 202

  19. Wang, B.A., Liao, C.W.: Optimal Speed and Accuracy of Object Detection (2020). https://arxiv.org/abs/2004.10934. Accessed 21 Dec 2020

  20. Tian, D., Han, Y., Wang, B., Guan, T., Wei, W.: A review of intelligent driving pedestrian detection based on deep learning. Comput. Intell. Neurosci. 1–16 (2021)

  21. ASV (Advanced Safety Vehicle). chrome-extension://ieepebpjnkhaiioojkepfniodjmjjihl/data/pdf.js/web/viewer.html?file=https%3A%2F%2F (referenced 2020–12–19)

  22. Fu, H., Gong, M., Wang, C., Batmanghelich, K., Tao, D.: Deep ordinal regression network for monocular depth estimation. In: IEEE Computer Vision and Pattern Recognition (CVPR). 2002–2011 (2018)

  23. Godard, C., Mac Aodha, O., Brostow, G.J.: Unsupervised monocular depth estimation with left-right consistency. In: International Conference on Computer Vision and Pattern Recognition (CVPR). 270–279 (2017)

  24. Zaheer, A., Rashid, M., Riaz, M.A., Khan, S.: Single-View Reconstruction using orthogonal line-pairs. Comput. Vis. Image Underst. 172, 107–123 (2018)

    Article  Google Scholar 

  25. Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.-Y., Berg, A.C.: SSD: Single Shot MultiBox Detector. European Conference on Computer Vision, Springer International Publishing, 978–3–319–46448–0, pp. 21–37 (2016). https://doi.org/10.1007/978-3-319-46448-0_2

  26. Simonyan, K., Zisserman, A.: Very deep convolutional Networks for Large-Scale Image Recognition. CVPR, arXiv:1409.1556 (2014)

  27. Cao, Z., Simon, T., Wei, S.-E., Sheikh, Y.: OpenPose: Realtime Multi-Person 2D pose estimation using part affinity fields. IEEE Trans. Pattern Anal. Mach. Intell. 43, 172–186 (2021)

  28. OpenPose Experimental models, https://github.com/CMU-Perceptual-Computing-b/openpose_train/blob/master/experimental_models/README.md (referenced 2020–12–19)

  29. Braking Distance, Wiki. https://en.wikipedia.org/wiki/Braking_distance. (referenced 2020–12–12)

Download references

Author information

Authors and Affiliations

  1. Tokushima University, 2-1 Minami Josanjima, Tokushima, Japan

    Stephen Karungaru, Ryosuke Tsuji & Kenji Terada

Authors
  1. Stephen Karungaru
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ryosuke Tsuji
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Kenji Terada
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Stephen Karungaru.

Ethics declarations

Conflict of Interest

The authors declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Karungaru, S., Tsuji, R. & Terada, K. Driving Assistance: Pedestrians and Bicycles Accident Risk Estimation using Onboard Front Camera. Int. J. ITS Res. 20, 768–777 (2022). https://doi.org/10.1007/s13177-022-00324-2

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s13177-022-00324-2

Keywords

Search

Navigation