Skip to main content
Log in

Efficient vehicle detection for traffic video-based intelligent transportation systems applications using recurrent architecture

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

The growth of vehicular population increases the need for an efficient methods for managing and regulating traffic. The effective and commonly existing solution in recent times is Intelligent Transportation Systems (ITS) that implements video-based traffic monitoring with computer vision techniques. The major challenge during such process is to achieve higher accuracy in vehicle detection with reduced computational cost. This paper proposes a solution to overcome the challenge using a Recurrent Architecture with Parallel Vehicle Detection Scheme (RAP-VDS) for a selected region of the frame of traffic video. There are two modules in the proposed RAP-VDS. Using an improved matching method, the Spatial Color Reducing over Recurrent Temporal Information (SCR2TI) module detects and removes the redundant frame. By processing the color components in parallel to increase detection accuracy, the Multi-level Parallelism with Spatial Color Information Processing (MSCIP) (MSCIP) module incorporates the spatial colour information of the non-redundant frames acquired through SCR2TI. The novel and innovative feature of RAP-VDS is that it can be incorporated by any video-based vehicle detection process. Also, RAP-VDS avoids the recurrent processing of content at the same time improves the detection without supressing the spatial characterstics of the traffic video. Hence, the proposed work offers an appropriate balance with detection and computational cost. The improvements in detections and computational costs are analysed with benchmark traffic videos usign conventional background subtraction techniques. From the results it is also seen that, the overall vehicle detection accuracy is 81.6%. The overall processing time was reduced by 37.5%. The major challenges to encounter the detection using the proposed RAP-VDS were for videos during poor illumination conditions. However, the results of the proposed work can also be improved further by using other improved video based detection technniques.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Algorithm 1
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

Data Availability

Data sharing not applicable to this article as no datasets were generated during the current study.

References

  1. Background Subtraction using OpenCV (2019). Available:https://docs.opencv.org/3.4/d1/dc5/tutorial_background_subtraction.html. Accessed 2019

  2. Barnich O, Van Droogenbroeck M (2011) ViBe: a universal background subtraction algorithm for video sequences. IEEE Trans Image Process 20(6):1709–1724

    Article  MathSciNet  MATH  Google Scholar 

  3. Garcia-Garcia B, Bouwmans T, Rosales Silva AJ (2020) Background subtraction in real applications: challenges, current models and future directions. Comput Sci Rev 35:100204. ISSN 1574-0137, https://doi.org/10.1016/j.cosrev.2019.100204

    Article  MathSciNet  Google Scholar 

  4. Brutzer S, Höferlin B, Heidemann G (2011) Evaluation of background subtraction techniques for video surveillance. IEEE Conference on Computer Vision and Pattern Recognition

  5. Chen Z, Ellis T (2014) A self-adaptive Gaussian mixture model. J Comput Vis Image Underst 122:35–46

    Article  Google Scholar 

  6. El Baf F, Bouwmans T, Vachon B (2008) Fuzzy integral for moving object detection IEEE international conference on fuzzy systems. IEEE International Conference on Fuzzy Systems, pp 1729–1736

  7. Girschick R (2015) Fast R-CNN (PDF). In: Proceedings of the IEEE International Conference on Computer Vision, pp 1440–1448

  8. Girshick R (2014) Rich feature hierarchies for accurate object detection and semantic segmentation (PDF). In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. IEEE, pp 580–587

  9. Gonzalez RC, Woods RE (2006) Digital image processing, 3rd edn. Prentice-Hall, Inc., USA

    Google Scholar 

  10. Hemnani M (2016) Parallel processing techniques for high performance image processing applications. In: 2016 IEEE Students’ Conference on Electrical, Electronics and Computer Science (SCEECS), pp 1–4

  11. Huo Z, Xia Y, Zhang B (2016) Vehicle type classification and attribute prediction using multi-task RCNN. In: International congress on image and signal processing. BioMedical Engineering and Informatics (CISP-BMEI), pp 564–569

  12. Impedovo D, Balducci F, Dentamaro V, Pirlo G (2019) Vehicular traffic congestion classification by visual features and deep learning approaches: a comparison. J Sensors 19(11):5213

    Article  Google Scholar 

  13. KadewTraKuPong P, Bowden R (2002) An improved adaptive background mixture model for Real-time tracking with shadow detection. International Conference on Pattern Recognition, PP 135–144

  14. Kanagamalliga S, Vasuki S, Shanmugapriya M (2016) Foreground object detection using expectation maximization based effective gaussian mixture model. Middle-East Journal of Scientific Research 24 (Special Issue on Innovations in Information, Embedded and Communication Systems, pp 51–57

  15. Kastrinaki V, Zervakis M, Kalaitzakis K (2016) A survey of video processing techniques for traffic applications. J Image Vis Comput 21:359–368

    Article  Google Scholar 

  16. Kim K, Chalidabhongse TH, Harwood D, Davis L (2005) Real-time foreground-background segmentation using codebook model. Real-Time Imag 11(3):172–185. ISSN 1077-2014, https://doi.org/10.1016/j.rti.2004.12.004

    Article  Google Scholar 

  17. Kumar A, Zhang ZJ, Lyu H (2020) Object detection in real time based on improved single shot multi-box detector algorithm. Journal on Wireless Com Network 2020, Article no. 204

  18. Kumaran SK, Mohapatra S, Dogra DP, Roy PP, Kim BG (2019) Computer vision-guided intelligent traffic signaling for isolated intersections. Expert Systems With Applications (Elsevier) 134(-):267–278

    Article  Google Scholar 

  19. Loce RP, Bala R, Trivedi M (2017) Book on computer vision and imaging in intelligent transportation Systems. Wiley publication

  20. Manana M, Tu C, Owolawi PA (2017) A survey on vehicle detection based on convolution neural networks. International Conference on Computer and Communications, pp 1751–1755

  21. Ma R, Zhang Z, Dong Y, Pan Y (2020) Deep learning based vehicle detection and classification methodology using strain sensors under bridge deck. Sensors (Basel). 2018: pp 5051

  22. Manipriya S, Mala C, Mathew S (2014) Performance analysis of spatial color information for object detection using background subtraction. IERI Procedia, vol 10

  23. Manipriya s, Mala C, Mathew S (2020) Virtual mono-layered continuous containers for vehicle detection applications in intelligent transportation systems. J Discret Math Sci Cryptogr 23:321–328

    Article  Google Scholar 

  24. Manipriya S, Mala C, Mathew S (2020) Significance of real time systems in intelligent transportation systems, chapter 5 in handling priority inversion in time-constrained distributed databases. IGI Global Publications, pp 61–85

  25. Manipriya S, Mala C, Mathew S (2021) Pre-processing framework with virtual mono-layer sequence of boxes for video based vehicle detection applications. J Multimed Tools Appl 80:1095–1122

    Article  Google Scholar 

  26. Manipriya S, Gitakrishnan V, Reddy VB (2015) Grid- based real time image processing (GRIP) algorithm for heterogeneous traffic. International conference on Communication Systems and Networks, pp 1–6

  27. Mohameda A, Issam A, Mohameda B, Abdellatif B (2015) Real-time detection of vehicles using the haar-like features and artificial neuron networks. Adv Wirel, Inf, Commun Technol 73:24–31

    Google Scholar 

  28. Piccardi M (2004) Background subtraction techniques: a review. In: IEEE international conference on systems, man and cybernetics, vol 4, pp 3099-3104

  29. Shah M, Woodford JD, Deng BJ (2014) Video background modeling: recent approaches, issues and our proposed techniques. J Mach Vis Appl 25:1105–1119

    Article  Google Scholar 

  30. Song H, Liang H, Li H (2019) Vision-based vehicle detection and counting system using deep learning in highway scenes. Eur Transp Res Rev 11:51

    Article  Google Scholar 

  31. Stauffer C, Grimson WEL (1999) Adaptive background mixture models for real-time tracking. Proc of CVPR, pp 246–252

  32. Suhao L, Jinzhao L, Guoquan L, Tong B, Huiqian W, Yu P (2018) Vehicle type detection based on deep learning in traffic scene. Procedia Comput Sci 131:564–572

    Article  Google Scholar 

  33. Wen L, Du D, Cai Z, Lei Z, Chang MC, Qi H, Lim J, Yang MH, Lyu S (2020) UA-DETRAC: a new benchmark and protocol for multi-object detection and tracking. Journal on Computer Vision and Image Understanding, vol 193

  34. Yaghoobi EN, Menéndez JM, Jiménez D (2018) Robust vehicle detection in different weather conditions: using MIPM. PLoS ONE 13:1

    Google Scholar 

  35. Yang Z, Lilian SC, Pun-Cheng (2018) Vehicle detection in intelligent transportation systems and its applications under varying environments: a review. J Image Vis Comput 69:143–154

    Article  Google Scholar 

  36. Yang S, Xu J, Wang MH (2012) Onboard vehicle detection and tracking using boosted Gabor descriptor and sparse representation. IEEE Electron Lett 48(16):995–997

    Article  Google Scholar 

  37. Zhang Y, Zhao C, He J, Chen A (2016) Vehicles detection in complex urban traffic scenes using Gaussian mixture model with confidence measurement. Journal IET Intell Transp Syst 10(6):445–452

    Article  Google Scholar 

  38. Zivkovic Z (2004) Improved adaptive Gaussian mixture model for background subtraction. Int Conf Pattern Recog 2:28–31

    Google Scholar 

  39. Rivastava S, Divekar AV, Anilkumar C (2021) Comparative analysis of deep learning image detection algorithms. J Big Data 8:66

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Manipriya Sankaranarayanan.

Ethics declarations

Conflict of Interests

The authors declare that they have no conflict of interest

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Sankaranarayanan, M., Mala, C. & Mathew, S. Efficient vehicle detection for traffic video-based intelligent transportation systems applications using recurrent architecture. Multimed Tools Appl 82, 39015–39033 (2023). https://doi.org/10.1007/s11042-023-14812-4

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-023-14812-4

Keywords

Navigation