Skip to main content
SpringerLink
Log in

Pre-processing framework with virtual mono-layer sequence of boxes for video based vehicle detection applications

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

The increase in day to day vehicular traffic demands an efficient, automated and innovative approach for its management and regulation. One of the most practical and commonly used Intelligent Transportation Systems (ITS) based solution in recent times is video based traffic monitoring. The primary task of such systems is vehicle detection and the existing methods are not robust enough to handle diverse backgrounds and illumination changes in the traffic video. In order to address this issue, a Pre-processing Framework with Virtual Mono-Layered Sequence of Boxes (PF-VMSB) is proposed to make any vehicle detection process robust and efficient. The two composite modules of the proposed system include Effective Element Estimation (E3) module and Dynamic Multilevel Parallel Video Image Processing (D-MPVIP) module. The E3 module enhances the illumination of the traffic video only when necessary to produce an ideal environment for detection. Further, it classifies the type of background in video content (Static, Moderate or Dynamic) to provide an option to choose the appropriate image processing algorithm suitable for vehicle detection. In D-MPVIP module, the redundant video content are eliminated from processing to reduce the computational cost and processing time. Additionally, the spatial color information of the traffic video content is preserved and processed in parallel.The efficiency of the proposed framework of VMSB with E3 and D-MPVIP were analysed using benchmark datasets such as DETRAC, Urban Trackr, Ko-per and self recorded videos. The results shows an overall accuracy of detection rate using conventional image processing techniques such as Background Subtraction (BS) increases by 34.6% and the processing time is reduced by 37.5%. By incorporating the proposed framework into any vehicle detection process, the processing time and computational cost are improved without compromising the detection accuracy. The resultant of the detection process can be utilized by ITS application to enumerate traffic parameters such as vehicle volume count, congestion estimation, speed monitoring, travel time prediction, etc.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

References

  1. Baf FE, Bouwmans T, Vachon B (2008) Fuzzy integral for moving object detection. IEEE International Conference on Fuzzy Systems, pp 1729–1736

  2. Barnich O, Droogenbroeck MV (2011) Vibe: A Universal Background Subtraction Algorithm for Video Sequences. IEEE Trans Image Process 20(6):1709–1724

    Article  MathSciNet  MATH  Google Scholar 

  3. Bouwmans T, Garcia-Garcia B (2019) Background subtraction in real applications: challenges. Current Models and Future Directions. eprint 1901.03577

  4. Chen Z, Ellis T (2014) A self-adaptive Gaussian mixture model. SCI Journal on Computer Vision and Image Understanding 122:35–46

    Article  Google Scholar 

  5. Gonzalez RC, Woods RE (2017) Digital image processing, 4th edn. Pearson Publications, New Jersey

    Google Scholar 

  6. Induja C (2018) A survey on vehicle counting - double virtual line. Journal for Research in Applied Science and Engineering Technology 6:4471–4473

    Article  Google Scholar 

  7. KadewTraKuPong P, Bowden R (2002) “An improved adaptive background mixture model for Real-Time tracking with shadow detection. Proc. 2nd European Workshop on Advanced Video-Based Surveillance Systems, pp 135–144

  8. Kamkar S, Safabakhsh R (2016) Vehicle detection, counting and Classification in various conditions. IEEE Journal on IET Intell. Transp. Syst. 10(6):406–413

    Article  Google Scholar 

  9. Kanagamalliga S, Vasuki S, Shanmugapriya M (2016) Foreground object detection using expectation maximization based effective gaussian mixture model. Middle-East J Sci Res 24(Special Issue on Innovations in Information, Embedded and Communication Systems):51–57

    Google Scholar 

  10. Kastrinaki V, Zervakis M, Kalaitzakis K (2016) A survey of video processing techniques for traffic applications. Journal on Image and Vision Computing 21:359–38

    Article  Google Scholar 

  11. Kyungnam TH, Chalidabhongse D, Harwood LD (2005) “Real-time foreground–background segmentation using codebook model”

  12. Liang D, et al. (2015) Co-occurrence probability-based pixel pairs background model for robust object detection in dynamic scenes. Pattern Recogn 48 (4):1374–1390

    Article  Google Scholar 

  13. Manipriya S, Gitakrishnan VV, Reddy B (2015) “Grid-based real time image processing (GRIP) algorithm for heterogeneous traffic,” IEEE International conference on Communication Systems and Networks, IEEE Publications, pp 1–6

  14. Manipriya S, Mala C, Mathew S (2016) “Real Time Multilevel Video Image Processing for VANET,”. In: Proc. 5th international Conference on Computing, Communication and Sensor Network, CCSN

  15. Mohameda A, Issama A, Mohameda B, Abdellatifa B (2015) “Real-Time detection of vehicles using the Haar-Like features and artificial neuron networks”. Elseiver Journal, Procedia Computer Science 73 on Advanced Wireless, Information, and Communication Technologies 73:24–31

    Google Scholar 

  16. Monika (2017) “Parallel processing techniques for high performance image processing applications”, IEEE Publications International Conference on Electrical, Electronics and Computer Science (SCEECS)

  17. Mu K, Hui F, Zhao X (2016) Multiple vehicle detection and tracking in highway traffic surveillance video based on SIFT feature matching. Journal on Information Process System 12(2):183–195

    Google Scholar 

  18. Piccardi M (2004) “Background subtraction techniques: A review”. In: Proceedings of the IEEE International Conference on Systems, Man and Cybernetics, vol. 4, (The Hague, The Netherlands)

  19. Robert PL, Bala R, Trivedi M (2017) “Computer Vision and Imaging in Intelligent Transportation System”, Wiley Publications, vol 1 ISBN: 978-1-118-97160-4

  20. Sankaranarayanan M, Mala C, Mathew S (2014) ‘Performance Analysis of spatial color information for object detection using background subtraction’. Elsevier Publications, IERI Procedia 10:63–69

    Article  Google Scholar 

  21. Seenouvong W, Nuthong K, Ohnishi (2016) Vehicle detection and classification system based on virtual detection zone. International Joint Conference on Computer Science and Software Engineering, pp 1–5

  22. Shah M, Deng JD, Woodford BJ (2014) Video background modeling: recent approaches, issues and our proposed techniques. Springer Journal on Machine Vision and Applications 25:1105–1119

    Article  Google Scholar 

  23. Sivasamy P, Naveen R, Kumari A (2016) “Vision based Vehicle Counting for Traffic Congestion Analysis during Night Time,” Indian Journal of Science and Technology vol 9 issue20

  24. Stauffer C, Grimson WEL (1999) Adaptive background mixture models for real-time tracking. Proc. of CVPR, pp 246–252

  25. Taha M, Zayed HH, Nazmy T, Khalifa M (2017) Day/night Detector for Vehicle Tracking in Traffic Monitoring Systems. International Journal on Computer Electrical Automation Control Information Engineering 10(1):93–99

    Google Scholar 

  26. Yaghoobi Ershadi N, Menéndez JM, Jiménez D (2018) “Robust vehicle detection in different weather conditions: Using MIPM” PLos ONE 13(3): e0191355

  27. Yang S, Xu J, Wang MH (2012) Onboard vehicle detection and tracking using boosted gabor descriptor and sparse representation. IEEE Electronics Letter 48(16):995–997

    Article  Google Scholar 

  28. Zhang Y, Zhao C, He J, Chen A (2016) Vehicles detection in complex urban traffic scenes using Gaussian mixture model with confidence measurement. IEEE Journal on IET Intelligent Transport Systems 10(6):445–452

    Article  Google Scholar 

  29. ZiYangLilian SCP-C (2018) “Vehicle detection in intelligent transportation systems and its applications under varying environments: A review”. Journal on Image and Vision Computing 69:143–154

    Article  Google Scholar 

  30. Zivkovic Z (2004) Improved adaptive gaussian mixture model for background subtraction. International Conference on Pattern Recognition, IEEE Publications 2:28–31

    Google Scholar 

  31. UA-DETRAC Benschmark Suite [Online] Available: https://detrac-db.rit.albany.edu/DetRet

  32. Background Subtraction Library: [Online] Available: https://github.com/andrewssobral/bgslibrary

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science and Engineering, National Institute of Technology Tiruchirappalli, Tiruchirappalli, Tamilnadu, India

    Manipriya Sankaranarayanan & Mala C

  2. Department of Civil Engineering, National Institute of Technology Tiruchirappalli, Tiruchirappalli, Tamilnadu, India

    Samson Mathew

Authors
  1. Manipriya Sankaranarayanan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mala C
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Samson Mathew
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Manipriya Sankaranarayanan.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Sankaranarayanan, M., C, M. & Mathew, S. Pre-processing framework with virtual mono-layer sequence of boxes for video based vehicle detection applications. Multimed Tools Appl 80, 1095–1122 (2021). https://doi.org/10.1007/s11042-020-09587-x

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-020-09587-x

Keywords

Search

Navigation