Skip to main content
SpringerLink
Log in

Vehicle type classification using graph ant colony optimizer based stack autoencoder model

  • 1220: Visual and Sensory Data Processing for Real Time Intelligent Surveillance System
  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

In the intelligent transport system, vehicle type classification technology plays a major role. With the growth of video processing and pattern recognition application, a deep learning model is proposed in this research article to improve vehicle type classification under dynamic background. Initially, the original video sequences are collected from MIOvision Traffic Camera Dataset (MIO-TCD), and CDnet2014 dataset. Additionally, the contrast and visible level of the video frames are improved by implementing histogram equalization method. Next, the moving vehicles are detected and tracked using Gaussian Mixture Model (GMM) and Kalman filter. Then, the feature extraction is accomplished using Dual Tree Complex Wavelet Transform (DTCWT), Histogram of Oriented Gradients (HOG), and Local Ternary Pattern (LTP) to extract the texture feature vectors. Further, a new graph clustering-Ant Colony Optimization (ACO) algorithm is proposed to select the active feature vectors for better vehicle type classification. Lastly, the selected active feature vectors are given as the input to stack autoencoder classifier to classify eleven vehicle types in MIO-TCD and four vehicle types in CDnet2014 dataset. In the experimental section, the graph ACO based stack autoencoder model achieved 99.09%, and 89.89% of classification accuracy on both MIO-TCD, and CDnet2014 dataset, which are better related to the existing models like attention based method, improved spatiotemporal sample consistency algorithm, and generative adversarial nets.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

References

  1. Aqel S, Hmimid A, Sabri MA, Aarab A (2017) Road traffic: Vehicle detection and classification. Intell Syst Comput Vis (ISCV) IEEE pp 1–5

  2. Bagade SS, Shandilya VK (2011) Use of histogram equalization in image processing for image enhancement. Int J Software Eng Res Pract 1(2):6–10

    Google Scholar 

  3. Bakti RY, Areni IS, Prayogi AA (2016) Vehicle detection and tracking using Gaussian mixture model and Kalman filter. Int Conf Comput Intell Cybernet IEEE pp115–119

  4. Chen Z, Pears N, Freeman M, Austin J (2013) A Gaussian mixture model and support vector machine approach to vehicle type and colour classification. IET Intel Transport Syst 8(2):135–144

    Article  Google Scholar 

  5. Dong Z, Wu Y, Pei M, Jia Y (2015) Vehicle type classification using a semisupervised convolutional neural network. IEEE Trans Intell Transp Syst 16(4):2247–2256

    Article  Google Scholar 

  6. Ghimatgar H, Kazemi K, Helfroush MS, Aarabi A (2018) An improved feature selection algorithm based on graph clustering and ant colony optimization. Knowl-Based Syst 159:270–285

    Article  Google Scholar 

  7. Gothankar N, Kambhamettu C, Moser P (2019) Circular hough transform assisted CNN based vehicle axle detection and classification. 4th Inter Conf Intel Transport Eng (ICITE) IEEE pp 217–221

  8. Goyal K, Kaur D (2016) A novel vehicle classification model for urban traffic surveillance using the deep neural network model. Int J Educ Manag Eng (IJEME) 6(1):18–31

    Google Scholar 

  9. Hedeya MA, Eid AH, Abdel-Kader RF (2020) A super-learner ensemble of deep networks for vehicle-type classification. IEEE Access 8:98266–98280

    Article  Google Scholar 

  10. Kwan C, Gribben D, Chou B, Budavari B, Larkin J, Rangamani A, Tran T, Zhang J, Etienne-Cummings R (2020) Real-Time and Deep Learning Based Vehicle Detection and Classification Using Pixel-Wise Code Exposure Measurements. Electronics 9(6):1014

    Article  Google Scholar 

  11. Li F, Lv Z (2017) Reliable vehicle type recognition based on information fusion in multiple sensor networks. Comput Netw 117:76–84

    Article  Google Scholar 

  12. Liu W, Luo Z, Li S (2018) Improving deep ensemble vehicle classification by using selected adversarial samples. Knowl-Based Syst 160:167–175

    Article  Google Scholar 

  13. Luo Z, Branchaud-Charron F, Lemaire C, Konrad J, Li S, Mishra A, Achkar A, Eichel J, Jodoin PM (2018) MIO-TCD: A new benchmark dataset for vehicle classification and localization. IEEE Trans Image Process 27(10):5129–5141

    Article  MathSciNet  Google Scholar 

  14. Moradi P, Rostami M (2015) Integration of graph clustering with ant colony optimization for feature selection. Knowl-Based Syst 84:144–161

    Article  Google Scholar 

  15. Mukherjee D, Wu QJ, Nguyen TM (2013) Multiresolution based Gaussian mixture model for background suppression. IEEE Trans Image Process 22(12):5022–5035

    Article  MathSciNet  MATH  Google Scholar 

  16. Nasaruddin N, Muchtar K, Afdhal A (2019) A lightweight moving vehicle classification system through attention-based method and deep learning. IEEE Access 7:157564–157573

    Article  Google Scholar 

  17. Rachmadi RF, Uchimura K, Koutaki G, Ogata K (2018) Single image vehicle classification using pseudo long short-term memory classifier. J Vis Commun Image Represent 56:265–274

    Article  Google Scholar 

  18. Rassem TH, Khoo BE (2014) Completed local ternary pattern for rotation invariant texture classification. Sci World J

  19. Sharma M, Sharma P, Pachori RB, Acharya UR (2018) Dual-tree complex wavelet transform-based features for automated alcoholism identification. Int J Fuzzy Syst 20(4):1297–1308

    Article  Google Scholar 

  20. Shvai N, Hasnat A, Meicler A, Nakib A (2019) Accurate classification for automatic vehicle-type recognition based on ensemble classifiers. IEEE Trans Intell Transp Syst 21(3):1288–1297

    Article  Google Scholar 

  21. Suhao L, Jinzhao L, Guoquan L, Tong B, Huiqian W, Yu P (2018) Vehicle type detection based on deep learning in traffic scene. Procedia Comput Sci 131:564–572

    Article  Google Scholar 

  22. Sun W, Zhang X, Shi S, He J, Jin Y (2017) Vehicle type recognition combining global and local features via two-stage classification. Math Prob Eng

  23. Theagarajan R, Thakoor NS, Bhanu B (2019) Physical features and deep learning-based appearance features for vehicle classification from rear view videos. IEEE Trans Intell Transp Syst 21(3):1096–1108

    Article  Google Scholar 

  24. Wang Q, Ding YD (2018) A novel fine-grained method for vehicle type recognition based on the locally enhanced PCANet neural network. J Comput Sci Technol 33(2):335–350

    Article  Google Scholar 

  25. Wang X, Zhang W, Wu X, Xiao L, Qian Y, Fang Z (2019) Real-time vehicle type classification with deep convolutional neural networks. J Real-Time Image Proc 16(1):5–14

    Article  Google Scholar 

  26. Wang Y, Ban X, Wang H, Wu D, Wang H, Yang S, Liu S, Lai J (2019) Detection and classification of moving vehicle from video using multiple spatio-temporal features. IEEE Access 7:80287–80299

    Article  Google Scholar 

  27. Wang Y, Jodoin PM, Porikli F, Konrad J, Benezeth Y, Ishwar P (2014) CDnet 2014: An expanded change detection benchmark dataset. In Proc IEEE Conf Comput Vis Pattern Recognit Workshops pp 387–394

  28. Yan G, Yu M, Yu Y, Fan L (2016) Real-time vehicle detection using histograms of oriented gradients and AdaBoost classification. Optik 127(19):7941–7951

    Article  Google Scholar 

  29. Zakaria A, Rizal R, Dwi O (2018) Particle swarm optimization and support vector machine for vehicle type classification in video stream. Int J Comput Appl 182(18):9–13

    Article  Google Scholar 

  30. Zhang B, Zhou Y, Pan H, Tillo T (2014) Hybrid model of clustering and kernel autoassociator for reliable vehicle type classification. Mach Vis Appl 25(2):437–450

    Article  Google Scholar 

  31. Zhang F, Yang F, Li C, Yuan G (2019) CMNet: A connect-and-merge convolutional neural network for fast vehicle detection in urban traffic surveillance. IEEE Access 7:72660–72671

    Article  Google Scholar 

  32. Zhang L, Wang J, An Z (2021) Vehicle recognition algorithm based on Haar-like features and improved Adaboost classifier. J Ambient Intell Humaniz Comput pp1–9

  33. Zhou P, Han J, Cheng G, Zhang B (2019) Learning compact and discriminative stacked autoencoder for hyperspectral image classification. IEEE Trans Geosci Remote Sens 57(7):4823–4833

    Article  Google Scholar 

  34. Zhu E, Xu M, Pi DC (2021) Vehicle type recognition algorithm based on improved network in network. Complexity

Download references

Author information

Authors and Affiliations

  1. CMR Technical Campus, Kandlakoya, Hyderabad, India

    B. Kavitha Rani, M. Varaprasad Rao, Raj Kumar Patra, K. Srinivas & G. Madhukar

Authors
  1. B. Kavitha Rani
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. M. Varaprasad Rao
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Raj Kumar Patra
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. K. Srinivas
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. G. Madhukar
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to K. Srinivas.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Rani, B.K., Rao, M.V., Patra, R.K. et al. Vehicle type classification using graph ant colony optimizer based stack autoencoder model. Multimed Tools Appl 81, 42163–42182 (2022). https://doi.org/10.1007/s11042-021-11508-5

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-021-11508-5

Keywords

Search

Navigation