Skip to main content
SpringerLink
Log in

Small vehicle classification in the wild using generative adversarial network

  • Original Article
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

With the popularization of intelligent transportation system, the demand for vision-based algorithms and performance becomes more and severe. Vehicle detection techniques have made great strides in the past decades; however, there are still some challenges, such as the classification of tiny vehicles. The images of distant vehicles are generally blurred and lack detailed information due to their low resolutions. To solve this problem, we propose a novel method to generate high-resolution (HR) images from fuzzy images by employing a generative adversarial network (GAN). In addition, the dataset used for training standard GAN is generally constructed by down-sampling from the neutral HR images. Unfortunately, the effect of reconstruction is more modest. To cope with this trouble, we first construct our dataset by using three fuzzy kernels. Then, the exposure of the low-resolution (LR) image is adjusted randomly. Furthermore, a hybrid objective function is designed to guide the model to restore image details. The experimental results on the KITTI data set verify the effectiveness of our method for tiny vehicle classification.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Bai Y, Zhang Y, Ding M, Ghanem B (2018) Finding tiny faces in the wild with generative adversarial network. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 21–30

  2. Bell S, Lawrence Zitnick C, Bala K, Girshick R (2016) Inside-outside net: Detecting objects in context with skip pooling and recurrent neural networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 2874–2883

  3. Cai Z, Fan Q, Feris RS, Vasconcelos N (2016) A unified multi-scale deep convolutional neural network for fast object detection. In: European conference on computer vision, Springer, New York, pp 354–370

  4. Chen YL (2009) Nighttime vehicle light detection on a moving vehicle using image segmentation and analysis techniques. WSEAS Trans Comput 8(3):506–515

    Google Scholar 

  5. Cover T, Hart P (2003) Nearest neighbor pattern classification. IEEE Trans Inf Theory 13(1):21–27

    Article  Google Scholar 

  6. Csurka G, Dance C, Fan L, Willamowski J, Bray C (2004) Visual categorization with bags of keypoints. In: Workshop on statistical learning in computer vision, ECCV, Prague, vol 1, pp 1–2

  7. Dong C, Loy CC, He K, Tang X (2014) Learning a deep convolutional network for image super-resolution. In: European conference on computer vision, Springer, pp 184–199

  8. Dong C, Loy CC, He K, Tang X (2016) Image super-resolution using deep convolutional networks. IEEE Trans Pattern Anal Mach Intell 38(2):295–307

    Article  Google Scholar 

  9. Geiger A, Lenz P, Stiller C, Urtasun R (2013) Vision meets robotics: the kitti dataset. Int J Robot Res 32(11):1231–1237

    Article  Google Scholar 

  10. Girshick R (2015) Fast r-cnn. In: Proceedings of the IEEE international conference on computer vision, pp 1440–1448

  11. Goodfellow I (2016) Nips 2016 tutorial: Generative adversarial networks. ArXiv preprint arXiv:1701.00160

  12. He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 770–778

  13. He Y, Li L (2018) A novel multi-source vehicle detection algorithm based on deep learning. In: 2018 14th IEEE international conference on signal processing (ICSP), IEEE, pp 979–982

  14. Hu X, Xu X, Xiao Y, Chen H, He S, Qin J, Heng PA (2018) Sinet: a scale-insensitive convolutional neural network for fast vehicle detection. IEEE Trans Intell Transp Syst 20(3):1010–1019

    Article  Google Scholar 

  15. John GH (1995) Estimating continuous distributions in Bayesian classifiers. In: Proceedings of the 11th conference on uncertainty in artificial intelligence, 1995

  16. Jolicoeur-Martineau A (2018) The relativistic discriminator: a key element missing from standard gan. ArXiv preprint arXiv:1807.00734

  17. Kafai M, Bhanu B (2012) Dynamic Bayesian networks for vehicle classification in video. IEEE Trans Ind Inf 8(1):100–109

    Article  Google Scholar 

  18. Krizhevsky A, Sutskever I, Hinton G (2012) Imagenet classification with deep convolutional neural networks. Adv Neural Inf Process Syst 25(2):75–79

    Google Scholar 

  19. Ledig C, Theis L, Huszár F, Caballero J, Cunningham A, Acosta A, Aitken A, Tejani A, Totz J, Wang Z, et al (2017) Photo-realistic single image super-resolution using a generative adversarial network. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 4681–4690

  20. Li J, Liang X, Wei Y, Xu T, Feng J, Yan S (2017) Perceptual generative adversarial networks for small object detection. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1222–1230

  21. Ma Z, Yu L, Chan AB (2015) Small instance detection by integer programming on object density maps. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 3689–3697

  22. Nasrollahi K, Moeslund TB (2014) Super-resolution: a comprehensive survey. Mach Vis Appl 25(6):1423–1468

    Article  Google Scholar 

  23. Psyllos A, Anagnostopoulos CN, Kayafas E (2011) Vehicle model recognition from frontal view image measurements. Comput Stand Interfaces 33(2):142–151

    Article  Google Scholar 

  24. Ren S, He K, Girshick R, Sun J (2015) Faster R-CNN: towards real-time object detection with region proposal networks. In: Advances in neural information processing systems, pp 91–99

  25. Shuang W, Li Z, Zhang H, Ji Y, Yan L (2017) Classifying vehicles with convolutional neural network and feature encoding. In: IEEE international conference on industrial informatics

  26. Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. ArXiv preprint arXiv:1409.1556

  27. Wang X, Yu K, Wu S, Gu J, Liu Y, Dong C, Loy CC, Qiao Y, Tang X (2018) Esrgan: enhanced super-resolution generative adversarial networks

  28. Yang CY, Ma C, Yang MH (2014) Single-image super-resolution: a benchmark. In: European conference on computer vision, Springer, pp 372–386

  29. Zhang H, Sun Y, Liu L, Wang X, Li L, Liu W (2018) Clothingout: a category-supervised GAN model for clothing segmentation and retrieval. Neural Comput Appl 32:4519–4530

    Article  Google Scholar 

  30. Zhao H, Gallo O, Frosio I, Kautz J (2016) Loss functions for image restoration with neural networks. IEEE Trans Comput Imaging 3(1):47–57

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Automatic Control, College of Automation Engineering, Nanjing University of Aeronautics and Astronautics, 29 Jiangjun Avenue, Jiangning District, Nanjing, Jiangsu Province, China

    Xu Wang, Xiaoming Chen & Yanping Wang

Authors
  1. Xu Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Xiaoming Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yanping Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Xiaoming Chen.

Ethics declarations

Conflicts of interest

The authors declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wang, X., Chen, X. & Wang, Y. Small vehicle classification in the wild using generative adversarial network. Neural Comput & Applic 33, 5369–5379 (2021). https://doi.org/10.1007/s00521-020-05331-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-020-05331-6

Keywords

Search

Navigation