Skip to main content
Log in

PakVehicle-ReID: a multi-perspective benchmark for vehicle re-identification in unconstrained urban road environment

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

    We’re sorry, something doesn't seem to be working properly.

    Please try refreshing the page. If that doesn't work, please contact support so we can address the problem.

Abstract

The challenge of re-identifying vehicles in urban city surveillance systems and major traffic arteries such as highways and roads is an important area of research. The advent of large-scale benchmarks such as VeRI-776 and Vehicle-ID has propelled efforts to enhance search operations from large databases for re-identification. However, several unresolved challenges associated with vehicle re-identification in unconstrained environments remain to be explored. In order to foster research in this field, we have compiled a new multi-perspective dataset, PAKVehicle-ReId, captured by real-world surveillance cameras in urban cities of the developing country of Pakistan. To the best of our knowledge, this is the first such dataset collected under unconstrained conditions in a developing Asian region. The dataset comprises 80,000 images of 20,000 unique vehicles. Additionally, a deep learning-based technique for extracting multi-dimensional robust features for vehicle re-identification using convolutional neural networks has been proposed. The results show the effectiveness of the proposed method on the PAKVehicle-ReId dataset as well as on two other existing datasets, VeRI-776 and VehicleID. The code and link to the dataset can be obtained from the following GitHub repository: https://github.com/Vision-At-SEECS/PakvehicleReId.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

Data availibility statement

The dataset, source code and trained weights for the proposed architecture can be found at this link: https://bit.ly/3SJzHhL.

References

  1. Moral P, García-Martín Á, Martínez JM, Bescós J (2023) Enhancing vehicle re–identification via synthetic training datasets and re–ranking based on video–clips information. Multimedia Tools Appl 1–21

  2. Zhang F, Zhang L, Zhang H, Ma Y (2023) Image-to-image domain adaptation for vehicle re-identification. Multimedia Tools Appl 1–26

  3. Liu X, Liu W, Mei T, Ma H (2016) A deep learning-based approach to progressive vehicle re-identification for urban surveillance. In: European Conference on Computer Vision, pp. 869–884. Springer

  4. Liu H, Tian Y, Yang Y, Pang L, Huang T (2016) Deep relative distance learning: Tell the difference between similar vehicles. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2167–2175

  5. Yan K, Tian Y, Wang Y, Zeng W, Huang T (2017) Exploiting multi-grain ranking constraints for precisely searching visually-similar vehicles. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 562–570

  6. Guo H, Zhao C, Liu Z, Wang J, Lu H (2018) Learning coarse-to-fine structured feature embedding for vehicle re-identification. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 32

  7. Rasib M, Butt MA, Riaz F, Sulaiman A, Akram M (2021) Pixel level segmentation based drivable road region detection and steering angle estimation method for autonomous driving on unstructured roads. IEEE Access 9:167855–167867

    Article  Google Scholar 

  8. Zahra A, Perwaiz N, Shahzad M, Fraz MM (2023) Person re-identification: A retrospective on domain specific open challenges and future trends. Pattern Recogn 109669

  9. Lou Y, Bai Y, Liu J, Wang S, Duan L (2019) Veri-wild: A large dataset and a new method for vehicle re-identification in the wild. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 3235–3243

  10. Chen D, Yuan Z, Hua G, Zheng N, Wang J (2015) Similarity learning on an explicit polynomial kernel feature map for person re-identification. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1565–1573

  11. Zhang R, Lin L, Zhang R, Zuo W, Zhang L (2015) Bit-scalable deep hashing with regularized similarity learning for image retrieval and person re-identification. IEEE Trans Image Process 24(12):4766–4779

    Article  MathSciNet  Google Scholar 

  12. Zhu J, Zeng H, Liao S, Lei Z, Cai C, Zheng L (2017) Deep hybrid similarity learning for person re-identification. IEEE Trans Circ Syst Video Technol 28(11):3183–3193

    Article  Google Scholar 

  13. Alfasly S, Hu Y, Li H, Liang T, Jin X, Liu B, Zhao Q (2019) Multilabel- based similarity learning for vehicle re-identification. IEEE Access 7:162605–162616

    Article  Google Scholar 

  14. Chung D, Tahboub K, Delp EJ (2017) A two stream siamese convolutional neural network for person re-identification. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 1983–1991

  15. Zhu J, Zeng H, Du Y, Lei Z, Zheng L, Cai C (2018) Joint feature and similarity deep learning for vehicle re-identification. IEEE Access 6:43724–43731

    Article  Google Scholar 

  16. Yang K–S, Chen Y–K, Chen T–S, Liu C–T, Chien S–Y (2021) Tracklet-refined multi-camera tracking based on balanced cross-domain re-identification for vehicles. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 3983–3992

  17. Peng J, Wang H, Xu F, Fu X (2020) Cross domain knowledge learning with dual-branch adversarial network for vehicle re-identification. Neurocomputing 401:133–144

    Article  Google Scholar 

  18. Zhu J–Y, Park T, Isola P, Efros AA (2017) Unpaired image-to-image translation using cycle-consistent adversarial networks. In: Computer Vision (ICCV), 2017 IEEE International Conference On

  19. Bashir RMS, Shahzad M, Fraz MM (2019) Vr-proud: Vehicle reidentification using progressive unsupervised deep architecture. Pattern Recognition 90:52–65. https://doi.org/10.1016/j.patcog.2019.01.008

    Article  Google Scholar 

  20. Bashir RMS, Shahzad M, Fraz MM (2018) Dupl-vr: Deep unsupervised progressive learning for vehicle re-identification. In: Bebis G, Boyle R, Parvin B, Koracin D, Turek M, Ramalingam S, Xu K, Lin S, Alsallakh B, Yang J, Cuervo E, Ventura J (eds) Advances in Visual Computing. Springer, Cham, pp 286–295

    Google Scholar 

  21. Huynh SV (2021) A strong baseline for vehicle re-identification. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 4147–4154

  22. Luo H, Chen W, Xu X, Gu J, Zhang Y, Liu C, Jiang Y, He S, Wang F, Li H (2021) An empirical study of vehicle re-identification on the ai city challenge. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 4095–4102

  23. Deng W, Zheng L, Ye Q, Kang G, Yang Y, Jiao J (2018) Image-image domain adaptation with preserved self-similarity and domain-dissimilarity for person re-identification. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 994–1003

  24. Zhang F, Ma Y, Yuan G, Zhang H, Ren J (2021) Multiview image generation for vehicle reidentification. Appl Intell 51(8):5665–5682

    Article  Google Scholar 

  25. Shankar A, Poojary A, Kollerathu V, Yeshwanth C, Reddy S, Sudhakaran V (2019) Comparative study on various losses for vehicle reidentification. In: CVPR Workshops, vol. 2, p. 6

  26. Shen Y, Xiao T, Li H, Yi S, Wang X (2017) Learning deep neural networks for vehicle re–id with visual–spatio–temporal path proposals. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 1900–1909

  27. Ma X, Boukerche A (2021) An efficient real-time vehicle re-identification scheme using urban surveillance videos. In: ICC 2021-IEEE International Conference on Communications, pp. 1–6. IEEE

  28. Taufique AMN, Savakis A (2021) Labnet: Local graph aggregation network with class balanced loss for vehicle re-identification. Neurocomputing 463:122–132

    Article  Google Scholar 

  29. Zhang C, Yang C, Wu D, Dong H, Deng B (2022) Cross-view vehicle re-identification based on graph matching. Appl Intell 52(13):14799–14810

    Article  Google Scholar 

  30. Butt MA, Riaz F (2022) Carl-d: a vision benchmark suite and large scale dataset for vehicle detection and scene segmentation. Signal Processing: Image Communication 104:116667

    Google Scholar 

  31. Wang X, Shrivastava A, Gupta A (2017) A-fast-rcnn: Hard positive generation via adversary for object detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2606–2615

  32. Ding S, Lin L, Wang G, Chao H (2015) Deep feature learning with relative distance comparison for person re-identification. Pattern Recognition 48(10):2993–3003

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Muhammad Moazam Fraz.

Ethics declarations

Conflict of interest

The authors declare no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Asghar, H.A., Khan, B., Zafar, Z. et al. PakVehicle-ReID: a multi-perspective benchmark for vehicle re-identification in unconstrained urban road environment. Multimed Tools Appl 83, 53009–53024 (2024). https://doi.org/10.1007/s11042-023-17070-6

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-023-17070-6

Keywords