Abstract
The challenge of re-identifying vehicles in urban city surveillance systems and major traffic arteries such as highways and roads is an important area of research. The advent of large-scale benchmarks such as VeRI-776 and Vehicle-ID has propelled efforts to enhance search operations from large databases for re-identification. However, several unresolved challenges associated with vehicle re-identification in unconstrained environments remain to be explored. In order to foster research in this field, we have compiled a new multi-perspective dataset, PAKVehicle-ReId, captured by real-world surveillance cameras in urban cities of the developing country of Pakistan. To the best of our knowledge, this is the first such dataset collected under unconstrained conditions in a developing Asian region. The dataset comprises 80,000 images of 20,000 unique vehicles. Additionally, a deep learning-based technique for extracting multi-dimensional robust features for vehicle re-identification using convolutional neural networks has been proposed. The results show the effectiveness of the proposed method on the PAKVehicle-ReId dataset as well as on two other existing datasets, VeRI-776 and VehicleID. The code and link to the dataset can be obtained from the following GitHub repository: https://github.com/Vision-At-SEECS/PakvehicleReId.






Similar content being viewed by others
Data availibility statement
The dataset, source code and trained weights for the proposed architecture can be found at this link: https://bit.ly/3SJzHhL.
References
Moral P, García-Martín Á, Martínez JM, Bescós J (2023) Enhancing vehicle re–identification via synthetic training datasets and re–ranking based on video–clips information. Multimedia Tools Appl 1–21
Zhang F, Zhang L, Zhang H, Ma Y (2023) Image-to-image domain adaptation for vehicle re-identification. Multimedia Tools Appl 1–26
Liu X, Liu W, Mei T, Ma H (2016) A deep learning-based approach to progressive vehicle re-identification for urban surveillance. In: European Conference on Computer Vision, pp. 869–884. Springer
Liu H, Tian Y, Yang Y, Pang L, Huang T (2016) Deep relative distance learning: Tell the difference between similar vehicles. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2167–2175
Yan K, Tian Y, Wang Y, Zeng W, Huang T (2017) Exploiting multi-grain ranking constraints for precisely searching visually-similar vehicles. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 562–570
Guo H, Zhao C, Liu Z, Wang J, Lu H (2018) Learning coarse-to-fine structured feature embedding for vehicle re-identification. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 32
Rasib M, Butt MA, Riaz F, Sulaiman A, Akram M (2021) Pixel level segmentation based drivable road region detection and steering angle estimation method for autonomous driving on unstructured roads. IEEE Access 9:167855–167867
Zahra A, Perwaiz N, Shahzad M, Fraz MM (2023) Person re-identification: A retrospective on domain specific open challenges and future trends. Pattern Recogn 109669
Lou Y, Bai Y, Liu J, Wang S, Duan L (2019) Veri-wild: A large dataset and a new method for vehicle re-identification in the wild. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 3235–3243
Chen D, Yuan Z, Hua G, Zheng N, Wang J (2015) Similarity learning on an explicit polynomial kernel feature map for person re-identification. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1565–1573
Zhang R, Lin L, Zhang R, Zuo W, Zhang L (2015) Bit-scalable deep hashing with regularized similarity learning for image retrieval and person re-identification. IEEE Trans Image Process 24(12):4766–4779
Zhu J, Zeng H, Liao S, Lei Z, Cai C, Zheng L (2017) Deep hybrid similarity learning for person re-identification. IEEE Trans Circ Syst Video Technol 28(11):3183–3193
Alfasly S, Hu Y, Li H, Liang T, Jin X, Liu B, Zhao Q (2019) Multilabel- based similarity learning for vehicle re-identification. IEEE Access 7:162605–162616
Chung D, Tahboub K, Delp EJ (2017) A two stream siamese convolutional neural network for person re-identification. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 1983–1991
Zhu J, Zeng H, Du Y, Lei Z, Zheng L, Cai C (2018) Joint feature and similarity deep learning for vehicle re-identification. IEEE Access 6:43724–43731
Yang K–S, Chen Y–K, Chen T–S, Liu C–T, Chien S–Y (2021) Tracklet-refined multi-camera tracking based on balanced cross-domain re-identification for vehicles. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 3983–3992
Peng J, Wang H, Xu F, Fu X (2020) Cross domain knowledge learning with dual-branch adversarial network for vehicle re-identification. Neurocomputing 401:133–144
Zhu J–Y, Park T, Isola P, Efros AA (2017) Unpaired image-to-image translation using cycle-consistent adversarial networks. In: Computer Vision (ICCV), 2017 IEEE International Conference On
Bashir RMS, Shahzad M, Fraz MM (2019) Vr-proud: Vehicle reidentification using progressive unsupervised deep architecture. Pattern Recognition 90:52–65. https://doi.org/10.1016/j.patcog.2019.01.008
Bashir RMS, Shahzad M, Fraz MM (2018) Dupl-vr: Deep unsupervised progressive learning for vehicle re-identification. In: Bebis G, Boyle R, Parvin B, Koracin D, Turek M, Ramalingam S, Xu K, Lin S, Alsallakh B, Yang J, Cuervo E, Ventura J (eds) Advances in Visual Computing. Springer, Cham, pp 286–295
Huynh SV (2021) A strong baseline for vehicle re-identification. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 4147–4154
Luo H, Chen W, Xu X, Gu J, Zhang Y, Liu C, Jiang Y, He S, Wang F, Li H (2021) An empirical study of vehicle re-identification on the ai city challenge. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 4095–4102
Deng W, Zheng L, Ye Q, Kang G, Yang Y, Jiao J (2018) Image-image domain adaptation with preserved self-similarity and domain-dissimilarity for person re-identification. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 994–1003
Zhang F, Ma Y, Yuan G, Zhang H, Ren J (2021) Multiview image generation for vehicle reidentification. Appl Intell 51(8):5665–5682
Shankar A, Poojary A, Kollerathu V, Yeshwanth C, Reddy S, Sudhakaran V (2019) Comparative study on various losses for vehicle reidentification. In: CVPR Workshops, vol. 2, p. 6
Shen Y, Xiao T, Li H, Yi S, Wang X (2017) Learning deep neural networks for vehicle re–id with visual–spatio–temporal path proposals. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 1900–1909
Ma X, Boukerche A (2021) An efficient real-time vehicle re-identification scheme using urban surveillance videos. In: ICC 2021-IEEE International Conference on Communications, pp. 1–6. IEEE
Taufique AMN, Savakis A (2021) Labnet: Local graph aggregation network with class balanced loss for vehicle re-identification. Neurocomputing 463:122–132
Zhang C, Yang C, Wu D, Dong H, Deng B (2022) Cross-view vehicle re-identification based on graph matching. Appl Intell 52(13):14799–14810
Butt MA, Riaz F (2022) Carl-d: a vision benchmark suite and large scale dataset for vehicle detection and scene segmentation. Signal Processing: Image Communication 104:116667
Wang X, Shrivastava A, Gupta A (2017) A-fast-rcnn: Hard positive generation via adversary for object detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2606–2615
Ding S, Lin L, Wang G, Chao H (2015) Deep feature learning with relative distance comparison for person re-identification. Pattern Recognition 48(10):2993–3003
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Asghar, H.A., Khan, B., Zafar, Z. et al. PakVehicle-ReID: a multi-perspective benchmark for vehicle re-identification in unconstrained urban road environment. Multimed Tools Appl 83, 53009–53024 (2024). https://doi.org/10.1007/s11042-023-17070-6
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-023-17070-6