Skip to main content
SpringerLink
Log in

Vehicle Re-Identification by Separating Representative Spatial Features

  • Original Article
  • Published:
Cognitive Computation Aims and scope Submit manuscript

Abstract

As a complex image classification problem, re-identification (ReID) requires the model to capture diverse representative features of vehicles through different spatial orientation cameras. However, it has been observed that the existing models tend to focus on extracting features with strong discrimination, while ignoring other valuable spatial features. In addition, the existing methods lack effective suppression of noise caused by spatial variations. Inspired by the observation from the human cognition that, the view and direction of the vehicle can be correctly recognized by human beings with only partial representative spatial features observed, in this paper, we propose a novel method to effectively separate representative spatial (SRS) information and non-spatial region discriminative information of vehicles. First, we specifically use an effective network to extract the vehicle keypoint information (e.g., roof and left wheel), and capture the representative local spatial region via the keypoint information. Then, we use the representative spatial features in the local spatial region and the distinguishing discriminative features in the non-spatial region to eliminate the interference arising from the spatial shift while enhancing the robustness of the model. Finally, the global discriminative information and representative spatial information are combined for vehicle re-identification to enhance the performance of the model. We validate the effectiveness of our proposed approach on the vehicle ReID datasets (VehicleID, VeRi-776 and VeRi-Wild). Experimental results show that our method achieves state-of-the-art performance.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

Data Availability

All the data that support the findings of this study are openly available. They are all publicly released and commonly used by the community. The data can be find via these references: [3, 41] and [51].

References

  1. Quispe R, Lan C, Zeng W, Pedrini H. Attributenet: Attribute enhanced vehicle re-identification. Neurocomputing. 2021;465:84–92. https://doi.org/10.1016/j.neucom.2021.08.126.

    Article  Google Scholar 

  2. Wang H, Peng J, Jiang G, Xu F, Fu X. Discriminative feature and dictionary learning with part-aware model for vehicle re-identification. Neurocomputing. 2021;48:55–62.

    Google Scholar 

  3. Liu H, Tian Y, Wang Y, Pang L, Huang T. Deep relative distance learning: Tell the difference between similar vehicles, in: 2016 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2016, Las Vegas, NV, USA, June 27-30, 2016, IEEE Computer Society, 2016, pp. 2167–2175. https://doi.org/10.1109/CVPR.2016.238.

  4. Li Y, Li Y, Yan H, Liu J. Deep joint discriminative learning for vehicle re-identification and retrieval, in: 2017 IEEE International Conference on Image Processing, ICIP 2017, Beijing, China, September 17-20, 2017, IEEE, 2017, pp. 395–399. https://doi.org/10.1109/ICIP.2017.8296310.

  5. Chu R, Sun Y, Li Y, Liu Z, Zhang C, Wei Y. Vehicle re-identification with viewpoint-aware metric learning, in: 2019 IEEE/CVF International Conference on Computer Vision, ICCV 2019, Seoul, Korea (South), October 27 - November 2, 2019, IEEE, 2019, pp. 8281–8290. https://doi.org/10.1109/ICCV.2019.00837.

  6. Porrello A, Bergamini L, Calderara S. Robust re-identification by multiple views knowledge distillation, in: A.Vedaldi, H.Bischof, T.Brox, J.Frahm (Eds.), Computer Vision - ECCV 2020 - 16th European Conference, Glasgow, UK, August 23-28, 2020, Proceedings, Part X, Vol. 12355 of Lecture Notes in Computer Science, Springer, 2020, pp. 93–110. https://doi.org/10.1007/978-3-030-58607-2_6.

  7. He B, Li J, Zhao Y, Tian Y. Part-regularized near-duplicate vehicle re-identification, in: IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2019, Long Beach, CA, USA, June 16-20, 2019, Computer Vision Foundation / IEEE, 2019, pp. 3997–4005. https://doi.org/10.1109/CVPR.2019.00412.

  8. Zhang X, Zhang R, Cao J, Gong D, You M, Shen C. Part-guided attention learning for vehicle re-identification, CoRR abs/1909.06023. http://arxiv.org/abs/1909.06023

  9. Khorramshahi P, Peri N, Chen J, Chellappa R. The devil is in the details: Self-supervised attention for vehicle re-identification, in: A.Vedaldi, H.Bischof, T.Brox, J.Frahm (Eds.), Computer Vision - ECCV 2020 - 16th European Conference, Glasgow, UK, August 23-28, 2020, Proceedings, Part XIV, Vol. 12359 of Lecture Notes in Computer Science, Springer, 2020, pp. 369–386. https://doi.org/10.1007/978-3-030-58568-6_22.

  10. Chen T, Liu C, Wu C, Chien S. Orientation-aware vehicle re-identification with semantics-guided part attention network, in: A.Vedaldi, H.Bischof, T.Brox, J.Frahm (Eds.), Computer Vision - ECCV 2020 - 16th European Conference, Glasgow, UK, August 23-28, 2020, Proceedings, Part II, Vol. 12347 of Lecture Notes in Computer Science, Springer, 2020, pp. 330–346. https://doi.org/10.1007/978-3-030-58536-5_20.

  11. Tumrani S, Deng Z, Lin H, Shao J. Partial attention and multi-attribute learning for vehicle re-identification. Pattern Recognit Lett. 2020;138:290–7. https://doi.org/10.1016/j.patrec.2020.07.034.

    Article  Google Scholar 

  12. Zhu J, Zeng H, Huang J, Liao S, Lei Z, Cai C, Zheng L. Vehicle re-identification using quadruple directional deep learning features. IEEE Trans Intell Transp Syst. 2019;21(1):410–20.

    Article  Google Scholar 

  13. Krizhevsky A, Sutskever I, Hinton GE. Imagenet classification with deep convolutional neural networks. In: Bartlett PL, Pereira FCN, Burges CJC, Bottou L, Weinberger KQ, editors. Advances in Neural Information Processing Systems 25: 26th Annual Conference on Neural Information Processing Systems 2012, vol. 2012. Nevada, United States: Lake Tahoe; 2012. p. 1106–14.

    Google Scholar 

  14. He K, Zhang X, Ren S, Sun J. Deep residual learning for image recognition, in: 2016 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2016, Las Vegas, NV, USA, June 27-30, 2016, IEEE Computer Society, 2016, pp. 770–778. https://doi.org/10.1109/CVPR.2016.90.

  15. Huang K, Hussain A, Wang Q-F, Zhang R. Deep learning: fundamentals, theory and applications, vol. 2. Springer; 2019.

    Book  Google Scholar 

  16. Liu Q, Li R, Hu H, Gu D. Indoor topological localization based on a novel deep learning technique. Cogn Comput. 2020;12:528–41.

    Article  Google Scholar 

  17. Wang X, Han X, Huang W, Dong D, Scott MR. Multi-similarity loss with general pair weighting for deep metric learning, in: IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2019, Long Beach, CA, USA, June 16-20, 2019, Computer Vision Foundation / IEEE, 2019, pp. 5022–5030. https://doi.org/10.1109/CVPR.2019.00516.

  18. Sun Z, Nie X, Xi X, Yin Y. Cfvmnet: A multi-branch network for vehicle re-identification based on common field of view, in: C.W. Chen, R.Cucchiara, X.Hua, G.Qi, E.Ricci, Z.Zhang, R.Zimmermann (Eds.), MM ’20: The 28th ACM International Conference on Multimedia, Virtual Event / Seattle, WA, USA, October 12-16, 2020, ACM, 2020, pp. 3523–3531. https://doi.org/10.1145/3394171.3413541.

  19. Qian J, Jiang W, Luo H, Yu H. Stripe-based and attribute-aware network: A two-branch deep model for vehicle re-identification, CoRR abs/1910.05549. arXiv:1910.05549.

  20. Liu X, Liu W, Zheng J, Yan C, Mei T. Beyond the parts: Learning multi-view cross-part correlation for vehicle re-identification, in: C.W. Chen, R.Cucchiara, X.Hua, G.Qi, E.Ricci, Z.Zhang, R.Zimmermann (Eds.), MM ’20: The 28th ACM International Conference on Multimedia, Virtual Event / Seattle, WA, USA, October 12-16, 2020, ACM, 2020, pp. 907–915. https://doi.org/10.1145/3394171.3413578.

  21. Zheng A, Dong J, Lin X, Liu L, Jiang B, Luo B. Visual cognition-inspired multi-view vehicle re-identification via laplacian-regularized correlative sparse ranking. Cogn Comput. 2021;13:859–72.

    Article  Google Scholar 

  22. Guo H, Zhu K, Tang M, Wang J. Two-level attention network with multi-grain ranking loss for vehicle re-identification. IEEE Trans Image Process. 2019;28(9):4328–38.

    Article  MathSciNet  MATH  Google Scholar 

  23. Lian J, Wang D, Zhu S, Wu Y, Li C. Transformer-based attention network for vehicle re-identification. Electronics. 2022;11(7):1016.

    Article  Google Scholar 

  24. Khorramshahi P, Kumar A, Peri N, Rambhatla SS, Chen J, Chellappa R. A dual-path model with adaptive attention for vehicle re-identification, in: 2019 IEEE/CVF International Conference on Computer Vision, ICCV 2019, Seoul, Korea (South), October 27 - November 2, 2019, IEEE, 2019, pp. 6131–6140. https://doi.org/10.1109/ICCV.2019.00623.

  25. Shen F, Zhu J, Zhu X, Xie Y, Huang J. Exploring spatial significance via hybrid pyramidal graph network for vehicle re-identification. IEEE Trans Intell Transp Syst. 2022;23(7):8793–804. https://doi.org/10.1109/TITS.2021.3086142.

    Article  Google Scholar 

  26. Jin X, Lan C, Zeng W, Chen Z. Uncertainty-aware multi-shot knowledge distillation for image-based object re-identification, in: The Thirty-Fourth AAAI Conference on Artificial Intelligence, AAAI 2020, The Thirty-Second Innovative Applications of Artificial Intelligence Conference, IAAI 2020, The Tenth AAAI Symposium on Educational Advances in Artificial Intelligence, EAAI 2020, New York, NY, USA, February 7-12, 2020, AAAI Press, 2020, pp. 11165–11172.

  27. Ning X, Gong K, Li W, Zhang L, Bai X, Tian S. Feature refinement and filter network for person re-identification. IEEE Trans Circuits Syst Video Technol. 2021;31(9):3391–402. https://doi.org/10.1109/TCSVT.2020.3043026.

    Article  Google Scholar 

  28. Meng D, Li L, Liu X, Li Y, Yang S, Zha Z, Gao X, Wang S, Huang Q. Parsing-based view-aware embedding network for vehicle re-identification, in: 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2020, Seattle, WA, USA, June 13-19, 2020, Computer Vision Foundation / IEEE, 2020, pp. 7101–7110. https://doi.org/10.1109/CVPR42600.2020.00713.

  29. Wang Z, Tang L, Liu X, Yao Z, Yi S, Shao J, Yan J, Wang S, Li H, Wang X. Orientation invariant feature embedding and spatial temporal regularization for vehicle re-identification, in: IEEE International Conference on Computer Vision, ICCV 2017, Venice, Italy, October 22-29, 2017, IEEE Computer Society, 2017, pp. 379–387. https://doi.org/10.1109/ICCV.2017.49.

  30. Peng J, Wang H, Zhao T, Fu X. Learning multi-region features for vehicle re-identification with context-based ranking method. Neurocomputing. 2019;359:427–37.

    Article  Google Scholar 

  31. Shen D, Zhao S, Hu J, Feng H, Cai D, He X. Es-net: Erasing salient parts to learn more in re-identification. IEEE Trans Image Process. 2020;30:1676–86.

    Article  Google Scholar 

  32. Kanacı A, Zhu X, Gong S. Vehicle reidentification by fine-grained cross-level deep learning, in: BMVC AMMDS Workshop, Vol.2, 2017, pp. 772–788.

  33. Alfasly SAS, Hu Y, Liang T, Jin X, Zhao Q, Liu B. Variational representation learning for vehicle re-identification, in: 2019 IEEE International Conference on Image Processing, ICIP 2019, Taipei, Taiwan, September 22-25, 2019, IEEE, 2019, pp. 3118–3122. https://doi.org/10.1109/ICIP.2019.8803366.

  34. Wang Q, Min W, Han Q, Yang Z, Xiong X, Zhu M, Zhao H. Viewpoint adaptation learning with cross-view distance metric for robust vehicle re-identification. Inform Sci. 2021;564:71–84.

    Article  MathSciNet  Google Scholar 

  35. Shen Y, Xiao T, Li H, Yi S, Wang X. Learning deep neural networks for vehicle re-id with visual-spatio-temporal path proposals, in: IEEE International Conference on Computer Vision, ICCV 2017, Venice, Italy, October 22-29, 2017, IEEE Computer Society, 2017, pp. 1918–1927. https://doi.org/10.1109/ICCV.2017.210.

  36. Jiang N, Xu Y, Zhou Z, Wu W. Multi-attribute driven vehicle re-identification with spatial-temporal re-ranking, in: 2018 IEEE International Conference on Image Processing, ICIP 2018, Athens, Greece, October 7-10, 2018, IEEE, 2018, pp. 858–862. https://doi.org/10.1109/ICIP.2018.8451776.

  37. Zheng Z, Zheng L, Yang Y. A discriminatively learned cnn embedding for person reidentification. ACM Trans Multimedia Comput Commun Appl. 2017;14(1):1551–6857. https://doi.org/10.1145/3159171.

    Article  Google Scholar 

  38. Deng J, Dong W, Socher R, Li L, Li K, Fei-Fei L. Imagenet: A large-scale hierarchical image database, in: 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2009), 20-25 June 2009, Miami, Florida, USA, IEEE Computer Society, 2009, pp. 248–255. https://doi.org/10.1109/CVPR.2009.5206848.

  39. Schroff F, Kalenichenko D, Philbin J. Facenet: A unified embedding for face recognition and clustering, in: IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2015, Boston, MA, USA, June 7-12, 2015, IEEE Computer Society, 2015, pp. 815–823. https://doi.org/10.1109/CVPR.2015.7298682.

  40. Kumar R, Weill E, Aghdasi F, Sriram P. Vehicle re-identification: an efficient baseline using triplet embedding, in: International Joint Conference on Neural Networks, IJCNN 2019 Budapest, Hungary, July 14-19, 2019, IEEE, 2019, pp. 1–9. https://doi.org/10.1109/IJCNN.2019.8852059.

  41. Liu X, Liu W, Mei T, Ma H. A deep learning-based approach to progressive vehicle re-identification for urban surveillance, in: B.Leibe, J.Matas, N.Sebe, M.Welling (Eds.), Computer Vision - ECCV 2016 - 14th European Conference, Amsterdam, The Netherlands, October 11-14, 2016, Proceedings, Part II, Vol. 9906 of Lecture Notes in Computer Science, Springer, 2016, pp. 869–884. https://doi.org/10.1007/978-3-319-46475-6_53.

  42. Zhang Y, Liu D, Zha Z. Improving triplet-wise training of convolutional neural network for vehicle re-identification, in: 2017 IEEE International Conference on Multimedia and Expo, ICME 2017, Hong Kong, China, July 10-14, 2017, IEEE Computer Society, 2017, pp. 1386–1391. https://doi.org/10.1109/ICME.2017.8019491.

  43. Sun Y, Wang X, Tang X. Deep learning face representation from predicting 10, 000 classes, in: 2014 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2014, Columbus, OH, USA, June 23-28, 2014, IEEE Computer Society, 2014, pp. 1891–1898. https://doi.org/10.1109/CVPR.2014.244.

  44. Liu X, Zhang S, Wang X, Hong R, Tian Q. Group-group loss-based global-regional feature learning for vehicle re-identification. IEEE Trans Image Process. 2019;29:2638–52.

    Article  MATH  Google Scholar 

  45. Bai Y, Lou Y, Gao F, Wang S, Wu Y, Duan L. Group-sensitive triplet embedding for vehicle reidentification. IEEE Trans Multimedia. 2018;20(9):2385–99. https://doi.org/10.1109/TMM.2018.2796240.

    Article  Google Scholar 

  46. Lin W, Li Y, Yang X, Peng P, Xing J. Multi-view learning for vehicle re-identification, in: IEEE International Conference on Multimedia and Expo, ICME 2019, Shanghai, China, July 8-12, 2019, IEEE, 2019, pp. 832–837. https://doi.org/10.1109/ICME.2019.00148.

  47. Ioffe S, Szegedy C. Batch normalization: Accelerating deep network training by reducing internal covariate shift, in: F.R. Bach, D.M. Blei (Eds.), Proceedings of the 32nd International Conference on Machine Learning, ICML 2015, Lille, France, 6-11 July 2015, Vol.37 of JMLR Workshop and Conference Proceedings, JMLR.org, 2015, pp. 448–456.

  48. Zhou K, Yang Y, Cavallaro A, Xiang T. Omni-scale feature learning for person re-identification, in: 2019 IEEE/CVF International Conference on Computer Vision, ICCV 2019, Seoul, Korea (South), October 27 - November 2, 2019, IEEE, 2019, pp. 3701–3711. https://doi.org/10.1109/ICCV.2019.00380.

  49. Sun Y, Zheng L, Yang Y, Tian Q, Wang S. Beyond part models: Person retrieval with refined part pooling (and A strong convolutional baseline), in: V.Ferrari, M.Hebert, C.Sminchisescu, Y.Weiss (Eds.), Computer Vision - ECCV 2018 - 15th European Conference, Munich, Germany, September 8-14, 2018, Proceedings, Part IV, Vol. 11208 of Lecture Notes in Computer Science, Springer, 2018, pp. 501–518. https://doi.org/10.1007/978-3-030-01225-0_30.

  50. Luo H, Gu Y, Liao X, Lai S, Jiang W. Bag of tricks and a strong baseline for deep person re-identification, in. IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW). 2019;2019:1487–95.

    Google Scholar 

  51. Lou Y, Bai Y, Liu J, Wang S, Duan L. Veri-wild: A large dataset and a new method for vehicle re-identification in the wild, in: IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2019, Long Beach, CA, USA, June 16-20, 2019, Computer Vision Foundation / IEEE, 2019, pp. 3235–3243. https://doi.org/10.1109/CVPR.2019.00335.

  52. Zhong Z, Zheng L, Kang G, Li S, Yang Y. Random erasing data augmentation, in: The Thirty-Fourth AAAI Conference on Artificial Intelligence, AAAI 2020, The Thirty-Second Innovative Applications of Artificial Intelligence Conference, IAAI 2020, The Tenth AAAI Symposium on Educational Advances in Artificial Intelligence, EAAI 2020, New York, NY, USA, February 7-12, 2020, AAAI Press, 2020, pp. 13001–13008.

  53. He L, Liao X, Liu W, Liu X, Cheng P, Mei T. Fastreid: A pytorch toolbox for general instance re-identification, arXiv preprint arXiv:2006.02631.

  54. Zhu X, Luo Z, Fu P, Ji X. Voc-reid: Vehicle re-identification based on vehicle-orientation-camera, CoRR abs/2004.09164. arXiv:2004.09164.

  55. Kingma DP, Ba J. Adam: A method for stochastic optimization, in: Y.Bengio, Y.LeCun (Eds.), 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, May 7-9, 2015, Conference Track Proceedings, 2015, pp. 1–15.

  56. Tian X, Pang X, Jiang G, Meng Q, Zheng Y. Vehicle re-identification based on global relational attention and multi-granularity feature learning. IEEE Access. 2022;10:17674–82. https://doi.org/10.1109/ACCESS.2022.3150411.

    Article  Google Scholar 

  57. Jiang G, Pang X, Tian X, Zheng Y, Meng Q. Global reference attention network for vehicle re-identification, Applied Intelligence (2022) 1–16.

  58. Zhang S, Lin C, Ma S. Large margin metric learning for multi-view vehicle re-identification. Neurocomputing. 2021;447:118–28. https://doi.org/10.1016/j.neucom.2021.02.095.

    Article  Google Scholar 

  59. Zhang C, Yang C, Wu D, Dong H, Deng B. Cross-view vehicle re-identification based on graph matching. Appl Intell. 2022;52(13):14799–810.

    Article  Google Scholar 

  60. Lu Z, Lin R, Lou X, Zheng L, Hu H. Identity-unrelated information decoupling model for vehicle re-identification. IEEE Trans Intell Transp Syst. 2022;23(10):19001–15.

    Article  Google Scholar 

Download references

Funding

This study was funded by Natural Science Foundation of China (No. 61773325), Industry-University Cooperation Project of Fujian Science and Technology Department (No. 2021H6035), Natural Science Foundation of Fujian Province (No. 2021J011191), the Science and Technology Planning Project of Fujian Province (No. 2020H0023, and No. 2020Y9064), and Lifelong Education Foundation Project of the Education Department of Fujian Province (No. ZS22056).

Author information

Author notes

  1. Wei Zhou and Jiawei Lian contributed equally to this work.

Authors and Affiliations

  1. Fujian Key Laboratory of Pattern Recognition and Image Understanding, School of Computer and Information Engineering, Xiamen University of Technology, Xiamen, Fujian, 361024, People’s Republic of China

    Wei Zhou, Jiawei Lian, Shunzhi Zhu, Yun Wu & Da-Han Wang

Authors
  1. Wei Zhou
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jiawei Lian
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Shunzhi Zhu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Yun Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Da-Han Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Da-Han Wang.

Ethics declarations

Ethical Approval

This article does not contain any studies with human participants or animals performed by any of the authors.

Conflict of Interest

The authors declare no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhou, W., Lian, J., Zhu, S. et al. Vehicle Re-Identification by Separating Representative Spatial Features. Cogn Comput 15, 1640–1655 (2023). https://doi.org/10.1007/s12559-023-10145-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12559-023-10145-4

Keywords

Search

Navigation