Skip to main content
SpringerLink
Log in

Person re-identification based on metric learning: a survey

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Person re-identification is a challenging research issue in computer vision and has a broad application prospect in intelligent security. In recent years, with the emergence of large-scale person datasets and the rapid development of deep learning, many outstanding results have been achieved in person re-identification researches, which mainly involves two critical technologies: feature extraction and distance metric. Among them, feature extraction has been well summarized in the current literature of person re-identification, but there is no systematic analysis of the distance metric method in the current review literature. However, effective and reliable distance metric is crucial to improve the accuracy of person re-identification. Therefore, it is necessary to systematically review and summarize the metric learning methods in person re-identification, so as to provide some references for the researchers of metric learning. In this paper, we make a comprehensive analysis of metric learning methods in the past five years, which can be summarized into three aspects: distance metric method, metric learning algorithm, and re-ranking for the metric results. Then, we compare the performance of some representative metric learning methods and discuss them in-depth. Finally, we make a prospect for the future research direction of metric learning in person re-identification.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

References

  1. Ali, TMF, Chaudhuri S. (2018) Maximum margin metric learning over discriminative nullspace for person re-identification. In Proceedings of the European Conference on Computer Vision (ECCV). : 122–138.

  2. An L, Chen X, Yang S (2016) Person re-identification via hypergraph-based matching. Neurocomputing 182:247–254

    Article  Google Scholar 

  3. Arindam S, Dibyadip C, Arpan B, et al. (2020) Open-set metric learning for erson re-identification in the wild. In Proceedings of the IEEE International Conference on Image Processing (ICIP), 2356–2360. https://doi.org/10.1109/ICIP40778.2020.9190744.

  4. Barman A, Shah SK (2017) Distance aggregation based score fusion for improving person re-identification. In 2017 IEEE International Symposium on Technologies for Homeland Security (HST). IEEE, 2017: 1–8.

  5. Barman A, Shah S K (2017) Shape: A novel graph theoretic algorithm for making consensus-based decisions in person re-identification systems. In Proceedings of the IEEE International Conference on Computer Vision. : 1115–1124.

  6. Bedagkar-Gala A, Shah SK (2014) A survey of approaches and trends in person re-identification. Image Vis Comput 32(4):270–286

    Article  Google Scholar 

  7. Bing C, Yufei Z, Yunqiang L et al (2018) Shift-variant similarity learning for person re-identification. J Electron Inf Technol 40(10):2381–2387

    Google Scholar 

  8. Borgia A, Hua Y, Kodirov E, Robertson NM (2018) Cross-view discriminative feature learning for person re-identification. IEEE Trans Image Process 27(11):5338–5349

    Article  MathSciNet  Google Scholar 

  9. Cai Y, Pietikäinen M (2010) Person re-identification based on global Y. Cai, M. Pietikäinen, Person re-identification based on global color context, The Tenth International Workshop on Visual Surveillance (in conjunction with ACCV 2010), pp. 205–215.

  10. Chen YC, Zheng WS, Lai JH et al (2016) An asymmetric distance model for cross-view feature mapping in person reidentification. IEEE transactions on circuits and systems for video technology 27(8):1661–1675

    Article  Google Scholar 

  11. Chen SZ, Guo CC, Lai JH (2016) Deep ranking for person re-identification via joint representation learning. IEEE Trans Image Process 25(5):2353–2367

    Article  MathSciNet  MATH  Google Scholar 

  12. Chen D, Xu D, Li H et al (2018) Group consistent similarity learning via deep crf for person re-identification. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition:8649–8658

  13. Cheng D, Gong Y, Shi W, Zhang S (2018) Person re-identification by the asymmetric triplet and identification loss function. Multimed Tools Appl 77(3):3533–3550

    Article  Google Scholar 

  14. Cho YJ, Yoon KJ (2018) Pamm: pose-aware multi-shot matching for improving person re-identification. IEEE Trans Image Process 27(8):3739–3752

    Article  MathSciNet  MATH  Google Scholar 

  15. Davis J V, Kulis B, Jain P, et al. (2007) Information-theoretic metric learning. In Proceedings of the 24th international conference on Machine learning. ACM, 209–216.

  16. De Maesschalck R, Jouan-Rimbaud D, Massart DL (2000) The mahalanobis distance. Chemom Intell Lab Syst 50(1):1–18

    Article  Google Scholar 

  17. Dikmen M, Akbas E, Huang TS et al (2010) Pedestrian recognition with a learned metric. In Asian conference on Computer vision. Springer, Berlin, Heidelberg, pp 501–512

    Google Scholar 

  18. Dong H, Gong S, Liu C, Ji Y, Zhong S (2017) Large margin relative distance learning for person re-identification. IET Comput Vis 11(6):455–462

    Article  Google Scholar 

  19. Dong H, Lu P, Liu C et al (2018) Learning multiple kernel metrics for iterative person re-identification. ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM) 14(3):78–78

    Google Scholar 

  20. Feng Z, Lai J, Xie X (2018) Learning view-specific deep networks for person re-identification. IEEE Trans Image Process 27(7):3472–3483

    Article  MathSciNet  MATH  Google Scholar 

  21. Feng Y, Yuan Y, Lu X (2019) Person Reidentification via Unsupervised Cross-View Metric Learning. In: Person Reidentification via unsupervised cross-view metric learning. IEEE transactions on cybernetics

    Google Scholar 

  22. García J, Martinel N, Gardel A, Bravo I, Foresti GL, Micheloni C (2017) Discriminant context information analysis for post-ranking person re-identification. IEEE Trans Image Process 26(4):1650–1665

    Article  MathSciNet  MATH  Google Scholar 

  23. Gheissari N, Sebastian T B, Hartley R (2006) Person reidentification using spatiotemporal appearance. In: Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. New York, USA: IEEE, 1528–1535.

  24. Hadsell R, Chopra S, LeCun Y (2006) Dimensionality reduction by learning an invariant mapping. In 2006 IEEE computer society conference on computer vision and pattern recognition (CVPR'06) IEEE 2:1735–1742

    Article  Google Scholar 

  25. He B, Yu S (2017) Ring-push metric learning for person reidentification. Journal of Electronic Imaging 26(3):033005

    Article  Google Scholar 

  26. He Z, Zhang Z, Jung C (2018) Deep feature embedding learning for person re-identification using lifted structured loss. In 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 2018: 1957–1961.

  27. Hou R, Ma B, Chang H, et al. (2020) IAUnet: Global context-aware feature learning for person reidentification. IEEE Transactions on Neural Networks and Learning Systems,, https://doi.org/10.1109/TNNLS.2020.3017939

  28. Joachims T (2002) Optimizing search engines using click through data. In Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining. ACM,: 133–142.

  29. Junior JCSJ, Baró X, Escalera S (2018) Exploiting feature representations through similarity learning, post-ranking and ranking aggregation for person re-identification. Image Vis Comput 79:76–85

    Article  Google Scholar 

  30. Koestinger M, Hirzer M, Wohlhart P, et al. (2012) Large scale metric learning from equivalence constraints. In 2012 IEEE conference on computer vision and pattern recognition. IEEE, 2288–2295.

  31. Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. Adv Neural Inf Proces Syst:1097–1105

  32. Krizhevsky A, Sutskever I, Hinton G E (2012) Imagenet classification with deep convolutional neural networks. In Advances in neural information processing systems. 1097–1105.

  33. Leng Q (2018) Co-metric learning for person re-identification. Advances in Multimedia 2018:1–9

    Article  Google Scholar 

  34. Leng Q, Hu R, Liang C, Wang Y, Chen J (2015) Person re-identification with content and context re-ranking. Multimed Tools Appl 74(17):6989–7014

    Article  Google Scholar 

  35. Li W, Zhao R, Wang X (2012) Human reidentification with transferred metric learning. In Asian conference on computer vision. Springer, Berlin, Heidelberg, pp 31–44

    Google Scholar 

  36. Li W, Wu Y, Mukunoki M, Kuang Y, Minoh M (2015) Locality based discriminative measure for multiple-shot human re-identification. Neurocomputing 167:280–289

    Article  Google Scholar 

  37. Li K, Ding Z, Li K, et al. (2018) Support neighbor loss for person re-identification. In 2018 ACM Multimedia Conference on Multimedia Conference. ACM, 2018: 1492–1500.

  38. Liao S, Li S Z (2015) Efficient psd constrained asymmetric metric learning for person re-identification. In Proceedings of the IEEE International Conference on Computer Vision. 3685–3693.

  39. Liao S, Hu Y, Zhu X et al (2015) Person re-identification by local maximal occurrence representation and metric learning. In Proceedings of the IEEE conference on computer vision and pattern recognition:2197–2206

  40. Ling H, Wang Z, Li P, Shi Y, Chen J, Zou F (2019) Improving person re-identification by multi-task learning. Neurocomputing 347:109–118

    Article  Google Scholar 

  41. Liu Z, Lu H, Ruan X, Yang MH (2019) Person Reidentification by joint local distance metric and feature transformation. IEEE transactions on neural networks and learning systems 30(10):2999–3009

    Article  Google Scholar 

  42. Luo Hao, Jiang Wei, Fan Xing, et.al. A survey on deep learning based person re-identification. Acta Automat Sin, 2019,45(11): 2032–2049.

  43. Ma AJ, Li J, Yuen PC et al (2015) Cross-domain person reidentification using domain adaptation ranking svms. IEEE Trans Image Process 24(5):1599–1613

    Article  MathSciNet  MATH  Google Scholar 

  44. McLaughlin N, del Rincon JM, Miller PC (2016) Person reidentification using deep convnets with multitask learning. IEEE Transactions on Circuits and Systems for Video Technology 27(3):525–539

    Article  Google Scholar 

  45. Olszewska JI (2016) Automated face recognition: challenges and solutions. Pattern Recognition Analysis and Applications

    Google Scholar 

  46. Pang Y, Cao J, Wang J, Han J (2019) JCS-net: joint classification and super-resolution network for small-scale pedestrian detection in surveillance images. IEEE Transactions on Information Forensics and Security 14(12):3322–3331

    Article  Google Scholar 

  47. Pedagadi S, Orwell J, Velastin S et al (2013) Local fisher discriminant analysis for pedestrian re-identification. In Proceedings of the IEEE conference on computer vision and pattern recognition:3318–3325

  48. Porikli F (2003) Inter-camera color calibration by correlation model function. In: Proceedings of the 2003 International Conference on Image Processing. Barcelona, Spain: IEEE, II-133-6.

  49. Qi Meibin, Wang Yunxia, Tan Shengshun, et.al. Person re-identification based on regularization of independent measure matrix. Pattern Recognition and Artificial Intelligence, 2016, 29( 6): 511–518.

  50. Qi Mei-Bin, Tan Sheng-Shun, Wang Yun-Xia, et.al. Multi-feature subspace and kernel learning for person re-identification. Acta Automat Sin, 2016, 42(2):299–308.

  51. Saquib Sarfraz M, Schumann A, Eberle A et al (2018) A pose-sensitive embedding for person re-identification with expanded cross neighborhood re-ranking. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition:420–429

  52. Schroff F, Kalenichenko D, Philbin J (2015) Facenet: a unified embedding for face recognition and clustering. In Proceedings of the IEEE conference on computer vision and pattern recognition:815–823

  53. Sikdar A, Chowdhury AS (2020) Scale-invariant batch-adaptive residual learning for person re-identification. Pattern Recogn Lett 129:279–286

    Article  Google Scholar 

  54. Syed M A, Jiao J (2016) Multi-kernel metric learning for person re-identification. In 2016 IEEE International Conference on Image Processing (ICIP). IEEE, 2016: 784–788.

  55. Syed MA, Han Z, Li Z et al (2018) Impostor resilient multimodal metric learning for person Reidentification. Advances in Multimedia:2018.1–2018.201811

  56. Tan S, Zheng F, Liu L et al (2016) Dense invariant feature-based support vector ranking for cross-camera person Reidentification. IEEE Transactions on Circuits and Systems for Video Technology 28(2):356–363

    Article  Google Scholar 

  57. Tan F, Liu W, Huang L, Zhai C, Shi W, Li Y (2017) Person re-identification across multiple non-overlapping cameras by grouping similarity comparison model. Chin J Electron 26(5):905–911

    Article  Google Scholar 

  58. Tao DP, Jin LW, Wang YF et al (2013) Person re-identification by regularized smoothing KISS metric learning. IEEE Trans on Circuits and Systems for Video Technology 23(10):1675–1685

    Article  Google Scholar 

  59. Wang X, Zheng WS, Li X et al (2015) Cross-scenario transfer person reidentification. IEEE Transactions on Circuits and Systems for Video Technology 26(8):1447–1460

    Article  Google Scholar 

  60. Wang J, Wang Z, Gao C et al (2016) Deeplist: learning deep features with adaptive listwise constraint for person reidentification. IEEE Transactions on Circuits and Systems for Video Technology 27(3):513–524

    Article  MathSciNet  Google Scholar 

  61. Wang J, Wang Z, Liang C, Gao C, Sang N (2018) Equidistance constrained metric learning for person re-identification. Pattern Recogn 74:38–51

    Article  Google Scholar 

  62. Wang J, Zhou S, Wang J, Hou Q (2018) Deep ranking model by large adaptive margin learning for person re-identification. Pattern Recogn 74:241–252

    Article  Google Scholar 

  63. Weinberger K Q, Saul LK (2008) Fast solvers and efficient implementations for distance metric learning. In Proceedings of the 25th international conference on Machine learning. ACM, 2008: 1160–1167.

  64. Weinberger KQ, Saul LK (2009) Distance metric learning for large margin nearest neighbor classification. J Mach Learn Res 10(Feb):207–244

    MATH  Google Scholar 

  65. Xiaokai L (2016) Pedestrian re-identification via coarse-to-fine ranking. IET Comput Vis 10(5):368–375

    Article  Google Scholar 

  66. Xie Y, Levine MD, Yu H (2016) Person re-identification by graph-based metric fusion. Electron Lett 52(17):1447–1449

    Article  Google Scholar 

  67. Xie Y, Yu H, Gong X, Levine MD (2017) Adaptive metric learning and probe-specific reranking for person reidentification. IEEE Signal Processing Letters 24(6):853–857

    Article  Google Scholar 

  68. Yang X, Zhou P, Wang M (2018) Person reidentification via structural deep metric learning. IEEE Transactions on Neural Networks and Learning Systems 30(10):2987–2998

    Article  Google Scholar 

  69. Yang H, Cheng Z, Chen L (2018) Reranking optimization for person re-identification under temporal-spatial information and common network consistency constraints. Pattern Recogn Lett:1–10

  70. Ye M, Liang C, Yu Y, Wang Z, Leng Q, Xiao C, Chen J, Hu R (2016) Person reidentification via ranking aggregation of similarity pulling and dissimilarity pushing. IEEE Transactions on Multimedia 18(12):2553–2566

    Article  Google Scholar 

  71. You-Jiao L, Li Z, Jing Z et al (2018) A survey of person re-identification. Acta Automat Sin 44(9):1554–1568

    Google Scholar 

  72. Yu B, Xu N (2018) Deep triplet-group network by exploiting symmetric and asymmetric information for person reidentification. Journal of Electronic Imaging 27(3):033033

    Article  Google Scholar 

  73. Yu H X, Wu A, Zheng W S. (2017) Cross-view asymmetric metric learning for unsupervised person re-identification. In Proceedings of the IEEE International Conference on Computer Vision. 994–1002.

  74. Yuan C, Guo J, Feng P, Zhao Z, Luo Y, Xu C, Wang T, Duan K (2019) Learning deep embedding with mini-cluster loss for person re-identification. Multimed Tools Appl 78(15):21145–21166

    Article  Google Scholar 

  75. Yu-Ning D, Hai-Zhou A (2016) Learning quadratic similarity function for pedestrian re-identification. Chinese Journal of Computers 39(8):1639–1651

    MathSciNet  Google Scholar 

  76. Zhang Z, Huang M (2017) Discriminative structural metric learning for person Reidentification in visual internet of things. IEEE Internet Things J 5(5):3361–3368

    Article  Google Scholar 

  77. Zhang Z, Saligrama V (2016) Prism: person reidentification via structured matching. IEEE Transactions on Circuits and Systems for Video Technology 27(3):499–512

    Article  Google Scholar 

  78. Zhao X, Wang N, Zhang Y, du S, Gao Y, Sun J (2017) Beyond pairwise matching: person reidentification via high-order relevance learning. IEEE transactions on neural networks and learning systems 29(8):3701–3714

    Article  Google Scholar 

  79. Zhao C, Wang X, Zuo W et al (2020) Similarity learning with joint transfer constraints for person re-identification. Pattern Recogn 97(107014):1–10

    Google Scholar 

  80. Zheng W S, Gong S, Xiang T (2011) Person re-identification by probabilistic relative distance comparison. In 2011 IEEE conference on computer vision and pattern recognition. IEEE, 2011: 649–656.

  81. Zheng WS, Gong S, Xiang T (2012) Reidentification by relative distance comparison. IEEE Trans Pattern Anal Mach Intell 35(3):653–668

    Article  Google Scholar 

  82. Zheng WS, Gong S, Xiang T (2015) Towards open-world person re-identification by one-shot group-based verification. IEEE Trans Pattern Anal Mach Intell 38(3):591–606

    Article  Google Scholar 

  83. Zhou Q, Zheng S, Yang H, et al. (2016) Joint instance and feature importance re-weighting for person re-identification. In 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 2016: 1546–1550.

  84. Zhou S, Wang J, Shi R et al (2017) Large margin learning in set-to-set similarity comparison for person reidentification. IEEE Transactions on Multimedia 20(3):593–604

    Google Scholar 

  85. Zhou J, Su B, Wu Y (2018) Easy identification from better constraints: multi-shot person re-identification from reference constraints. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition:5373–5381

  86. Zhou Z, Liu K, Huang J et al (2019) Improved metric learning algorithm for person re-identification based on equidistance. J Electron Inf Technol 41(2):477–483

    Google Scholar 

  87. Zhu J, Zeng H, Liao S et al (2017) Deep hybrid similarity learning for person re-identification. IEEE Transactions on Circuits and Systems for Video Technology 28(11):3183–3193

    Article  Google Scholar 

  88. Zhu F, Kong X, Wu Q, Fu H, Li M (2018) A loss combination based deep model for person re-identification. Multimed Tools Appl 77(3):3049–3069

    Article  Google Scholar 

  89. Zongyuan D, Wang H, Fuhua C et al (2017) Person re-identification based on distance centralization and projection vectors learning. Journal of Computer Research and Development 54(8):1785–1794

    Google Scholar 

Download references

Acknowledgements

This work was funded by the Visiting Project Funds of Shandong University of Technology, the Integration Funds of Shandong University of Technology and Zhangdian District (No.118228), the National Natural Science Foundation of China (No. 61601266, No.61801272), the Natural Science Foundation of Shandong Province of China (No. ZR2015FL029, ZR2016FL14).

Author information

Authors and Affiliations

  1. School of Electrical and Electronic Engineering, Shandong University of Technology, Zibo, 255049, China

    Guofeng Zou, Guixia Fu, Yue Liu & Mingliang Gao

  2. School of Engineering, University of British Columbia, Okanagan, Kelowna, BC, V1V 1V7, Canada

    Xiang Peng & Zheng Liu

Authors
  1. Guofeng Zou
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Guixia Fu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Xiang Peng
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Yue Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Mingliang Gao
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Zheng Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Guofeng Zou.

Ethics declarations

Conflict of interest

The authors declare no conflict of interest.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zou, G., Fu, G., Peng, X. et al. Person re-identification based on metric learning: a survey. Multimed Tools Appl 80, 26855–26888 (2021). https://doi.org/10.1007/s11042-021-10953-6

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-021-10953-6

Keywords

Search

Navigation