Skip to main content
SpringerLink
Log in

Mutual purification for unsupervised domain adaptation in person re-identification

  • Original Article
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

Unsupervised domain adaptation person re-identification aims to adapt the model learned on a labeled source domain to an unlabeled target domain. It has attracted extensively attention in the computer vision community due to its important applications in security and surveillance. Existing approaches are primary to utilize pseudo labels assigned by clustering algorithm as supervision information on target domain. One of the most successful methods exploits neighbors of each unlabeled image to generate pseudo labels, in which contain noise and errors inevitably. In this paper, we propose a Mutual Purification Network (MP-Net) to alleviate errors of pseudo-labels and errors accumulation. MP-Net aims to utilize two independent pre-trained models to learn external auxiliary knowledge from each other, which consists of mutual purification neighbors-exploiting (MPNE) and mutual purification selection (MPS). MPNE focuses on using the common and unique knowledge of the two models to mine more robust neighbor relationships for alleviating the noise and errors from the normal neighbors exploiting. MPS aims to filter outliers and construct reliable triplets during training with triplet loss in unsupervised scenario. Each model selects more reliable and informative positives and negatives for peer models based on dynamic ranking and isolation computation. Extensive experiments on three large-scale public datasets, including Market-1501, DukeMTMC and MSMT17 illustrate that our MP-Net outperforms or shows comparable results to the state-of-the-art methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Wang Z, Hu R, Yu Y, Jiang J, Liang C, Wang J (2016) Scale-adaptive low-resolution person re-identification via learning a discriminating surface. IJCAI 2:6

    Google Scholar 

  2. Bedagkar-Gala A, Shah SK (2014) A survey of approaches and trends in person re-identification. Image Vis Comput 32(4):270–286

    Article  Google Scholar 

  3. Vezzani R, Baltieri D, Cucchiara R (2013) People reidentification in surveillance and forensics: a survey. ACM Comput Surv (CSUR) 46(2):1–37

    Article  Google Scholar 

  4. Deng W, Zheng L, Ye Q, Kang G, Yang Y, Jiao J (2018) Image-image domain adaptation with preserved self-similarity and domain-dissimilarity for person re-identification. In: Proceedings of the IEEE conference on computer vision and pattern recognition. pp 994–1003

  5. Zou Y, Yang X, Yu Z, Kumar BVK, Kautz J (2020) Joint disentangling and adaptation for cross-domain person re-identification. arXiv preprint arXiv:2007.10315

  6. Fu Y, Wei Y, Wang G, Zhou Y, Shi H, Huang TS (2019) Self-similarity grouping: a simple unsupervised cross domain adaptation approach for person re-identification. In: Proceedings of the IEEE international conference on computer Vision. pp 6112–6121

  7. Zhai Y, Lu S, Ye Q, Shan X, Chen J, Ji R, Tian Y (2020) Ad-cluster: augmented discriminative clustering for domain adaptive person re-identification. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. pp 9021–9030

  8. Zhu X, Li Y, Sun J, Chen H, Zhu J (2021) Learning with noisy labels method for unsupervised domain adaptive person re-identification. Neurocomputing 452:78–88

    Article  Google Scholar 

  9. Zhong Z, Zheng L, Li S, Yang Y (2018) Generalizing a person retrieval model hetero-and homogeneously. In: Proceedings of the european conference on computer vision (ECCV). pp 172–188

  10. Liu J, Zha ZJ, Chen D, Hong R, Wang M (2019) Adaptive transfer network for cross-domain person re-identification. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. pp 7202–7211

  11. Zhang Y, Xiang T, Hospedales TM, Lu H (2018) Deep mutual learning. In: Proceedings of the IEEE conference on computer vision and pattern recognition. pp 4320–4328

  12. Zhong Z, Zheng L, Cao D, Li S (2017) Re-ranking person re-identification with k-reciprocal encoding. In: Proceedings of the IEEE conference on computer vision and pattern recognition. pp 1318–1327

  13. Song L, Wang C, Zhang L, Du B, Zhang Q, Huang C, Wang X (2020) Unsupervised domain adaptive re-identification: theory and practice. Pattern Recogn 102:107173

    Article  Google Scholar 

  14. Zhang X, Cao J, Shen C, You M (2019) Self-training with progressive augmentation for unsupervised cross-domain person re-identification. In: Proceedings of the IEEE international conference on computer vision. pp 8222–8231

  15. Han B, Yao Q, Yu X, Niu G, Xu M, Hu W, Tsang I, Sugiyama M (2018) Co-teaching: robust training of deep neural networks with extremely noisy labels. Adv Neural Inf Process Syst 8527–8537

  16. Zhao F, Liao S, Xie GS, Zhao J, Zhang K, Shao L (2020) Unsupervised domain adaptation with noise resistible mutual-training for person re-identification. In: European conference on computer vision. Springer, pp 526–544

  17. Zheng L, Shen L, Tian L, Wang S, Wang J, Tian Q (2015) Scalable person re-identification: a benchmark. In: Proceedings of the IEEE international conference on computer vision. pp 1116–1124

  18. Ristani E, Solera F, Zou R, Cucchiara R, Tomasi C (2016) Performance measures and a data set for multi-target, multi-camera tracking. In: European conference on computer vision. Springer, pp 17–35

  19. Wei L, Zhang S, Gao W, Tian Q (2018) Person transfer gan to bridge domain gap for person re-identification. In: Proceedings of the IEEE conference on computer vision and pattern recognition. pp 79–88

  20. Fu D, Chen D, Bao J, Yang H, Yuan L, Zhang L, Li H, Chen D (2021) Unsupervised pre-training for person re-identification. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. pp 14750–14759

  21. Ning X, Gong K, Li W, Zhang L, Bai X, Tian S (2020) Feature refinement and filter network for person re-identification. IEEE Trans Circuits Syst Video Technol 31(9):3391–3402

    Article  Google Scholar 

  22. Yi D, Lei Z, Liao S, Li SZ (2014) Deep metric learning for person re-identification. In: 2014 22nd international conference on pattern recognition. IEEE, pp 34–39

  23. Li W, Zhao R, Xiao T, Wang X (2014) Deepreid: deep filter pairing neural network for person re-identification. In: Proceedings of the IEEE conference on computer vision and pattern recognition. pp 152–159

  24. Zheng L, Yang Y, Hauptmann AG (2016) Person re-identification: past, present and future. arXiv preprint arXiv:1610.02984

  25. Imani Z, Soltanizadeh H (2018) Histogram of the node strength and histogram of the edge weight: two new features for rgb-d person re-identification. Sci China Inf Sci 61(9):1–14

    Article  Google Scholar 

  26. Su C, Li J, Zhang S, Xing J, Gao W, Tian Q (2017) Pose-driven deep convolutional model for person re-identification. In: Proceedings of the IEEE international conference on computer vision. pp 3960–3969

  27. Yan C, Pang G, Bai X, Liu C, Xin N, Gu L, Zhou J (2021) Beyond triplet loss: person re-identification with fine-grained difference-aware pairwise loss. IEEE Trans Multimed

  28. Zhang L, Xiang T, Gong S (2016) Learning a discriminative null space for person re-identification. In: Proceedings of the IEEE conference on computer vision and pattern recognition. pp 1239–1248

  29. Yan Y, Ni B, Song Z, Ma C, Yan Y, Yang X (2016) Person re-identification via recurrent feature aggregation. In: European conference on computer vision. Springer, pp 701–716

  30. Zheng Z, Zheng L, Yang Y (2017) Unlabeled samples generated by gan improve the person re-identification baseline in vitro. In: Proceedings of the IEEE international conference on computer vision. pp 3754–3762

  31. Zheng Z, Zheng L, Yang Y (2017) A discriminatively learned cnn embedding for person reidentification. ACM Trans Multimed Comput Commun Appl (TOMM) 14(1):1–20

    Google Scholar 

  32. Varior RR, Shuai B, Lu J, Xu D, Wang G (2016) A siamese long short-term memory architecture for human re-identification. In: European conference on computer vision. Springer, pp 135–153

  33. Tzeng E, Hoffman J, Saenko K, Darrell T (2017) Adversarial discriminative domain adaptation. In: Proceedings of the IEEE conference on computer vision and pattern recognition. pp 7167–7176

  34. Huang H, Yang W, Chen X, Zhao X, Huang K, Lin J, Huang G, Du D (2018) Eanet: enhancing alignment for cross-domain person re-identification. arXiv preprint arXiv:1812.11369

  35. Song J, Yang Y, Song YZ, Xiang T, Hospedales TM (2019) Generalizable person re-identification by domain-invariant mapping network. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. pp 719–728

  36. Wang J, Zhu X, Gong S, Li W (2018) Transferable joint attribute-identity deep learning for unsupervised person re-identification. In: Proceedings of the IEEE conference on computer vision and pattern recognition. pp 2275–2284

  37. Li YJ, Lin CS, Lin YB, Wang YCF (2019) Cross-dataset person re-identification via unsupervised pose disentanglement and adaptation. In: Proceedings of the IEEE/CVF international conference on computer vision. pp 7919–7929

  38. Zhong Z, Zheng L, Luo Z, Li S, Yang Y (2019) Invariance matters: exemplar memory for domain adaptive person re-identification. In: Proceedings of the IEEE conference on computer vision and pattern recognition. pp 598–607

  39. Zhong Z, Zheng L, Luo Z, Li S, Yang Y (2020) Learning to adapt invariance in memory for person re-identification. IEEE Trans Pattern Anal Mach Intell

  40. Qi L, Wang L, Huo J, Zhou L, Shi Y, Gao Y (2019) A novel unsupervised camera-aware domain adaptation framework for person re-identification. In: Proceedings of the IEEE/CVF international conference on computer vision. pp 8080–8089

  41. Sun J, Li Y, Chen H, Peng Y, Zhu J (2021) Unsupervised cross domain person re-identification by multi-loss optimization learning. IEEE Trans Image Process 30:2935–2946

    Article  Google Scholar 

  42. Feng H, Chen M, Jinming H, Shen D, Liu H, Cai D (2021) Complementary pseudo labels for unsupervised domain adaptation on person re-identification. IEEE Trans Image Process 30:2898–2907

    Article  Google Scholar 

  43. Yu X, Han B, Yao J, Niu G, Tsang I, Sugiyama M (2019) How does disagreement help generalization against label corruption? In: International conference on machine learning. PMLR, pp 7164–7173

  44. Patrini G, Rozza A, Menon AK, Nock R, Qu L (2017) Making deep neural networks robust to label noise: a loss correction approach. In: Proceedings of the IEEE conference on computer vision and pattern recognition. pp 1944–1952

  45. Malach E, Shalev-Shwartz S (2017)Decoupling“when to update”from“how to update”. Adv Neural Inf Process Syst 30

  46. Wu Y, Lin Y, Dong X, Yan Y, Ouyang W, Yang Y (2018) Exploit the unknown gradually: one-shot video-based person re-identification by stepwise learning. In: Proceedings of the IEEE conference on computer vision and pattern recognition. pp 5177–5186

  47. Wu Y, Lin Y, Dong X, Yan Y, Bian W, Yang Y (2019) Progressive learning for person re-identification with one example. IEEE Trans Image Process 28(6):2872–2881

    Article  MathSciNet  Google Scholar 

  48. Ge Y, Chen D, Li H (2020) Mutual mean-teaching: pseudo label refinery for unsupervised domain adaptation on person re-identification. arXiv preprint arXiv:2001.01526

  49. Yang , Li K, Zhong Z, Luo Z, Sun X, Cheng H, Guo X, Huang F, Ji R, Li S (2020) Asymmetric co-teaching for unsupervised cross-domain person re-identification. In: Proceedings of the AAAI conference on artificial intelligence 34:12597–12604

  50. He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition. pp 770–778

  51. Lin Y, Xie L, Wu Y, Yan C, Tian Q (2016) Unsupervised person re-identification via softened similarity learning. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition pp 3390–3399

  52. Wang X, Doretto G, Sebastian T, Rittscher J, Tu P (2007) Shape and appearance context modeling. In: 2007 IEEE 11th international conference on computer vision. IEEE, pp 1–8

  53. Wang D, Zhang S (2020) Unsupervised person re-identification via multi-label classification. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. pp 10981–10990

  54. Zhang H, Cao H, Yang X, Deng C, Tao D (2021) Self-training with progressive representation enhancement for unsupervised cross-domain person re-identification. IEEE Trans Image Process

  55. Liu X, Zhang S (2020) Domain adaptive person re-identification via coupling optimization. In: Proceedings of the 28th ACM international conference on multimedia. pp 547–555

  56. Xuan S, Zhang S(2021) Intra-inter camera similarity for unsupervised person re-identification. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. pp 11926–11935

  57. Yang F, Zhong Z, Luo Z, Cai YZ, Lin Y, Li S, Sebe N (2021) Joint noise-tolerant learning and meta camera shift adaptation for unsupervised person re-identification. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. pp 4855–4864

  58. Ge Y, Zhu F, Chen D, Zhao R et al (2020) Self-paced contrastive learning with hybrid memory for domain adaptive object re-id. Adv Neural Inf Process Syst 33:11309–11321

    Google Scholar 

Download references

Acknowledgements

This work was supported by the National Natural Science Foundation of China under Grant Nos. 61872024 and the National Key R & D Program of China under Grant Nos. 2018YFB2100603. The authors would like to thank the anonymous reviewers for their critical and constructive comments and suggestions.

Author information

Authors and Affiliations

  1. State Key Laboratory of Virtual Reality Technology and Systems, School of Computer Science and Engineering, Beihang University, Beijing, 100191, China

    Lei Zhang, Qishuai Diao, Zhong Zhou & Wei Wu

  2. Information Engineering College, Capital Normal University, Beijing, 100089, China

    Na Jiang

Authors
  1. Lei Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Qishuai Diao
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Na Jiang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Zhong Zhou
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Wei Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Zhong Zhou.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhang, L., Diao, Q., Jiang, N. et al. Mutual purification for unsupervised domain adaptation in person re-identification. Neural Comput & Applic 34, 16929–16944 (2022). https://doi.org/10.1007/s00521-022-07340-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-022-07340-z

Keywords

Search

Navigation