Skip to main content

Advertisement

Log in

PHQPL: producing high quality pseudo labels for unsupervised person Re-IDentification

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

Unsupervised person Re-IDentification (Re-ID) algorithms typically employ complex large models as feature extractors, but they are frequently constrained in the physical deployment environments with finite computility resources. To address this concern, this paper proposes a novel producing high quality pseudo labels (PHQPL) framework for simple small network with the aim of achieving rapid inference speed while maintaining superior precision in the unsupervised person Re-ID task. Specifically, the novel PHQPL framework is primarily comprised of pseudo labels recycling (PLR) and soft pseudo labels creation (SPLC) module. The PLR module is designed to preserve the pseudo labels derived from the complex large (teacher) network as high quality supervisory information to guide the performance optimization of simple small (student) network through online pseudo label knowledge distillation operations. This module reduces the difficulty of eliminating the adverse implications of noisy pseudo labels upon model training by transforming unsupervised person Re-ID task with an agnostic proportion of noisy labels learning into a certain proportion of learning. The SPLC module adequately exploits the prior knowledge of teacher network and leverages its output values to produce soft pseudo labels that contain more hierarchical information about different person categories as high quality supervisory information for student network. Sufficient experiments are conducted on three person and one vehicle Re-ID benchmark datasets so as to authenticate the effectiveness of the methodology in this paper. The experimental findings demonstrate that the PHQPL framework allows the behavior of student network to approach or even surpass that of teacher network, exhibiting competitive outcomes over state-of-the-art algorithms.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Algorithm 1
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

Data availability

No datasets were generated or analysed during the current study.

References

  1. Behera, N.K.S., Sa, P.K., Bakshi, S., Padhy, R.P.: Person re-identification: a taxonomic survey and the path ahead. Image Vis. Comput. 122, 104432 (2022)

    Article  MATH  Google Scholar 

  2. Ye, M., Shen, J., Lin, G., Xiang, T., Shao, L., Hoi, S.C.: Deep learning for person re-identification: a survey and outlook. IEEE Trans. Pattern Anal. Mach. Intell. 44(6), 2872–2893 (2021)

    Article  MATH  Google Scholar 

  3. Ding, Y., Mao, R., Du, G., Zhang, L.: Clothes-eraser: clothing-aware controllable disentanglement for clothes-changing person re-identification. Signal Image Video Process 18(5), 4337–4348 (2024)

    Article  MATH  Google Scholar 

  4. Pan, K., Zhao, Y., Wang, T., Yao, S.: MSNet: a lightweight multi-scale deep learning network for pedestrian re-identification. Signal Image Video Process. 17(6), 3091–3098 (2023)

    Article  MATH  Google Scholar 

  5. Duan, Q., Hu, Z., Lu, M., Tao, H.: Learning discriminative features for person re-identification via multi-spectral channel attention. Signal Image Video Process. 17(6), 3019–3026 (2023)

    Article  MATH  Google Scholar 

  6. Sun, Z., Wang, X., Zhang, Y., Song, Y., Zhao, J., Xu, J., Yan, W., Lv, C.: A comprehensive review of pedestrian re-identification based on deep learning. Complex Intell. Syst. 10(2), 1733–1768 (2024)

    Article  MATH  Google Scholar 

  7. Khan, F.M., Brémond, F.: Person re-identification for real-world surveillance systems. arXiv preprint arXiv:1607.05975 (2016)

  8. Gaikwad, B., Karmakar, A.: End-to-end person re-identification: real-time video surveillance over edge-cloud environment. Comput. Electr. Eng. 99, 107824 (2022)

    Article  MATH  Google Scholar 

  9. Wang, D., Zhang, S.: Unsupervised person re-identification via multi-label classification. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 10981–10990 (2020)

  10. Lin, Y., Dong, X., Zheng, L., Yan, Y., Yang, Y.: A bottom-up clustering approach to unsupervised person re-identification. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 33. pp. 8738–8745 (2019)

  11. Bak, S., Carr, P., Lalonde, J.-F.: Domain adaptation through synthesis for unsupervised person re-identification. In: Proceedings of the European Conference on Computer Vision (ECCV), pp. 189–205 (2018)

  12. Mekhazni, D., Bhuiyan, A., Ekladious, G., Granger, E.: Unsupervised domain adaptation in the dissimilarity space for person re-identification. In: Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part XXVII 16. Springer, pp. 159–174 (2020)

  13. He, S., Luo, H., Wang, P., Wang, F., Li, H., Jiang, W.: TransReID: transformer-based object re-identification. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 15013–15022 (2021)

  14. Yan, X., Ding, S., Zhou, W., Shi, W., Tian, H.: Unsupervised domain adaptive person re-identification method based on transformer. Electronics 11(19), 3082 (2022)

    Article  MATH  Google Scholar 

  15. Zhang, C., Liu, X., Xu, J., Chen, T., Li, G., Jiang, F., Li, X.: An edge based federated learning framework for person re-identification in UAV delivery service. In: 2021 IEEE International Conference on Web Services (ICWS). IEEE, pp. 500–505 (2021)

  16. Chen, X., Li, Z., Tang, C., Xiao, S., Chen, Y.: Person re-identification in the edge computing system: a deep square similarity learning approach. Concurr. Comput. Pract. Exp. 33(7), 1–1 (2021)

    Article  MATH  Google Scholar 

  17. Hinton, G., Vinyals, O., Dean, J.: Distilling the knowledge in a neural network. arXiv preprint arXiv:1503.02531 (2015)

  18. Dai, Z., Wang, G., Yuan, W., Zhu, S., Tan, P.: Cluster contrast for unsupervised person re-identification. In: Proceedings of the Asian Conference on Computer Vision, pp. 1142–1160 (2022)

  19. Liu, J., Zha, Z.-J., Chen, D., Hong, R., Wang, M.: Adaptive transfer network for cross-domain person re-identification. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 7202–7211 (2019)

  20. Zhang, S., Zeng, Y., Hu, H., Liu, S.: Noise resistible network for unsupervised domain adaptation on person re-identification. IEEE Access 9, 60740–60752 (2021)

    Article  Google Scholar 

  21. Zhang, S., Hu, H.: Unsupervised person re-identification using unified domanial learning. Neural Process. Lett. 55(6), 6887–6905 (2023)

    Article  MATH  Google Scholar 

  22. Wu, A., Zheng, W.-S., Lai, J.-H.: Distilled camera-aware self training for semi-supervised person re-identification. IEEE Access 7, 156752–156763 (2019)

    Article  MATH  Google Scholar 

  23. Mirzadeh, S.I., Farajtabar, M., Li, A., Levine, N., Matsukawa, A., Ghasemzadeh, H.: Improved knowledge distillation via teacher assistant. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 34. pp. 5191–5198 (2020)

  24. Luan, Y., Zhao, H., Yang, Z., Dai, Y.: MSD: multi-self-distillation learning via multi-classifiers within deep neural networks. arXiv preprint arXiv:1911.09418 (2019)

  25. Bhat, P., Arani, E., Zonooz, B.: Distill on the go: online knowledge distillation in self-supervised learning. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 2678–2687 (2021)

  26. Han, B., Yao, Q., Yu, X., Niu, G., Xu, M., Hu, W., Tsang, I., Sugiyama, M.: Co-teaching: robust training of deep neural networks with extremely noisy labels. In: Advances in Neural Information Processing Systems, vol. 31 (2018)

  27. Lu, Y., He, W.: SELC: self-ensemble label correction improves learning with noisy labels. arXiv preprint arXiv:2205.01156 (2022)

  28. Nguyen, D.T., Mummadi, C.K., Ngo, T.P.N., Nguyen, T.H.P., Beggel, L., Brox, T.: Self: learning to filter noisy labels with self-ensembling. arXiv preprint arXiv:1910.01842 (2019)

  29. He, K., Fan, H., Wu, Y., Xie, S., Girshick, R.: Momentum contrast for unsupervised visual representation learning. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 9729–9738 (2020)

  30. Kim, T., Oh, J., Kim, N., Cho, S., Yun, S.-Y.: Comparing Kullback–Leibler divergence and mean squared error loss in knowledge distillation. arXiv preprint arXiv:2105.08919 (2021)

  31. Johnson, D., Sinanovic, S.: Symmetrizing the Kullback–Leibler distance. IEEE Trans. Inf. Theory 1, 1–10 (2001)

    MATH  Google Scholar 

  32. Zheng, L., Shen, L., Tian, L., Wang, S., Wang, J., Tian, Q.: Scalable person re-identification: a benchmark. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 1116–1124 (2015)

  33. Zheng, Z., Zheng, L., Yang, Y.: Unlabeled samples generated by GAN improve the person re-identification baseline in vitro. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 3754–3762 (2017)

  34. Wei, L., Zhang, S., Gao, W., Tian, Q.: Person transfer GAN to bridge domain gap for person re-identification. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 79–88 (2018)

  35. Liu, X., Liu, W., Mei, T., Ma, H.: A deep learning-based approach to progressive vehicle re-identification for urban surveillance. In: Computer Vision–ECCV 2016: 14th European Conference, Amsterdam, The Netherlands, October 11-14, 2016, Proceedings, Part II 14. Springer, pp. 869–884 (2016)

  36. Cheng, D., Zhou, J., Wang, N., Gao, X.: Hybrid dynamic contrast and probability distillation for unsupervised person re-ID. IEEE Trans. Image Process. 31, 3334–3346 (2022)

    Article  MATH  Google Scholar 

  37. Wang, D., Zhang, S.: Unsupervised person re-identification via multi-label classification. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 10981–10990 (2020)

  38. Li, J., Zhang, S.: Joint visual and temporal consistency for unsupervised domain adaptive person re-identification. In: Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part XXIV 16. Springer, pp. 483–499 (2020)

  39. Jin, X., Lan, C., Zeng, W., Chen, Z.: Global distance-distributions separation for unsupervised person re-identification. In: Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part VII 16. Springer, pp. 735–751 (2020)

  40. Ge, Y., Zhu, F., Chen, D., Zhao, R.: Self-paced contrastive learning with hybrid memory for domain adaptive object re-ID. In: Advances in Neural Information Processing Systems, vol. 33. pp. 11309–11321 (2020)

  41. Chen, G., Lu, Y., Lu, J., Zhou, J.: Deep credible metric learning for unsupervised domain adaptation person re-identification. In: Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part VIII 16. Springer, pp. 643–659 (2020)

  42. Chen, H., Lagadec, B., Bremond, F.: Enhancing diversity in teacher-student networks via asymmetric branches for unsupervised person re-identification. In: Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, pp. 1–10 (2021)

  43. Lin, Y., Xie, L., Wu, Y., Yan, C., Tian, Q.: Unsupervised person re-identification via softened similarity learning. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 3390–3399 (2020)

  44. Xuan, S., Zhang, S.: Intra-inter camera similarity for unsupervised person re-identification. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 11926–11935 (2021)

  45. Cho, Y., Kim, W.J., Hong, S., Yoon, S.-E.: Part-based pseudo label refinement for unsupervised person re-identification. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 7308–7318 (2022)

  46. Lan, L., Teng, X., Zhang, J., Zhang, X., Tao, D.: Learning to purification for unsupervised person re-identification. IEEE Transactions on Image Processing (2023)

  47. Maaten, L., Hinton, G.: Visualizing data using t-SNE. J. Mach. Learn. Res. 9(11), 2579–2605 (2008)

    MATH  Google Scholar 

  48. Zhang, H., Cisse, M., Dauphin, Y.N., Lopez-Paz, D.: MixUp: beyond empirical risk minimization. arXiv preprint arXiv:1710.09412 (2017)

Download references

Author information

Authors and Affiliations

Authors

Contributions

Haiming Sun and Deshun Wang performed the design of the experimental methodology and the writing of the software program and the first draft. Shiwei Ma provided experimental supervision and leadership.

Corresponding author

Correspondence to Shiwei Ma.

Ethics declarations

Conflict of interest

There are no conflict of interest to declare.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Sun, H., Wang, D. & Ma, S. PHQPL: producing high quality pseudo labels for unsupervised person Re-IDentification. SIViP 19, 15 (2025). https://doi.org/10.1007/s11760-024-03684-2

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s11760-024-03684-2

Keywords

Navigation