Abstract
Unsupervised person Re-IDentification (Re-ID) algorithms typically employ complex large models as feature extractors, but they are frequently constrained in the physical deployment environments with finite computility resources. To address this concern, this paper proposes a novel producing high quality pseudo labels (PHQPL) framework for simple small network with the aim of achieving rapid inference speed while maintaining superior precision in the unsupervised person Re-ID task. Specifically, the novel PHQPL framework is primarily comprised of pseudo labels recycling (PLR) and soft pseudo labels creation (SPLC) module. The PLR module is designed to preserve the pseudo labels derived from the complex large (teacher) network as high quality supervisory information to guide the performance optimization of simple small (student) network through online pseudo label knowledge distillation operations. This module reduces the difficulty of eliminating the adverse implications of noisy pseudo labels upon model training by transforming unsupervised person Re-ID task with an agnostic proportion of noisy labels learning into a certain proportion of learning. The SPLC module adequately exploits the prior knowledge of teacher network and leverages its output values to produce soft pseudo labels that contain more hierarchical information about different person categories as high quality supervisory information for student network. Sufficient experiments are conducted on three person and one vehicle Re-ID benchmark datasets so as to authenticate the effectiveness of the methodology in this paper. The experimental findings demonstrate that the PHQPL framework allows the behavior of student network to approach or even surpass that of teacher network, exhibiting competitive outcomes over state-of-the-art algorithms.
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs11760-024-03684-2/MediaObjects/11760_2024_3684_Fig1_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs11760-024-03684-2/MediaObjects/11760_2024_3684_Fig2_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs11760-024-03684-2/MediaObjects/11760_2024_3684_Fig3_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs11760-024-03684-2/MediaObjects/11760_2024_3684_Figa_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs11760-024-03684-2/MediaObjects/11760_2024_3684_Fig4_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs11760-024-03684-2/MediaObjects/11760_2024_3684_Fig5_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs11760-024-03684-2/MediaObjects/11760_2024_3684_Fig6_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs11760-024-03684-2/MediaObjects/11760_2024_3684_Fig7_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs11760-024-03684-2/MediaObjects/11760_2024_3684_Fig8_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs11760-024-03684-2/MediaObjects/11760_2024_3684_Fig9_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs11760-024-03684-2/MediaObjects/11760_2024_3684_Fig10_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs11760-024-03684-2/MediaObjects/11760_2024_3684_Fig11_HTML.png)
Similar content being viewed by others
Data availability
No datasets were generated or analysed during the current study.
References
Behera, N.K.S., Sa, P.K., Bakshi, S., Padhy, R.P.: Person re-identification: a taxonomic survey and the path ahead. Image Vis. Comput. 122, 104432 (2022)
Ye, M., Shen, J., Lin, G., Xiang, T., Shao, L., Hoi, S.C.: Deep learning for person re-identification: a survey and outlook. IEEE Trans. Pattern Anal. Mach. Intell. 44(6), 2872–2893 (2021)
Ding, Y., Mao, R., Du, G., Zhang, L.: Clothes-eraser: clothing-aware controllable disentanglement for clothes-changing person re-identification. Signal Image Video Process 18(5), 4337–4348 (2024)
Pan, K., Zhao, Y., Wang, T., Yao, S.: MSNet: a lightweight multi-scale deep learning network for pedestrian re-identification. Signal Image Video Process. 17(6), 3091–3098 (2023)
Duan, Q., Hu, Z., Lu, M., Tao, H.: Learning discriminative features for person re-identification via multi-spectral channel attention. Signal Image Video Process. 17(6), 3019–3026 (2023)
Sun, Z., Wang, X., Zhang, Y., Song, Y., Zhao, J., Xu, J., Yan, W., Lv, C.: A comprehensive review of pedestrian re-identification based on deep learning. Complex Intell. Syst. 10(2), 1733–1768 (2024)
Khan, F.M., Brémond, F.: Person re-identification for real-world surveillance systems. arXiv preprint arXiv:1607.05975 (2016)
Gaikwad, B., Karmakar, A.: End-to-end person re-identification: real-time video surveillance over edge-cloud environment. Comput. Electr. Eng. 99, 107824 (2022)
Wang, D., Zhang, S.: Unsupervised person re-identification via multi-label classification. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 10981–10990 (2020)
Lin, Y., Dong, X., Zheng, L., Yan, Y., Yang, Y.: A bottom-up clustering approach to unsupervised person re-identification. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 33. pp. 8738–8745 (2019)
Bak, S., Carr, P., Lalonde, J.-F.: Domain adaptation through synthesis for unsupervised person re-identification. In: Proceedings of the European Conference on Computer Vision (ECCV), pp. 189–205 (2018)
Mekhazni, D., Bhuiyan, A., Ekladious, G., Granger, E.: Unsupervised domain adaptation in the dissimilarity space for person re-identification. In: Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part XXVII 16. Springer, pp. 159–174 (2020)
He, S., Luo, H., Wang, P., Wang, F., Li, H., Jiang, W.: TransReID: transformer-based object re-identification. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 15013–15022 (2021)
Yan, X., Ding, S., Zhou, W., Shi, W., Tian, H.: Unsupervised domain adaptive person re-identification method based on transformer. Electronics 11(19), 3082 (2022)
Zhang, C., Liu, X., Xu, J., Chen, T., Li, G., Jiang, F., Li, X.: An edge based federated learning framework for person re-identification in UAV delivery service. In: 2021 IEEE International Conference on Web Services (ICWS). IEEE, pp. 500–505 (2021)
Chen, X., Li, Z., Tang, C., Xiao, S., Chen, Y.: Person re-identification in the edge computing system: a deep square similarity learning approach. Concurr. Comput. Pract. Exp. 33(7), 1–1 (2021)
Hinton, G., Vinyals, O., Dean, J.: Distilling the knowledge in a neural network. arXiv preprint arXiv:1503.02531 (2015)
Dai, Z., Wang, G., Yuan, W., Zhu, S., Tan, P.: Cluster contrast for unsupervised person re-identification. In: Proceedings of the Asian Conference on Computer Vision, pp. 1142–1160 (2022)
Liu, J., Zha, Z.-J., Chen, D., Hong, R., Wang, M.: Adaptive transfer network for cross-domain person re-identification. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 7202–7211 (2019)
Zhang, S., Zeng, Y., Hu, H., Liu, S.: Noise resistible network for unsupervised domain adaptation on person re-identification. IEEE Access 9, 60740–60752 (2021)
Zhang, S., Hu, H.: Unsupervised person re-identification using unified domanial learning. Neural Process. Lett. 55(6), 6887–6905 (2023)
Wu, A., Zheng, W.-S., Lai, J.-H.: Distilled camera-aware self training for semi-supervised person re-identification. IEEE Access 7, 156752–156763 (2019)
Mirzadeh, S.I., Farajtabar, M., Li, A., Levine, N., Matsukawa, A., Ghasemzadeh, H.: Improved knowledge distillation via teacher assistant. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 34. pp. 5191–5198 (2020)
Luan, Y., Zhao, H., Yang, Z., Dai, Y.: MSD: multi-self-distillation learning via multi-classifiers within deep neural networks. arXiv preprint arXiv:1911.09418 (2019)
Bhat, P., Arani, E., Zonooz, B.: Distill on the go: online knowledge distillation in self-supervised learning. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 2678–2687 (2021)
Han, B., Yao, Q., Yu, X., Niu, G., Xu, M., Hu, W., Tsang, I., Sugiyama, M.: Co-teaching: robust training of deep neural networks with extremely noisy labels. In: Advances in Neural Information Processing Systems, vol. 31 (2018)
Lu, Y., He, W.: SELC: self-ensemble label correction improves learning with noisy labels. arXiv preprint arXiv:2205.01156 (2022)
Nguyen, D.T., Mummadi, C.K., Ngo, T.P.N., Nguyen, T.H.P., Beggel, L., Brox, T.: Self: learning to filter noisy labels with self-ensembling. arXiv preprint arXiv:1910.01842 (2019)
He, K., Fan, H., Wu, Y., Xie, S., Girshick, R.: Momentum contrast for unsupervised visual representation learning. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 9729–9738 (2020)
Kim, T., Oh, J., Kim, N., Cho, S., Yun, S.-Y.: Comparing Kullback–Leibler divergence and mean squared error loss in knowledge distillation. arXiv preprint arXiv:2105.08919 (2021)
Johnson, D., Sinanovic, S.: Symmetrizing the Kullback–Leibler distance. IEEE Trans. Inf. Theory 1, 1–10 (2001)
Zheng, L., Shen, L., Tian, L., Wang, S., Wang, J., Tian, Q.: Scalable person re-identification: a benchmark. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 1116–1124 (2015)
Zheng, Z., Zheng, L., Yang, Y.: Unlabeled samples generated by GAN improve the person re-identification baseline in vitro. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 3754–3762 (2017)
Wei, L., Zhang, S., Gao, W., Tian, Q.: Person transfer GAN to bridge domain gap for person re-identification. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 79–88 (2018)
Liu, X., Liu, W., Mei, T., Ma, H.: A deep learning-based approach to progressive vehicle re-identification for urban surveillance. In: Computer Vision–ECCV 2016: 14th European Conference, Amsterdam, The Netherlands, October 11-14, 2016, Proceedings, Part II 14. Springer, pp. 869–884 (2016)
Cheng, D., Zhou, J., Wang, N., Gao, X.: Hybrid dynamic contrast and probability distillation for unsupervised person re-ID. IEEE Trans. Image Process. 31, 3334–3346 (2022)
Wang, D., Zhang, S.: Unsupervised person re-identification via multi-label classification. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 10981–10990 (2020)
Li, J., Zhang, S.: Joint visual and temporal consistency for unsupervised domain adaptive person re-identification. In: Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part XXIV 16. Springer, pp. 483–499 (2020)
Jin, X., Lan, C., Zeng, W., Chen, Z.: Global distance-distributions separation for unsupervised person re-identification. In: Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part VII 16. Springer, pp. 735–751 (2020)
Ge, Y., Zhu, F., Chen, D., Zhao, R.: Self-paced contrastive learning with hybrid memory for domain adaptive object re-ID. In: Advances in Neural Information Processing Systems, vol. 33. pp. 11309–11321 (2020)
Chen, G., Lu, Y., Lu, J., Zhou, J.: Deep credible metric learning for unsupervised domain adaptation person re-identification. In: Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part VIII 16. Springer, pp. 643–659 (2020)
Chen, H., Lagadec, B., Bremond, F.: Enhancing diversity in teacher-student networks via asymmetric branches for unsupervised person re-identification. In: Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, pp. 1–10 (2021)
Lin, Y., Xie, L., Wu, Y., Yan, C., Tian, Q.: Unsupervised person re-identification via softened similarity learning. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 3390–3399 (2020)
Xuan, S., Zhang, S.: Intra-inter camera similarity for unsupervised person re-identification. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 11926–11935 (2021)
Cho, Y., Kim, W.J., Hong, S., Yoon, S.-E.: Part-based pseudo label refinement for unsupervised person re-identification. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 7308–7318 (2022)
Lan, L., Teng, X., Zhang, J., Zhang, X., Tao, D.: Learning to purification for unsupervised person re-identification. IEEE Transactions on Image Processing (2023)
Maaten, L., Hinton, G.: Visualizing data using t-SNE. J. Mach. Learn. Res. 9(11), 2579–2605 (2008)
Zhang, H., Cisse, M., Dauphin, Y.N., Lopez-Paz, D.: MixUp: beyond empirical risk minimization. arXiv preprint arXiv:1710.09412 (2017)
Author information
Authors and Affiliations
Contributions
Haiming Sun and Deshun Wang performed the design of the experimental methodology and the writing of the software program and the first draft. Shiwei Ma provided experimental supervision and leadership.
Corresponding author
Ethics declarations
Conflict of interest
There are no conflict of interest to declare.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Sun, H., Wang, D. & Ma, S. PHQPL: producing high quality pseudo labels for unsupervised person Re-IDentification. SIViP 19, 15 (2025). https://doi.org/10.1007/s11760-024-03684-2
Received:
Revised:
Accepted:
Published:
DOI: https://doi.org/10.1007/s11760-024-03684-2