Skip to main content

Cross-Camera Prototype Learning for Intra-camera Supervised Person Re-identification

  • Conference paper
  • First Online:
Artificial Neural Networks and Machine Learning – ICANN 2023 (ICANN 2023)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 14260))

Included in the following conference series:

  • 1005 Accesses

Abstract

Person Re-Identification (ReID) aims at retrieving images of the specific pedestrian across disjoint cameras. However, the annotations are extremely costly as the number of cameras increases, which derives a new setting named Intra-Camera Supervision (ICS) ReID. ICS assumes that identity labels are independently annotated within each camera, while no cross-camera identity association is available. Previous ICS methods focus on connecting the inter-camera instances that are likely to be the same pedestrian, whereas fails to exploit the so far untapped yet informative supervision, i.e., ‘the cross-camera prototype relations’. In this paper, we propose the novel Cross-Camera Prototype Learning (CCPL) method to tackle this issue. Firstly, we ensure identities to be discriminative and associated with corresponding intra-camera prototypes, which can be considered as the semantic representations for each local identity. Besides, we claim that the distance between the same inter-camera prototypes is inevitably large, due to the variances of different cameras in views, lights, backgrounds etc. To that end, we propose the Camera-invariant Prototype Alignment (CPA) module, which preserves the cross-camera prototype relations by explicitly pulling together the same inter-camera prototypes and pushing away the different ones. Last but not least, we also introduce the inter-camera prototype pulling loss to constrain the same prototypes as close as possible. Extensive experiments on three benchmarks show the superiority of our method.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 69.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 89.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., Fei-Fei, L.: Imagenet: a large-scale hierarchical image database. In: CVPR (2009)

    Google Scholar 

  2. Ge, Y., Li, Z., Zhao, H., Yin, G., Yi, S., Wang, X., et al.: FD-GAN: pose-guided feature distilling GAN for robust person re-identification. In: Advances in Neural Information Processing Systems, vol. 31 (2018)

    Google Scholar 

  3. Hao, X., Zhang, W., Wu, D., Zhu, F., Li, B.: Dual alignment unsupervised domain adaptation for video-text retrieval. In: CVPR (2023)

    Google Scholar 

  4. He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: CVPR (2016)

    Google Scholar 

  5. Li, M., Zhu, X., Gong, S.: Unsupervised person re-identification by deep learning tracklet association. In: ECCV (2018)

    Google Scholar 

  6. Li, M., Zhu, X., Gong, S.: Unsupervised tracklet person re-identification. IEEE Trans. Pattern Anal. Mach. Intell. 42(7), 1770–1782 (2019)

    Article  Google Scholar 

  7. Li, W., Zhu, X., Gong, S.: Harmonious attention network for person re-identification. In: CVPR (2018)

    Google Scholar 

  8. Li, Y., He, J., Zhang, T., Liu, X., Zhang, Y., Wu, F.: Diverse part discovery: occluded person re-identification with part-aware transformer. In: CVPR (2021)

    Google Scholar 

  9. Lin, Y., Xie, L., Wu, Y., Yan, C., Tian, Q.: Unsupervised person re-identification via softened similarity learning. In: CVPR (2020)

    Google Scholar 

  10. Luo, H., Gu, Y., Liao, X., Lai, S., Jiang, W.: Bag of tricks and a strong baseline for deep person re-identification. In: CVPRws (2019)

    Google Scholar 

  11. Van der Maaten, L., Hinton, G.: Visualizing data using t-SNE. J. Mach. Learn. Res. 9(11) (2008)

    Google Scholar 

  12. Peng, Y.X., Jiao, J., Feng, X., Zheng, W.S.: Consistent discrepancy learning for intra-camera supervised person re-identification. IEEE Trans. Multimedia (2022)

    Google Scholar 

  13. Qi, L., Wang, L., Huo, J., Shi, Y., Gao, Y.: Progressive cross-camera soft-label learning for semi-supervised person re-identification. IEEE Trans. Circuits Syst. Video Technol. 30(9), 2815–2829 (2020)

    Article  Google Scholar 

  14. Qi, L., Wang, L., Huo, J., Shi, Y., Geng, X., Gao, Y.: Adversarial camera alignment network for unsupervised cross-camera person re-identification. IEEE Trans. Circuits Syst. Video Technol. 32(5), 2921–2936 (2021)

    Article  Google Scholar 

  15. Ristani, E., Solera, F., Zou, R., Cucchiara, R., Tomasi, C.: Performance measures and a data set for multi-target, multi-camera tracking. In: ECCVws (2016)

    Google Scholar 

  16. Sun, Y., Zheng, L., Yang, Y., Tian, Q., Wang, S.: Beyond part models: person retrieval with refined part pooling (and a strong convolutional baseline). In: ECCV (2018)

    Google Scholar 

  17. Wang, L., Zhang, W., Wu, D., Hong, P., Li, B.: Prototype-based inter-camera learning for person re-identification. In: ICASSP (2022)

    Google Scholar 

  18. Wang, L., Zhang, W., Wu, D., Zhu, F., Li, B.: Attack is the best defense: towards preemptive-protection person re-identification. In: ACM MM (2022)

    Google Scholar 

  19. Wang, M., Lai, B., Chen, H., Huang, J., Gong, X., Hua, X.S.: Towards precise intra-camera supervised person re-identification. In: WACV (2021)

    Google Scholar 

  20. Wang, M., Lai, B., Huang, J., Gong, X., Hua, X.S.: Camera-aware proxies for unsupervised person re-identification. In: AAAI (2021)

    Google Scholar 

  21. Wei, L., Zhang, S., Gao, W., Tian, Q.: Person transfer GAN to bridge domain gap for person re-identification. In: CVPR (2018)

    Google Scholar 

  22. Wu, J., Yang, Y., Liu, H., Liao, S., Lei, Z., Li, S.Z.: Unsupervised graph association for person re-identification. In: ICCV (2019)

    Google Scholar 

  23. Xuan, S., Zhang, S.: Intra-inter camera similarity for unsupervised person re-identification. In: CVPR (2021)

    Google Scholar 

  24. Zeng, K., Ning, M., Wang, Y., Guo, Y.: Hierarchical clustering with hard-batch triplet loss for person re-identification. In: CVPR (2020)

    Google Scholar 

  25. Zhang, X., Ge, Y., Qiao, Y., Li, H.: Refining pseudo labels with clustering consensus over generations for unsupervised object re-identification. In: CVPR (2021)

    Google Scholar 

  26. Zheng, L., Shen, L., Tian, L., Wang, S., Wang, J., Tian, Q.: Scalable person re-identification: a benchmark. In: ICCV (2015)

    Google Scholar 

  27. Zheng, Z., Yang, X., Yu, Z., Zheng, L., Yang, Y., Kautz, J.: Joint discriminative and generative learning for person re-identification. In: CVPR (2019)

    Google Scholar 

  28. Zhou, K., Yang, Y., Cavallaro, A., Xiang, T.: Omni-scale feature learning for person re-identification. In: ICCV (2019)

    Google Scholar 

  29. Zhu, X., Zhu, X., Li, M., Morerio, P., Murino, V., Gong, S.: Intra-camera supervised person re-identification. Int. J. Comput. Vision 129, 1580–1595 (2021)

    Article  Google Scholar 

  30. Zhu, X., Zhu, X., Li, M., Murino, V., Gong, S.: Intra-camera supervised person re-identification: a new benchmark. In: ICCVws (2019)

    Google Scholar 

Download references

Acknowledgement

This work was supported by the National Key R &D Program of China under Grant 2022YFB3103500, the National Natural Science Foundation of China under Grants 62106258, 62006242 and 62202459, and the China Postdoctoral Science Foundation under Grant 2022M713348 and 2022TQ0363, and Young Elite Scientists Sponsorship Program by BAST (No. BYESS2023304).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Wanqian Zhang .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Duan, B., Zhang, W., Wu, D., Wang, L., Li, B., Wang, W. (2023). Cross-Camera Prototype Learning for Intra-camera Supervised Person Re-identification. In: Iliadis, L., Papaleonidas, A., Angelov, P., Jayne, C. (eds) Artificial Neural Networks and Machine Learning – ICANN 2023. ICANN 2023. Lecture Notes in Computer Science, vol 14260. Springer, Cham. https://doi.org/10.1007/978-3-031-44195-0_33

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-44195-0_33

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-44194-3

  • Online ISBN: 978-3-031-44195-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics