Abstract
Person Re-Identification (ReID) aims at retrieving images of the specific pedestrian across disjoint cameras. However, the annotations are extremely costly as the number of cameras increases, which derives a new setting named Intra-Camera Supervision (ICS) ReID. ICS assumes that identity labels are independently annotated within each camera, while no cross-camera identity association is available. Previous ICS methods focus on connecting the inter-camera instances that are likely to be the same pedestrian, whereas fails to exploit the so far untapped yet informative supervision, i.e., ‘the cross-camera prototype relations’. In this paper, we propose the novel Cross-Camera Prototype Learning (CCPL) method to tackle this issue. Firstly, we ensure identities to be discriminative and associated with corresponding intra-camera prototypes, which can be considered as the semantic representations for each local identity. Besides, we claim that the distance between the same inter-camera prototypes is inevitably large, due to the variances of different cameras in views, lights, backgrounds etc. To that end, we propose the Camera-invariant Prototype Alignment (CPA) module, which preserves the cross-camera prototype relations by explicitly pulling together the same inter-camera prototypes and pushing away the different ones. Last but not least, we also introduce the inter-camera prototype pulling loss to constrain the same prototypes as close as possible. Extensive experiments on three benchmarks show the superiority of our method.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., Fei-Fei, L.: Imagenet: a large-scale hierarchical image database. In: CVPR (2009)
Ge, Y., Li, Z., Zhao, H., Yin, G., Yi, S., Wang, X., et al.: FD-GAN: pose-guided feature distilling GAN for robust person re-identification. In: Advances in Neural Information Processing Systems, vol. 31 (2018)
Hao, X., Zhang, W., Wu, D., Zhu, F., Li, B.: Dual alignment unsupervised domain adaptation for video-text retrieval. In: CVPR (2023)
He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: CVPR (2016)
Li, M., Zhu, X., Gong, S.: Unsupervised person re-identification by deep learning tracklet association. In: ECCV (2018)
Li, M., Zhu, X., Gong, S.: Unsupervised tracklet person re-identification. IEEE Trans. Pattern Anal. Mach. Intell. 42(7), 1770–1782 (2019)
Li, W., Zhu, X., Gong, S.: Harmonious attention network for person re-identification. In: CVPR (2018)
Li, Y., He, J., Zhang, T., Liu, X., Zhang, Y., Wu, F.: Diverse part discovery: occluded person re-identification with part-aware transformer. In: CVPR (2021)
Lin, Y., Xie, L., Wu, Y., Yan, C., Tian, Q.: Unsupervised person re-identification via softened similarity learning. In: CVPR (2020)
Luo, H., Gu, Y., Liao, X., Lai, S., Jiang, W.: Bag of tricks and a strong baseline for deep person re-identification. In: CVPRws (2019)
Van der Maaten, L., Hinton, G.: Visualizing data using t-SNE. J. Mach. Learn. Res. 9(11) (2008)
Peng, Y.X., Jiao, J., Feng, X., Zheng, W.S.: Consistent discrepancy learning for intra-camera supervised person re-identification. IEEE Trans. Multimedia (2022)
Qi, L., Wang, L., Huo, J., Shi, Y., Gao, Y.: Progressive cross-camera soft-label learning for semi-supervised person re-identification. IEEE Trans. Circuits Syst. Video Technol. 30(9), 2815–2829 (2020)
Qi, L., Wang, L., Huo, J., Shi, Y., Geng, X., Gao, Y.: Adversarial camera alignment network for unsupervised cross-camera person re-identification. IEEE Trans. Circuits Syst. Video Technol. 32(5), 2921–2936 (2021)
Ristani, E., Solera, F., Zou, R., Cucchiara, R., Tomasi, C.: Performance measures and a data set for multi-target, multi-camera tracking. In: ECCVws (2016)
Sun, Y., Zheng, L., Yang, Y., Tian, Q., Wang, S.: Beyond part models: person retrieval with refined part pooling (and a strong convolutional baseline). In: ECCV (2018)
Wang, L., Zhang, W., Wu, D., Hong, P., Li, B.: Prototype-based inter-camera learning for person re-identification. In: ICASSP (2022)
Wang, L., Zhang, W., Wu, D., Zhu, F., Li, B.: Attack is the best defense: towards preemptive-protection person re-identification. In: ACM MM (2022)
Wang, M., Lai, B., Chen, H., Huang, J., Gong, X., Hua, X.S.: Towards precise intra-camera supervised person re-identification. In: WACV (2021)
Wang, M., Lai, B., Huang, J., Gong, X., Hua, X.S.: Camera-aware proxies for unsupervised person re-identification. In: AAAI (2021)
Wei, L., Zhang, S., Gao, W., Tian, Q.: Person transfer GAN to bridge domain gap for person re-identification. In: CVPR (2018)
Wu, J., Yang, Y., Liu, H., Liao, S., Lei, Z., Li, S.Z.: Unsupervised graph association for person re-identification. In: ICCV (2019)
Xuan, S., Zhang, S.: Intra-inter camera similarity for unsupervised person re-identification. In: CVPR (2021)
Zeng, K., Ning, M., Wang, Y., Guo, Y.: Hierarchical clustering with hard-batch triplet loss for person re-identification. In: CVPR (2020)
Zhang, X., Ge, Y., Qiao, Y., Li, H.: Refining pseudo labels with clustering consensus over generations for unsupervised object re-identification. In: CVPR (2021)
Zheng, L., Shen, L., Tian, L., Wang, S., Wang, J., Tian, Q.: Scalable person re-identification: a benchmark. In: ICCV (2015)
Zheng, Z., Yang, X., Yu, Z., Zheng, L., Yang, Y., Kautz, J.: Joint discriminative and generative learning for person re-identification. In: CVPR (2019)
Zhou, K., Yang, Y., Cavallaro, A., Xiang, T.: Omni-scale feature learning for person re-identification. In: ICCV (2019)
Zhu, X., Zhu, X., Li, M., Morerio, P., Murino, V., Gong, S.: Intra-camera supervised person re-identification. Int. J. Comput. Vision 129, 1580–1595 (2021)
Zhu, X., Zhu, X., Li, M., Murino, V., Gong, S.: Intra-camera supervised person re-identification: a new benchmark. In: ICCVws (2019)
Acknowledgement
This work was supported by the National Key R &D Program of China under Grant 2022YFB3103500, the National Natural Science Foundation of China under Grants 62106258, 62006242 and 62202459, and the China Postdoctoral Science Foundation under Grant 2022M713348 and 2022TQ0363, and Young Elite Scientists Sponsorship Program by BAST (No. BYESS2023304).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Duan, B., Zhang, W., Wu, D., Wang, L., Li, B., Wang, W. (2023). Cross-Camera Prototype Learning for Intra-camera Supervised Person Re-identification. In: Iliadis, L., Papaleonidas, A., Angelov, P., Jayne, C. (eds) Artificial Neural Networks and Machine Learning – ICANN 2023. ICANN 2023. Lecture Notes in Computer Science, vol 14260. Springer, Cham. https://doi.org/10.1007/978-3-031-44195-0_33
Download citation
DOI: https://doi.org/10.1007/978-3-031-44195-0_33
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-44194-3
Online ISBN: 978-3-031-44195-0
eBook Packages: Computer ScienceComputer Science (R0)