Abstract
The current pedestrian reidentification method based on convolutional neural networks still cannot solve the problems of pedestrian posture change, occlusion and background clutter. Many people use local feature learning or global feature learning alone to alleviate this problem, but they ignore their relevance. Aiming at the difference in emphasis between local features and global features, we propose a unified fusion algorithm, which inherits their advantages while discarding their shortcomings. While random erasure is used to enhance the robustness of the network model, the combined optimization function is used to optimize features of different scales, and the features processed at different scales are merged and spliced to obtain the final representation. Finally, multiple optimization reordering strategies are used to improve the performance of the algorithm. The proposed fusion algorithm was tested on three public pedestrian reidentification datasets, which proved the effectiveness of the method.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Wu, S., et al.: An enhanced deep feature representation for person re-identification. In: 2016 IEEE Winter Conference on Applications of Computer Vision (WACV). IEEE (2016)
Ding, S., et al.: Deep feature learning with relative distance comparison for person re-identification. Pattern Recognit. 48(10), 2993–3003 (2015)
Lu, X., Yuan, Y., Zheng, X.: Joint dictionary learning for multispectral change detection. IEEE Trans. Cybern. 47(4), 884–897 (2016)
Zheng, L., et al.: Person re-identification in the wild. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2017)
Tao, D., et al.: Deep multi-view feature learning for person re-identification. IEEE Trans. Circuits Syst. Video Technol. 28(10), 2657–2666 (2017)
Kumar, V., et al.: Pose-aware person recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2017)
Su, C., et al.: Pose-driven deep convolutional model for person re-identification. In: Proceedings of the IEEE International Conference on Computer Vision (2017)
Suh, Y., et al.: Part-aligned bilinear representations for person re-identification. In: Proceedings of the European Conference on Computer Vision (ECCV) (2018)
Cheng, D., et al.: Person re-identification by multi-channel parts-based cnn with improved triplet loss function. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2016)
Sun, Y., et al.: Beyond part models: person retrieval with refined part pooling (and a strong convolutional baseline). In: Proceedings of the European Conference on Computer Vision (ECCV) (2018)
Xiao, T., et al.: Joint detection and identification feature learning for person search. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2017)
Ahmed, E., Jones, M., Marks T.K.: An improved deep learning architecture for person re-identification. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2015)
Dai, Z., et al.: Batch dropblock network for person re-identification and beyond. In: Proceedings of the IEEE/CVF International Conference on Computer Vision (2019)
Bai, S., Bai, X., Tian, Q. Scalable person re-identification on supervised smoothed manifold. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2017)
Zhong, Z., et al.: Re-ranking person re-identification with k-reciprocal encoding. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2017)
Zhong, Z., et al.: Random erasing data augmentation. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 34(07) (2020)
He, K., et al.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2016)
Zheng, L., et al.: Scalable person re-identification: a benchmark. In: Proceedings of the IEEE International Conference on Computer Vision (2015)
Li, W., et al.: Deepreid: deep filter pairing neural network for person re-identification. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2014)
Ristani, E., et al.: Performance measures and a data set for multi-target, multi-camera tracking. In: European Conference on Computer Vision. Springer, Cham (2016)
Lin, M., Chen, Q., Yan, S.: Network in network (2013). arXiv preprint https://arxiv.org/1312.4400
Zheng, Z., Zheng, L., Yang, Y.: Pedestrian alignment network for large-scale person re-identification. IEEE Trans. Circuits Syst. Video Technol. 29(10), 3037–3045 (2018)
Sun, Y., et al.: Svdnet for pedestrian retrieval. In: Proceedings of the IEEE International Conference on Computer Vision (2017)
Wang, Y., et al.: Resource aware person re-identification across multiple resolutions. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2018)
Li, W., Zhu, X., Gong, S.: Harmonious attention network for person re-identification. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2018)
Wang, G., et al.: Learning discriminative features with multiple granularities for person re-identification. In: Proceedings of the 26th ACM International Conference on Multimedia (2018)
Acknowledgements
This work is supported by the National Natural Science Foundation of China Project Nos. 61771386, 52075435 and Natural Science Foundation of Shaanxi Province No. 2021JM-340.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Liao, K., Huang, G., Zheng, Y. et al. Pedestrian reidentification based on multiscale convolution feature fusion. SIViP 16, 1691–1699 (2022). https://doi.org/10.1007/s11760-021-02125-8
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11760-021-02125-8