Abstract
Person re-identification plays important roles in many practical applications. Due to various human poses, complex backgrounds and similarity of person clothes, person re-identification is still a challenging task. In this paper, we mainly focus on the robust and discriminative appearance feature representation and proposed a novel multi-appearance method for person re-identification. First, we proposed a deep feature fusion method and get the multi-appearance feature by combining two Convolutional Neural Networks. Then, in order to further enhance the representation of the appearance feature, the multi-part model was constructed by combining the whole body and the six body parts. Additionally, we optimized the feature extraction process by adding a pooling layer. Comprehensive and comparative experiments with the state-of-the-art methods over publicly available datasets demonstrated that the proposed method can get promising results.
Similar content being viewed by others
References
Chen Y, Zhao C, Wang X, Gao C (2016), Robust color invariant model for person re-identification, in Biometric Recognition, pp. 695–702
Chen W, Chen X, Zhang J, Huang K 2017 Beyond triplet loss: a deep quadruplet network for person re-identification, in IEEE Conference on Computer Vision and Pattern Recognition, pp. 1320–1329
Cheng D, Gong Y, Zhou S, Wang J, Zheng N (2016) Person Re-identification by multi-channel parts-based CNN with improved triplet loss function, in 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016, pp. 1335–1344, https://doi.org/10.1109/CVPR.2016.149
Gong A, Qiu Q, Sapiro G (2018) Virtual CNN branching: efficient feature ensemble for person re-identification, arXiv:1803.05872 [cs]
He K, Zhang X, Ren S, Sun J (2016) Deep Residual Learning for Image Recognition, in 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Los Alamitos, CA, USA, pp. 770–778, https://doi.org/10.1109/CVPR.2016.90
Huang H et al (2018) EANet: enhancing alignment for cross-domain person re-identification, arXiv:1812.11369 [cs]
Kuo C, Khamis S, Shet V (2013) Person re-identification using semantic color names and RankBoost, in 2013 IEEE Workshop on Applications of Computer Vision (WACV), pp. 281–287, https://doi.org/10.1109/WACV.2013.6475030
Layne R, Hospedales T, Gong S (2012) Person re-identification by attributes, Procedings of the British Machine Vision Conference 2012, pp. 24.1–24.11, https://doi.org/10.5244/C.26.24
Lee C-Y, Gallagher P, Tu Z (2018) Generalizing pooling functions in CNNs: mixed, gated, and tree. IEEE Trans Pattern Anal Mach Intell 40(4):863–875. https://doi.org/10.1109/TPAMI.2017.2703082
Li W, Zhao R, Wang X (2012) Human reidentification with transferred metric learning, in Computer Vision – ACCV 2012, pp. 31–44, https://doi.org/10.1007/978-3-642-37331-2_3
Li A, Liu L, Yan S (2014) Person re-identification by attribute-assisted clothes appearance. In: Gong S, Cristani M, Yan S, Loy CC (eds) Person re-identification. Springer, London, pp 119–138
Lin Y, Zheng L, Zheng Z, Wu Y, Hu Z, Yan C, Yang Y (2019) Improving person re-identification by attribute and identity learning. Pattern Recognition, pp 151–161
Lisanti G, Masi I, Bagdanov AD, Bimbo AD (2015) Person re-identification by iterative re-weighted sparse ranking. IEEE Trans Pattern Anal Mach Intel 37(8):1629–1642. https://doi.org/10.1109/TPAMI.2014.2369055
Liu C, Gong S, Loy CC (2014) On-the-fly feature importance mining for person re-identification. Pattern Recogn 47(4):1602–1615. https://doi.org/10.1016/j.patcog.2013.11.001
Ma B, Su Y, Jurie F (2014) Discriminative image descriptors for person re-identification. In: Gong S, Cristani M, Yan S, Loy CC (eds) Person re-identification. Springer London, London, pp 23–42
Mirmahboub B et al (2016) Person re-identification using sparse representation with manifold constraints, in 2016 IEEE International Conference on Image Processing (ICIP), pp. 774–778, https://doi.org/10.1109/ICIP.2016.7532462
Paisitkriangkrai S, Shen C, A. van den Hengel (2015) Learning to rank in person re-identification with metric ensembles, in 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1846–1855, https://doi.org/10.1109/CVPR.2015.7298794
Ren C-X, Xu X-L, Lei Z (2019) A deep and structured metric learning method for robust person re-identification. Pattern Recogn 96:106995. https://doi.org/10.1016/j.patcog.2019.106995
Ristani E, Solera F, Zou RS, Cucchiara R, Tomasi C, (2016) Performance measures and a data set for multi-target, multi-camera tracking, arXiv:1609.01775 [cs]
Simonyan K Zisserman A (2014) Very deep convolutional networks for large-scale image recognition, arXiv:1409.1556 [cs]
Sun Y, Zheng L, Yang Y, Tian Q, Wang S (2018), Beyond part models: person retrieval with refined part pooling (and a strong convolutional baseline), in Computer Vision – ECCV 2018, pp. 501–518
Wang T, Gong S, Zhu X, Wang S (2014) Person re-identification by video ranking, in Computer Vision – ECCV 2014, pp. 688–703
Wang Z, Hu R, Liang C, Leng Q, Sun K (2014) Region-based interactive ranking optimization for person re-identification, in Advances in Multimedia Information Processing – PCM 2014, pp. 1–10, https://doi.org/10.1007/978-3-319-13168-9_1
Wang F, Zuo W, Lin L, Zhang D, Zhang L (2016) Joint learning of single-image and cross-image representations for person re-identification, in 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1288–1296, https://doi.org/10.1109/CVPR.2016.144
Wang D, Yan C, Shan S, Chen X (2016) Unsupervised person re-identification with locality-constrained Earth Mover’s distance, in 2016 IEEE International Conference on Image Processing (ICIP), pp. 4289–4293, https://doi.org/10.1109/ICIP.2016.7533169
Wu Y, Lin Y, Dong X, Yan Y, Bian W, Yang Y (Jun. 2019) Progressive learning for person re-identification with one example. IEEE Trans Image Process 28(6):2872–2881. https://doi.org/10.1109/TIP.2019.2891895
Xiao T, Li S, Wang B, Lin L, Wang X (2016) Joint detection and identification feature learning for person search, arXiv:1604.01850 [cs]
Yang Y, Yang J, Yan J, Liao S, Yi D, Li SZ (2014) Salient color names for person re-identification, in Computer Vision – ECCV, pp. 536–551
Yang H, Wang X, Ma W, Su H, Zhu J (2015) Multiple scaled person re-identification framework for HD Video surveillance application, in Computer Vision, pp. 219–228
Yi D, Lei Z, Liao S, Li SZ, (2014) Deep metric learning for person re-identification, in 2014 22nd International Conference on Pattern Recognition, pp. 34–39, https://doi.org/10.1109/ICPR.2014.16
Yu H, Wu A, Zheng W (2020) Unsupervised person re-identification by deep asymmetric metric embedding. IEEE Transactions on Pattern Analysis and Machine Intelligence 42(4):956–973
Zhao R, Ouyang W, Wang X, (2013) “Unsupervised Salience Learning for Person Re-identification,” in Proceedings of the 2013 IEEE Conference on Computer Vision and Pattern Recognition, Washington, DC, USA, pp. 3586–3593, https://doi.org/10.1109/CVPR.2013.460
Zhao R, Ouyang W, Wang X (2013) Person Re-identification by Salience Matching, in 2013 IEEE International Conference on Computer Vision, pp. 2528–2535, https://doi.org/10.1109/ICCV.2013.314
Zhao H et al (2017) Spindle net: person re-identification with human body region guided feature decomposition and fusion, in IEEE Conference on Computer Vision and Pattern Recognition, pp. 907–915
Zheng W, Gong S, Xiang T (2011) Person re-identification by probabilistic relative distance comparison, in CVPR 2011, pp. 649–656, https://doi.org/10.1109/CVPR.2011.5995598
Zheng Z, Zheng L, Yang Y (2017) Unlabeled samples generated by GAN improve the person re-identification baseline in vitro, in 2017 IEEE International Conference on Computer Vision (ICCV), pp. 3774–3782, https://doi.org/10.1109/ICCV.2017.405
Zhong Z, Zheng L, Cao D, Li S, 2017 Re-ranking person re-identification with k-reciprocal encoding, arXiv:1701.08398 [cs]
Acknowledgements
This work is supported by the National Natural Science Foundation of China (No. 61702471, No. 61872326, No.61672475); Shandong Provincial Natural Science Foundation (ZR2019MF044).
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Huang, L., Zhang, W., Nie, J. et al. Person re-identification based on multi-appearance model. Multimed Tools Appl 80, 16413–16423 (2021). https://doi.org/10.1007/s11042-020-08927-1
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-020-08927-1