Skip to main content

Advertisement

Springer Nature Link
Log in

Selective relation-aware representations for person re-identification

  • Original Article
  • Published:
International Journal of Machine Learning and Cybernetics Aims and scope Submit manuscript

Abstract

Recent studies have shown the effectiveness of the joint learning of global and part-level features for person re-identification (Re-ID) task, as they target to enhance the discriminative feature representations of pedestrian from the perspective of multiple granularities. However, most of these methods ignore the global structural relation information under adaptive receptive fields, and the local structural relation between parts, making it hard to fully utilize rich structural relation information of pedestrian to form the stable coherent structural patterns. In this paper, we propose selective relation-aware representations (SRAR) for person Re-ID. The framework of SRAR mainly consists of a distinctive attention module and a part relation-aware (PRA) module. Firstly, the distinctive attention module embraces selective position attention module and channel attention (CA) module, which are designed to selectively exploit spatial-wise and channel-wise relation-aware salient feature representations under adaptive receptive fields for the pedestrian. Furthermore, to comprehensively grasp the coherent structural patterns of pedestrian, the PRA module is introduced to promote the interaction between part-level features, and further obtain relation-aware fine-grained feature representations. Extensive experiments are performed on the three popular datasets, including Market1501, DukeMTMC-reID, CUHK03, which validate that our method achieves a competitive performance.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

Data Availability Statement

The datasets analysed during the current study are available in the Refs. [63,64,65,66, 68].

References

  1. Zheng L, Yang Y, Hauptmann AG (2016) Person re-identification: past, present and future. arXiv preprint arXiv:1610.02984

  2. Zhong W, Zhang T, Jiang L, Ji J, Zhang Z, Xiong H (2019) Discriminative representation learning for person re-identification via multi-loss training. J Vis Commun Image Represent 62:267–278

    Article  Google Scholar 

  3. Zhao R, Oyang W, Wang X (2016) Person re-identification by saliency learning. IEEE Trans Pattern Anal Mach Intell 39(2):356–370

    Article  Google Scholar 

  4. Varior RR, Haloi M, Wang G (2016) Gated Siamese Convolutional Neural Network architecture for human re-identification. In: Leibe B, Matas J, Sebe N, Welling M (eds) Computer vision—ECCV 2016: 14th european conference, Amsterdam, The Netherlands, October 11–14, 2016, Proceedings, Part VIII. Springer International Publishing, Cham, pp 791–808. https://doi.org/10.1007/978-3-319-46484-8_48

  5. Xiao T, Li H, Ouyang W, Wang X (2016) Learning deep feature representations with domain guided dropout for person re-identification. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1249–1258

  6. Zhang L, Xiang T, Gong S (2016) Learning a discriminative null space for person re-identification. In Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1239–1248

  7. Chen B, Deng W, Hu J (2019) Mixed high-order attention network for person re-identification. In: Proceedings of the IEEE international conference on computer vision, pp 371–381

  8. Yao H, Zhang S, Hong R, Zhang Y, Xu C, Tian Q (2019) Deep representation learning with part loss for person re-identification. IEEE Trans Image Process 28(6):2860–2871. https://doi.org/10.1109/TIP.2019.2891888

    Article  MathSciNet  MATH  Google Scholar 

  9. Song C, Huang, Ouyang W, Wang L (2018) Mask-guided contrastive attention model for person re-identification. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1179–1188

  10. Li W, Zhu X, Gong S (2018) Harmonious attention network for person re-identification. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 2285–2294

  11. Si J, Zhang H, Li C-G, Kuen J, Kong X, Kot AC, Wang G (2018) Dual attention matching network for context-aware feature sequence based person re-identification. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 5363–5372

  12. Xu J, Zhao R, Zhu F, Wang H, Ouyang W (2018) Attention-aware compositional network for person re-identification. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 2119–2128

  13. Zhou S, Wang F, Huang Z, Wang J (2019) Discriminative feature learning with consistent attention regularization for person re-identification. In: Proceedings of the IEEE/CVF international conference on computer vision, pp 8040–8049

  14. Zheng M, Karanam S, Wu Z, Radke RJ (2019) Re-identification with consistent attentive siamese networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 5735–5744

  15. Tay C-P, Roy S, Yap K-H (2019) Aanet: attribute attention network for person re-identifications. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 7134–7143

  16. Hou R, Ma B, Chang H, Gu X, Shan S, Chen X (2019) Interaction-and-aggregation network for person re-identification. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 9317–9326

  17. Chen T, Ding S, Xie J, Yuan Y, Chen W, Yang Y, Ren Z, Wang Z (2019) Abd-net: Attentive but diverse person re-identification. In: Proceedings of the IEEE international conference on computer vision, pp 8351–8361

  18. Hou R, Ma B, Chang H, Gu X, Shan S, Chen X (2020) Iaunet: global context-aware feature learning for person reidentification. IEEE Trans Neural Netw Learn Syst. https://doi.org/10.1109/TNNLS.2020.2967051

    Article  Google Scholar 

  19. Su J, He X, Qing L, Cheng Y, Peng Y (2021) An enhanced siamese angular softmax network with dual joint-attention for person re-identification. Appl Intell 1–19

  20. Saquib Sarfraz M, Schumann A, Eberle A, Stiefelhagen R (2018) A pose-sensitive embedding for person re-identification with expanded cross neighborhood re-ranking. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 420–429

  21. Su C, Li J, Zhang S, Xing J, Gao W, Tian Q (2017) Pose-driven deep convolutional model for person re-identification. In: Proceedings of the IEEE international conference on computer vision, pp 3960–3969

  22. Guo J, Yuan Y, Huang L, Zhang C, Yao J-G, Han K (2019) Beyond human parts: Dual part-aligned representations for person re-identification. In: Proceedings of the IEEE international conference on computer vision, pp 3642–3651

  23. Zheng L, Huang Y, Huchuan L, Yang Y (2019) Pose-invariant embedding for deep person re-identification. IEEE Trans Image Process 28(9):4500–4509

    Article  MathSciNet  Google Scholar 

  24. Zhang Z, Lan C, Zeng W, Chen Z (2019) Densely semantically aligned person re-identification. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 667–676

  25. Suh Y, Wang J, Tang S, Mei T, Lee KM (2018) Part-aligned bilinear representations for person re-identification. In: Ferrari V, Hebert M, Sminchisescu C, Weiss Y (eds) Computer vision—ECCV 2018: 15th European conference, Munich, Germany, September 8–14, 2018, Proceedings, Part XIV. Springer International Publishing, Cham, pp 418–437. https://doi.org/10.1007/978-3-030-01264-9_25

  26. Kalayeh MM, Basaran E, Gökmen M, Kamasak ME, Shah M (2018) Human semantic parsing for person re-identification. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1062–1071

  27. Li D, Chen X, Zhang Z, Huang K (2017) Learning deep context-aware features over body and latent parts for person re-identification. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 384–393

  28. Zhao L, Li X, Zhuang Y, Wang J (2017) Deeply-learned part-aligned representations for person re-identification. In: Proceedings of the IEEE international conference on computer vision, pp 3219–3228

  29. Zhu K, Guo H, Liu Z, Tang M, Wang J (2020) Identity-guided human semantic parsing for person re-identification. In: Vedaldi A, Bischof H, Brox T, Frahm J-M (eds) Computer vision—ECCV 2020: 16th European conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part III. Springer International Publishing, Cham, pp 346–363. https://doi.org/10.1007/978-3-030-58580-8_21

  30. Sun Y, Zheng L, Yang Y, Tian Q, Wang S (2018) Beyond part models: person retrieval with refined part pooling (and a strong convolutional baseline). In: Ferrari V, Hebert M, Sminchisescu C, Weiss Y (eds) Computer vision—ECCV 2018: 15th European conference, Munich, Germany, September 8–14, 2018, Proceedings, Part IV. Springer International Publishing, Cham, pp 501–518. https://doi.org/10.1007/978-3-030-01225-0_30

  31. Wang G, Yuan Y, Chen X, Li J, Zhou X (2018) Learning discriminative features with multiple granularities for person re-identification. In: Proceedings of the 26th ACM international conference on multimedia, pp 274–282

  32. Yang F, Wei Y, Zhou Y, Shi H, Huang G, Wang X, Yao Z, Huang T (2019) Horizontal pyramid matching for person re-identification. Proc AAAI Conf Artif Intell 33:8295–8302

    Google Scholar 

  33. Zheng F, Deng C, Sun X, Jiang X, Guo X, Yu Z, Huang F, Ji R (2019) Pyramidal person re-identification via multi-loss dynamic training. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 8514–8522

  34. Zhang Y, Liu S, Qi L, Coleman S, Kerr D, Shi W (2020) Multi level and multi scale horizontal pooling network for person re-identification. Multimed Tools Appl 79(39):28603–28619

    Article  Google Scholar 

  35. Li Z, Lv J, Chen Y, Yuan J (2021) Person re-identification with part prediction alignment. Comput Vis Image Underst 205:103172

    Article  Google Scholar 

  36. Zhang T, Lin H, Tadesse MM, Ren Y, Duan X, Bo X (2021) Chinese medical relation extraction based on multi-hop self-attention mechanism. Int J Mach Learn Cybern 12(2):355–363

    Article  Google Scholar 

  37. Qiao X, Peng C, Liu Z, Yanfeng H (2019) Word-character attention model for Chinese text classification. Int J Mach Learn Cybern 10(12):3521–3537

    Article  Google Scholar 

  38. Chen Y, Zhao H, Hu Z, Peng J (2021) Attention-based context aggregation network for monocular depth estimation. Int J Mach Learn Cybern 1–14

  39. Jiang Y, Jun X, Zhang T (2020) View-independent representation with frame interpolation method for skeleton-based human action recognition. Int J Mach Learn Cybern 11(12):2625–2636

    Article  Google Scholar 

  40. Zhang H, Goodfellow I, Metaxas D, Odena A (2019) Self-attention generative adversarial networks. In: International conference on machine learning. PMLR, pp 7354–7363

  41. Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser L, Polosukhin I (2017) Attention is all you need. arXiv preprint arXiv:1706.03762

  42. Wang X, Girshick R, Gupta A, He K (2018) Non-local neural networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 7794–7803

  43. Fu J, Liu J, Tian H, Li Y, Bao Y, Fang Z, Lu H (2019) Dual attention network for scene segmentation. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 3146–3154

  44. Sethuraman J, Alzubi JA, Manikandan R, Gheisari M, Kumar A (2019) Eccentric methodology with optimization to unearth hidden facts of search engine result pages. Recent Patents Comput Sci 12(2):110–119

    Article  Google Scholar 

  45. Gheisari M, Panwar D, Tomar P, Harsh H, Zhang X, Solanki A, Nayyar A, Alzubi JA (2019) An optimization model for software quality prediction with case study analysis using matlab. IEEE Access 7:85123–85138

    Article  Google Scholar 

  46. Das A, Chakraborty A, Roy-Chowdhury AK (2014) Consistent re-identification in a camera network. In: Fleet D, Pajdla T, Schiele B, Tuytelaars T (eds) Computer vision—ECCV 2014: 13th European conference, Zurich, Switzerland, September 6–12, 2014, Proceedings, Part II. Springer International Publishing, Cham, pp 330–345. https://doi.org/10.1007/978-3-319-10605-2_22

  47. Liao S, Hu Y, Zhu X, Li SZ (2015) Person re-identification by local maximal occurrence representation and metric learning. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 2197–2206

  48. Matsukawa T, Okabe T, Suzuki E, Sato Y (2016) Hierarchical gaussian descriptor for person re-identification. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1363–1372

  49. Jaderberg M, Simonyan K, Zisserman A, Kavukcuoglu K (2015) Spatial transformer networks. In: Proceedings of the 28th international conference on neural information processing systems-volume 2, pp 2017–2025

  50. Park H, Ham B (2020) Relation network for person re-identification. Proc AAAI Conf Artif Intell 34:11839–11847

    Google Scholar 

  51. Hou Y, Lian S, Haifeng H, Chen D (2021) Part-relation-aware feature fusion network for person re-identification. IEEE Signal Process Lett 28:743–747

    Article  Google Scholar 

  52. Wang H, Bi X (2021) Person re-identification based on graph relation learning. Neural Process Lett 53(2):1401–1415

    Article  Google Scholar 

  53. Wang F, Jiang M, Qian C, Yang S, Li C, Zhang H, Wang X, Tang X (2017) Residual attention network for image classification. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 3156–3164

  54. Yu C, Wang J, Peng C, Gao C, Yu G, Sang N (2018) Learning a discriminative feature network for semantic segmentation. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1857–1866

  55. Hermans A, Beyer L, Leibe B (2017) In defense of the triplet loss for person re-identification. arXiv preprint arXiv:1703.07737

  56. Li X, Wang W, Hu X, Yang J (2019) Selective kernel networks. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 510–519

  57. Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. Adv Neural Inf Process Syst 25:1097–1105

    Google Scholar 

  58. He K, Zhang X, Ren S, Sun J (2015) Spatial pyramid pooling in deep convolutional networks for visual recognition. IEEE Trans Pattern Anal Mach Intell 37(9):1904–1916

    Article  Google Scholar 

  59. Zhao H, Shi J, Qi X, Wang X, Jia J (2017) Pyramid scene parsing network. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 2881–2890

  60. Deng W, Zheng L, Ye Q, Kang G, Yang Y, Jiao J (2018) Image-image domain adaptation with preserved self-similarity and domain-dissimilarity for person re-identification. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 994–1003

  61. Alzubi OA, Alzubi JA, Alweshah M, Qiqieh I, Al-Shami S, Ramachandran M (2020) An optimal pruning algorithm of classifier ensembles: dynamic programming approach. Neural Comput Appl 32(20):16091–16107

    Article  Google Scholar 

  62. Jafar A, ALzubi BB, Sudeep T, Ramachandran M, Ashish K, Chandrasekar T (2019) Boosted neural network ensemble classification for lung cancer disease diagnosis. Appl Soft Comput 80:579–591

    Article  Google Scholar 

  63. Zheng L, Shen L, Tian L, Wang S, Wang J, Tian Q (2015) Scalable person re-identification: a benchmark. In: Proceedings of the IEEE international conference on computer vision, pp 1116–1124

  64. Ristani E, Solera F, Zou R, Cucchiara R, Tomasi C (2016) Performance measures and a data set for multi-target, multi-camera tracking. In: Hua G, Jégou H (eds) Computer vision—ECCV 2016 workshops: Amsterdam, The Netherlands, October 8–10 and 15–16, 2016, Proceedings, Part II. Springer International Publishing, Cham, pp 17–35. https://doi.org/10.1007/978-3-319-48881-3_2

  65. Zheng Z, Zheng L, Yang Y (2017) Unlabeled samples generated by gan improve the person re-identification baseline in vitro. In: Proceedings of the IEEE international conference on computer vision, pp 3754–3762

  66. Li W, Zhao R, Xiao T, Wang X (2014) Deepreid: deep filter pairing neural network for person re-identification. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 152–159

  67. Felzenszwalb P, McAllester D, Ramanan D (2008) A discriminatively trained, multiscale, deformable part model. In: 2008 IEEE conference on computer vision and pattern recognition. IEEE, pp 1–8

  68. Zhong Z, Zheng L, Cao D, Li S (2017) Re-ranking person re-identification with k-reciprocal encoding. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1318–1327

  69. Deng J, Dong W, Socher R, Li L-J, Li K, Fei-Fei L (2009) Imagenet: a large-scale hierarchical image database. In: 2009 IEEE conference on computer vision and pattern recognition. IEEE, pp 48–255

  70. Reddi SJ, Kale S, Kumar S (2019) On the convergence of adam and beyond. arXiv preprint arXiv:1904.09237

  71. Selvaraju RR, Cogswell M, Das A, Vedantam R, Parikh D, Batra D (2017) Grad-cam: visual explanations from deep networks via gradient-based localization. In: Proceedings of the IEEE international conference on computer vision, pp 618–626

  72. Chen Y, Wang H, Sun X, Fan B, Tang C (2020) Deep attention aware feature learning for person re-identification. arXiv preprint arXiv:2003.00517

  73. Zhou J, Roy SK, Fang P, Harandi M, Petersson L (2020) Cross-correlated attention networks for person re-identification. Image Vis Comput 100:103931

    Article  Google Scholar 

  74. Jiabao W, Yang L, Yangshuo Z, Zhuang M, Rui Z (2020) A heterogeneous branch and multi-level classification network for person re-identification. Neurocomputing 404:61–69

    Article  Google Scholar 

  75. Zhang W, Huang L, Wei Z, Nie J (2021) Appearance feature enhancement for person re-identification. Expert Syst Appl 163:113771

    Article  Google Scholar 

  76. Tan H, Liu X, Bian Y, Wang H, Yin B (2021) Incomplete descriptor mining with elastic loss for person re-identification. IEEE Trans Circuits Syst Video Technol 1–1

  77. https://mp.weixin.qq.com/s/U7mO5pu5P_9qr_pOtbY7MQ

  78. Xiong F, Gou M, Camps O, Sznaier M (2014) Person re-identification using kernel-based metric learning methods. In: European conference on computer vision. Springer, pp 1–16

Download references

Acknowledgements

This work was partially supported by the Fundamental Research Funds for the Central Universities (JUSRP41908), the National Natural Science Foundation of China (61362030, 61201429), China Postdoctoral Science Foundation (2015M581720, 2016M600360).

Author information

Authors and Affiliations

  1. Jiangsu Provincial Engineering Laboratory of Pattern Recognition and Computational Intelligence, Jiangnan University, Wuxi, 214122, China

    Min Jiang

  2. School of the Internet of Things Engineering, Jiangnan University, Wuxi, 214122, China

    Xi Luo & Jun Kong

Authors
  1. Xi Luo
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Min Jiang
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. Jun Kong
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Min Jiang.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Luo, X., Jiang, M. & Kong, J. Selective relation-aware representations for person re-identification. Int. J. Mach. Learn. & Cyber. 13, 3523–3541 (2022). https://doi.org/10.1007/s13042-022-01610-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s13042-022-01610-x

Keywords