skip to main content
10.1145/3393527.3393560acmotherconferencesArticle/Chapter ViewAbstractPublication Pagesacm-turcConference Proceedingsconference-collections
research-article

Person Re-identification Based on Pose-guided Generative Adversarial Network

Authors Info & Claims
Published:26 October 2020Publication History

ABSTRACT

Person re-identification (re-id) is a challenging and valuable research topic in the field of computer vision. It needs to match person images with the same identity in multiple camera systems. The change of pose is one of the key factors that affect the network to extract robust features. In order to mitigate the influence of pose variations on person re-id, the paper proposes a person re-id method based on a pose-guided generative adversarial network (PG-GAN), which can be used to learn identity-sensitive and pose-insensitive features. The algorithm is composed of a Siamese convolutional neural network (SCNN) and generative adversarial networks (GANs). SCNN is a symmetric structure with ResNet-50. GANs contain multiple pose discriminators and identity discriminators, as well as incorporate pose loss, which requires appearance of the generated image with same identity to be similar. The proposed method has been well performed on pedestrian reidentification datasets.

References

  1. H. Zhao, M. Tian, S. Sun, J. Shao, S. Yi, X. Wang, X. Tang, "Spindle net: Person re-identification with human body region guided feature decomposition and fusion," in CVPR, pp.907--915, 2017.Google ScholarGoogle Scholar
  2. Z. Zheng, L. Zheng, Y. Yang, "Pedestrain alignment network for large-scale person re-identification," in TCSVT, pp.1--1, 2018.Google ScholarGoogle Scholar
  3. L. He, J. Liang, H. Li, Z. Sun, "Deep spatial feature reconstruction for partial person re-identification: alignment-free approach," in CVPR, pp.7073--7082, 2018.Google ScholarGoogle Scholar
  4. W. Li, X. Zhu, S. Gong, "Harmonious attention network for person reidentification," in CVPR, pp.2285--2294, 2018.Google ScholarGoogle Scholar
  5. Y. Guo, N. Cheung, "Efficient and deep person re-identification using multi-level similarity," in CVPR, pp.2335--2344, 2018.Google ScholarGoogle Scholar
  6. R. Alec, M. Luke, C. Soumith, "Unsupervised representation learning with deep convolutional generative adversarial networks," arXiv preprint arXiv:1511.06434, 2015.Google ScholarGoogle Scholar
  7. C. Xi, D. Yan, H. Rein, S. John, S. Ilya, A. Pieter, "Infogan: Interpretable representation learning by information maximizing generative adversarial nets," in NIPS, pp.2172--2180, 2016.Google ScholarGoogle Scholar
  8. A. Martín, C. Soumith, B. Léon, "Wasserstein GAN," arXiv preprint arXiv:1701.07875, 2017.Google ScholarGoogle Scholar
  9. Z. Zheng, L. Zheng, Y. Yang, "Unlabeled samples generated by gan improve the person re-identification baseline in vitro," in ICCV, pp.3774--3782, 2017.Google ScholarGoogle Scholar
  10. L. Wei, S. Zhang, W. Gao, Q. Tian, "Person transfer gan to bridge domain gap for person re-identification," in CVPR, pp.79--88, 2018.Google ScholarGoogle Scholar
  11. Z. Zhong, L. Zheng, D. Cao, et al., "Re-ranking Person Reidentification with k-Reciprocal Encoding," in CVPR, pp.3652--3661, 2017.Google ScholarGoogle Scholar
  12. L. Zheng, Y. Yang, Q. Tian, "SIFT meets CNN: A decade survey of instance retrieval," Pattern Analysis and Machine Intelligence, pp.1224--1244, 2018.Google ScholarGoogle Scholar
  13. R. Arandjelović, A. Zisserman, "Three things everyone should know to improve object retrieval," in CVPR, pp.2911--2918, 2012.Google ScholarGoogle Scholar
  14. S. Bai, X. Bai, "Sparse contextual activation for efficient visual reranking," in IEEE Trans on Image Processing, pp.1056--1069, 2016.Google ScholarGoogle Scholar
  15. J. Garcia, N. Martinel, C. Micheloni, et al., "Person re-identification ranking optimization by discriminant context information analysis," in ICCV, pp.1305--1313, 2015.Google ScholarGoogle Scholar
  16. H. Wang, S. Liao, Z. Lei, Y. Yang, "Is re-ranking useful for open-set person re-identification," in Big Data, pp.4625--4631, 2018.Google ScholarGoogle Scholar
  17. L. Zheng, L. Shen, L. Tian, et al., "Scalable person re-identification: A benchmark," in ICCV, pp.1116--1124, 2015.Google ScholarGoogle Scholar
  18. W. Li, R. Zhao, T. Xiao, X. Wang, "Deepreid: Deep filter pairing neural network for person re-identification," in CVPR, pp.152--159, 2014.Google ScholarGoogle Scholar
  19. E. Ristani, F. Solera, R. Zou, R. Cucchiara, C. Tomasi, "Performance measures and a data set for multi-target, multi-camera tracking," in ECCV, 2016.Google ScholarGoogle Scholar
  20. K. He, X. Zhang, S. Ren, et al., "Deep residual learning for image recognition," in CVPR, pp.770--778, 2016.Google ScholarGoogle Scholar
  21. Z. Cao, T. Simon, S. Wei, Y. Sheikh, "Realtime multi-person 2d pose estimation using part affinity fields," in CVPR, pp.1302--1310, 2017.Google ScholarGoogle Scholar
  22. P. Isola, J. Zhu, T. Zhou, et al., "Image-to-image translation with conditional adversarial networks," in CVPR, pp.5967--5976, 2017.Google ScholarGoogle Scholar
  23. J. Deng, W. Dong, R. et al., "Imagenet: A large-scale hierarchical image database," in CVPR, pp.248--255, 2009.Google ScholarGoogle Scholar
  24. T. Salimans, I. Goodfellow, W. Zaremba, et al., "Improved techniques for training gans," in NIPS, 2016.Google ScholarGoogle Scholar
  25. J. Xu, R. Zhao, F. Zhu, H. Wang, W. Ouyang, "Attention-aware compositional network for person re-identification," in CVPR, pp.2119--2128, 2018.Google ScholarGoogle Scholar
  26. M. Sarfraz, A. Schumann, A. Eberle, R. Stiefelhagen, "A posesensitive embedding for person re-identification with expanded cross neighborhood re-ranking," in CVPR, pp.420--429, 2018.Google ScholarGoogle Scholar

Index Terms

  1. Person Re-identification Based on Pose-guided Generative Adversarial Network

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Other conferences
      ACM TURC '20: Proceedings of the ACM Turing Celebration Conference - China
      May 2020
      220 pages
      ISBN:9781450375344
      DOI:10.1145/3393527

      Copyright © 2020 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 26 October 2020

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article
      • Research
      • Refereed limited

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader