Skip to main content
Springer Nature Link
Log in

Person re-identification using salient region matching game

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

The human saliency feature has been increasingly used for person re-identification across non-overlapping cameras but is deficient in retaining the minor features of the salient region, thus resulting in matching accuracy decline. To address this challenge, we first propose to extract optimal regions from pedestrian images that contain high intra-region feature similarity. Subsequently, by computing the saliency of each region, we choose the most salient region, which contains not only saliency features but also minor features, to represent the corresponding pedestrian. Finally, by formulating the competitive matching as hypothesis in a matching game, we obtain the most suitable set of matching by iteratively computing the payoff of each hypothesis. We evaluate our scheme on three widely used public datasets, and experimental results verify the advantage of our proposed algorithm, which outperforms previous representative methods with a matching ratio of 10.8%.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

References

  1. Albarelli A, Bergamasco F, Torsello A (2013) A scale independent selection process for 3D object recognition in cluttered scenes. Int J Comput Vis 102(1–3):29–145. https://doi.org/10.1007/s11263-012-0568-x

    MathSciNet  Google Scholar 

  2. An L, Chen X, Yang S, Bhanu B (2016) Sparse representation matching for person re-identification. Inf Sci 355–356:74–89. https://doi.org/10.1016/j.ins.2016.02.055

    Article  Google Scholar 

  3. Arbelez P, Maire M, Fowlkes C, Malik J (2011) Contour detection and hierarchical image segmentation. IEEE Trans Pattern Anal Mach Intell 33(5):898–916. https://doi.org/10.1109/tpami.2010.161

    Article  Google Scholar 

  4. Chang YC, Chiang CK, Lai SH (2012) Single-shot person re-identification based on improved random-walk pedestrian segmentation. In: Intelligent signal processing and communications systems (ISPACS), pp 1–6. https://doi.org/10.1109/ISPACS.2012.6473442

  5. Chen D, Yuan Z, Hua G, Zheng N, Wang J (2015) Similarity learning on an explicit polynomial kernel feature map for person re-identification. In: Conference on computer vision and pattern recognition, pp 1565–1573. https://doi.org/10.1109/CVPR.2015.7298764

  6. Cheng MM, Zhang GX, Mitra NJ, Huang X, Hu SM (2011) Global contrast based salient region detection. Proc IEEE Conf Comput Vis Pattern Recognit 37(3):409–416. https://doi.org/10.1109/TPAMI.2014.2345401

    Google Scholar 

  7. Cho YJ, Yoon KJ (2016) Improving person re-identification via pose-aware multi-shot matching. In: Computer vision and pattern recognition, pp 1354–1362. https://doi.org/10.1109/CVPR.2016.151

  8. Cosmo L, Albarelli A, Bergamasco F, Torsello A, Rodol E, Cremers D (2016) A game-theoretical approach for joint matching of multiple feature throughout unordered images. In: International conference on pattern recognition (ICPR), pp 3715–3720. https://doi.org/10.1109/ICPR.2016.7900212

  9. Dong SC, Cristani M, Stoppa M, Bazzani L, Murino V (2014) Custom pictorial structures for re-identification. British Machine Vision Conference 68:1–11. https://doi.org/10.5244/C.25.68

    Google Scholar 

  10. Einhauser W, Konig P (2003) Does luminance-contrast contribute to a saliency map for overt visual attention? Eur J Neurosci 17(5):1089. https://doi.org/10.1046/j.1460-9568.2003.02508.x

    Article  Google Scholar 

  11. Farenzena M, Bazzani L, Perina A, Murino V, Cristani M (2010) Person re-identification by symmetry-driven accumulation of local features. Comput Vis Pattern Recognit 23(3):2360–2367. https://doi.org/10.1109/CVPR.2010.5539926

    Google Scholar 

  12. GRID Dataset. Avaliable online: https://personal.ie.cuhk.edu.hk/~ccloy/files/datasets/underground_reid.zip. Accessed 9 Oct 2016

  13. Huang S, Lu J, Zhou J, Jain AK (2015) Nonlinear local metric learning for person re-identification. Computer science. arXiv:1511.05169v1

  14. iLIDS-VID dataset. Avaliable online: https://www.eecs.qmul.ac.uk/~xz303/iLIDS-VID/iLIDS-VID.tar. Accessed 28 Sept 2016

  15. Jing XY, Zhu X, Wu F, Hu R, You X, Wang Y (2017) Super-resolution person re-identification with semi-coupled low-rank discriminant dictionary learning. IEEE Trans Image Process 26(3):1363–1378. https://doi.org/10.1109/TIP.2017.2651364

    Article  MathSciNet  Google Scholar 

  16. Karanam S, Li Y, Radke RJ (2016) Person re-identification with discriminatively trained viewpoint invariant dictionaries. In: IEEE international conference on computer vision, pp 4516–4524. https://doi.org/10.1109/ICCV.2015.513

  17. Li J, Yang Z, Xiong H (2015) Encoding the regional features for person re-identification using locality-constrained linear coding. In: International conference on computers, communications, and systems (ICCCS), pp 178–181. https://doi.org/10.1109/CCOMS.2015.7562896

  18. Li X, Zheng WS, Wang X, Xiang T, Gong S (2015) Multi-scale learning for low-resolution person re-identification. In: IEEE international conference on computer vision, pp 3765–3773. https://doi.org/10.1109/ICCV.2015.429

  19. Li Y, Wu Z, Radke RJ (2015) Multi-shot re-identification with random-projection-based random forests. In: Applications of computer vision, pp 373–380. https://doi.org/10.1109/WACV.2015.56

  20. Li W, Huang C, Luo B, Meng F, Song T, Shi H (2016) Person re-identification based on multi-region-set ensembles. J Vis Commun Image Represent, Part A 40:67–75. https://doi.org/10.1016/j.jvcir.2016.06.009

    Article  Google Scholar 

  21. Liu G, Lin Z, Yu Y (2010) Robust subspace segmentation by low-rank representation. In: International conference on machine learning, pp 663–670. https://doi.org/10.1109/icdmw.2010.64

  22. Ma B, Su Y, Jurie F (2012) Bicov: a novel image representation for person re-identification and face verification. https://doi.org/10.5244/c.26.57

  23. Ma L, Yang X, Tao D (2014) Person re-identification over camera networks using multi-task distance metric learning. IEEE Trans Image Process 23(8):3656–3670. https://doi.org/10.1109/TIP.2014.2331755

    Article  MathSciNet  MATH  Google Scholar 

  24. Martinel N, Micheloni C, Foresti GL (2015) Kernelized saliency-based person re-identification through multiple metric learning. IEEE Trans Image Process 24(12):5645–5658. https://doi.org/10.1109/TIP.2015.2487048

    Article  MathSciNet  Google Scholar 

  25. Pedagadi S, Orwell J, Velastin S, Boghossian B (2013) Local fisher discriminant analysis for pedestrian re-identification. IEEE Conf Comput Vis Pattern Recognit 9 (4):3318–3325. https://doi.org/10.1109/CVPR.2013.426

    Google Scholar 

  26. Poongothai E, Suruliandi A (2016) Features analysis of person re-identification techniques. In: International conference on computing technologies and intelligent data engineering (ICCTIDE’16), pp 1–6. https://doi.org/10.1109/ICCTIDE.2016.7725330

  27. Ramström O, Christensen HI (2002) Visual attention using game theory. Biologically Motivated Computer Vision Second International Workshop 2525(1):462–471. https://doi.org/10.1007/3-540-36181-2_46

    Article  MATH  Google Scholar 

  28. Tao D, Guo Y, Song M, Li Y, Yu Z, Tang YY (2016) Person re-identification by dual-regularized kiss metric learning. IEEE Trans Image Process 25 (6):2726–2738. https://doi.org/10.1109/TIP.2016.2553446

    Article  MathSciNet  Google Scholar 

  29. VIPeR dataset. Avaliable online: https://users.soe.ucsc.edu/~manduchi/VIPeR.v1.0.zip. Accessed 25 Sept 2016

  30. Wang C, Tang S, Zhu S, Jing X (2016) Person re-identification based on saliency. In: Control conference, pp 3887–3890. https://doi.org/10.1109/chicc.2016.7553958

  31. Wang S, Zhang C, Duan L, Wang L, Wu S, Chen L (2016) Person re-identification based on deep spatio-temporal features and transfer learning. In: International joint conference on neural networks, pp 1660–1665. https://doi.org/10.1109/IJCNN.2016.7727397

  32. Wang T, Gong S, Zhu X, Wang S (2016) Person re-identification by discriminative selection in video ranking. IEEE Trans Pattern Anal Mach Intell 38 (12):2501–2514. https://doi.org/10.1109/TPAMI.2016.2522418

    Article  Google Scholar 

  33. Xiong F, Gou M, Camps O, Sznaier M (2014) Person re-identification using kernel-based metric learning methods. In: Computer vision (ECCV), pp 1–16. https://doi.org/10.1007/978-3-319-10584-0_1

  34. Xu Y, Li J, Chen J, Shen G, Gao Y (2017) A novel approach for visual Saliency detection and segmentation based on objectness and top-down attention. In: 2017 2nd international conference on image, vision and computing (ICIVC), pp 361–365. https://doi.org/10.1109/ICIVC.2017.7984578

  35. Yang Y, Yang J, Yan J, Liao S, Yi D, Li S (2014) Salient color names for person re-identification. European Conference on Computer Vision (ECCV) 8689(9):536–551. https://doi.org/10.1109/tifs.2016.2601065

    Google Scholar 

  36. Yang M, Wan W, Hou L, Zhang Y (2015) Person re-identification using human salience based on multi-feature fusion. In: International Conference on Smart and Sustainable City and Big Data (ICSSC), pp 195–199. https://doi.org/10.1049/cp.2015.0268

  37. Zhang J, Sclaroff S (2016) Exploiting surroundedness for saliency detection: a boolean map approach. IEEE Trans Pattern Anal Mach Intell 38(5):889–902. https://doi.org/10.1109/TPAMI.2015.2473844

    Article  Google Scholar 

  38. Zhao R, Ouyang W, Wang X (2013) Person re-identification by salience matching. In: IEEE international conference on computer vision, pp 2528–2535. https://doi.org/10.1109/ICCV.2013.314

  39. Zhao R, Ouyang W, Wang X (2014) Learning mid-level filters for person re-identification. In: Computer vision and pattern recognition, pp 44–151. https://doi.org/10.1109/CVPR.2014.26

  40. Zheng L, Shen L, Tian L, Wang S, Wang J, Tian Q (2015) Scalable person re-identification: a benchmark. In: IEEE international conference on computer vision (ICCV), pp 1116–1124. https://doi.org/10.1109/ICCV.2015.133

  41. Zheng WS, Gong S, Xiang T (2013) Reidentification by relative distance comparison. IEEE Trans Pattern Anal Mach Intell 35(3):653–668. https://doi.org/10.1109/TPAMI.2012.138

    Article  Google Scholar 

  42. Zhou Z, Wang Y, Wu QMJ, Yang C, Sun X (2017) Effective and efficient global context verification for image copy detection. IEEE Trans Inf Forensics Secur 12(1):48–63. https://doi.org/10.1109/TIFS.2016.2601065

    Article  Google Scholar 

  43. Zhu F, Chu Q, Yu N (2016) Consistent matching based on boosted salience channels for group re-identification. In: IEEE international conference on image processing (ICIP), pp 4279–4283. https://doi.org/10.1109/ICIP.2016.7533167

Download references

Acknowledgements

This work is supported by the National Natural Science Foundation of China under Grant No. 61572261 and 61702284, the Natural Science Foundation of Jiangsu Province under Grant No. BK20150868, the China Postdoctoral Science Foundation funded project under Grant No. 2014M551635, the NUPTSF under Grant No. NY214013, the Jiangsu Planned Projects for Postdoctoral Research Funds under Grant No.1302085B and 1701165C, and the Major Scientic Research Project of Higher Learning Institution of Henan Province under Grant No. 18A520022.

Author information

Authors and Affiliations

  1. College of Computer, Nanjing University of Posts and Telecommunications, Nanjing, 210003, China

    Tiezhu Li, Lijuan Sun, Chong Han & Jian Guo

  2. School of Software, Henan University, Kaifeng, 475000, China

    Tiezhu Li

  3. Jiangsu High Technology Research Key Laboratory for Wireless Sensor Networks, Nanjing University of Posts and Telecommunications, Nanjing, 210003, China

    Lijuan Sun, Chong Han & Jian Guo

Authors
  1. Tiezhu Li
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Lijuan Sun
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. Chong Han
    View author publications

    You can also search for this author inPubMed Google Scholar

  4. Jian Guo
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Lijuan Sun.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Li, T., Sun, L., Han, C. et al. Person re-identification using salient region matching game. Multimed Tools Appl 77, 21393–21415 (2018). https://doi.org/10.1007/s11042-017-5541-9

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-017-5541-9

Keywords