Skip to main content
SpringerLink
Log in

Histogram of the node strength and histogram of the edge weight: two new features for RGB-D person re-identification

  • Research Paper
  • Published:
Science China Information Sciences Aims and scope Submit manuscript

Abstract

Person re-identification is a classical task for any multi-camera surveillance system. Most of the existing researches on re-identification are based on features extracted from RGB images. However, there are many deficiencies in RGB image processing, some of which are requiring a lot of illumination and high computation. In this paper, novel features are proposed for RGB-D person re-identification. First, the complex network approach in texture recognition is modified and its threshold function is changed for using in depth images extracted by RGB-D sensors. Then, two novel measurements named the histogram of the edge weight (HEW) and the histogram of the node strength (HNS) are introduced on complex networks. Our features fit both single-shot and multi-shot person re-identification. In the single-shot case, the HNS is extracted from only one frame while for the multi-shot case it is extracted from both one frame and multi-frames. These proposed measurements are called histogram of the spatial node strength (HSNS) and histogram of the temporal node strength (HTNS) respectively. Subsequently, these measurements are combined with skeleton features using score-level fusion. The method is evaluated using two benchmark databases and the results show that ours outperforms some state-of-the-art methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Guillaumin M, Verbeek J, Schmid C. Is that you? Metric learning approaches for face identification. In: Proceedings of 12th International Conference on Computer Vision (ICCV), Kyoto, 2009. 498–505

    Google Scholar 

  2. Wang L, Tan T N, Ning H Z, et al. Silhouette analysis based gait recognition for human identification. IEEE Trans Pattern Anal Mach Intell, 2003, 25: 1505–1518

    Article  Google Scholar 

  3. Cong D N T, Khoudour L, Achard C, et al. People re-identification by spectral classification of silhouettes. Signal Process, 2010, 90: 2362–2374

    Article  MATH  Google Scholar 

  4. Bedagkar-Gala A, Shah S K. A survey of approaches and trends in person re-identification. Image Vis Comput, 2014, 32: 270–286

    Article  Google Scholar 

  5. Geng Y B, Hu H M, Zeng G D, et al. A person re-identification algorithm by exploiting region-based feature salience. J Vis Commun Image Represent, 2015, 29: 89–102

    Article  Google Scholar 

  6. Schwartz W, Davis L. Learning discriminative appearance-based models using partial least squares. In: Proceedings of XXII Brazilian Symposium on Computer Graphics and Image Processing (SIBGRAPI), Rio de Janiero, 2009. 322–329

    Google Scholar 

  7. Farenzena M, Bazzani L, Perina A, et al. Person re-identification by symmetry-driven accumulation of local features. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), San Francisco, 2010. 2360–2367

    Google Scholar 

  8. Ma B P, Su Y, Jurie F. Covariance descriptor based on bio-inspired features for person re-identification and face verification. Image Vis Comput, 2014, 32: 379–390

    Article  Google Scholar 

  9. Cheng D S, Cristani M, Stoppa M, et al. Custom pictorial structures for re-identification. In: Proceedings of the British Machine Vision Conference (BMVC), Dundee, 2011. 68.1–68.11

    Google Scholar 

  10. Zhao R, Ouyang W L, Wang X G. Unsupervised salience learning for person re-identification. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Portland, 2013. 3586–3593

    Google Scholar 

  11. Zhao R, Oyang W L, Wang X G. Person re-identification by saliency learning. IEEE Trans Pattern Anal Mach Intell, 2017, 39: 356–370

    Article  Google Scholar 

  12. Si J L, Zhang H G, Li C-G, et al. Spatial pyramid-based statistical features for person re-identification: a comprehensive evaluation. IEEE Trans Syst Man Cybern Syst, 2017, 99: 1–5

    Article  Google Scholar 

  13. Lan R S, Zhou Y C, Tang Y Y. Quaternionic local ranking binary pattern: a local descriptor of color images. IEEE Trans Image Process, 2016, 25: 566–579

    Article  MathSciNet  Google Scholar 

  14. Prosser B, Zheng W S, Gong S G, et al. Person re-identification by support vector ranking. In: Proceedings of the British Machine Vision Conference (BMVC), Aberystwyth, 2010. 21.1–21.11

    Google Scholar 

  15. Bashir K, Xiang T, Gong S G. Feature selection on gait energy image for human identification. In: Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Las Vegas, 2008. 985–988

    Google Scholar 

  16. Zheng W S, Gong S G, Xiang T. Person re-identification by probabilistic relative distance comparison. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Colorado Springs, 2011. 649–656

    Google Scholar 

  17. Loy C C, Liu C X, Gong S G. Person re-identification by manifold ranking. In: Proceedings of IEEE International Conference on Image Processing, Melbourne, 2013. 3567–3571

    Google Scholar 

  18. Figueira D, Bazzani L, Minh H Q, et al. Semisupervised multi-feature learning for person re-identification. In: Proceedings of 10th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), Krakow, 2013. 111–116

    Google Scholar 

  19. Kostinger M, Hirzer M, Wohlhart P, et al. Large scale metric learning from equivalence constraints. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Providence, 2012. 2288–2295

    Google Scholar 

  20. Tao D P, Guo Y N, Song M L, et al. Person re-identification by dual-regularized KISS metric learning. IEEE Trans Image Process, 2016, 25: 2726–2738

    Article  MathSciNet  Google Scholar 

  21. Mignon A, Jurie F. PCCA: a new approach for distance learning from sparse pairwise constraints. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Providence, 2012. 2666–2672

    Google Scholar 

  22. Liu H, Ma B P, Qin L, et al. Set-label modeling and deep metric learning on person re-identification. Neurocomput, 2015, 151: 1283–1292

    Article  Google Scholar 

  23. Vezzani R, Baltieri D, Cucchiara R. People re-identification in surveillance and forensics: a survey. ACM Comput Surv, 2013, 46: 29

    Article  Google Scholar 

  24. Chen S-Z, Guo C-C, Lai J-H. Deep ranking for person re-identification via joint representation learning. IEEE Trans Image Process, 2016, 25: 2353–2367

    Article  MathSciNet  Google Scholar 

  25. Barbosa I B, Cristani M, Bue A D, et al. Re-identification with RGB-D sensors. In: Fusiello A, Murino V, CucchiaraR, eds. Computer Vision ECCV, Workshops and Demonstrations. Berlin/Heidelberg: Springer-Verlag, 2012. 433–442

    Google Scholar 

  26. Satta R, Pala F, Fumera G, et al. Real-time appearance-based person re-identification over multiple kinect cameras. In: Proceedings of the 8th International Conference on Computer Vision Theory and Applications (VISAPP), Barcelona, 2013. 21–24

    Google Scholar 

  27. Munaro M, Fossati A, Basso A, et al. One-shot person re-identification with a consumer depth camera. In: Gong S G, Cristani M, Yan S C, et al., eds. Person Re-identification. London: Springer, 2014. 161–181

    Chapter  Google Scholar 

  28. Pala F, Satta R, Fumera G, et al. Multi-modal person re-identification using RGB-D cameras. IEEE Trans Circuit Syst Video Technol, 2015, 26: 788–799

    Article  Google Scholar 

  29. Munaro M B, Ghidoni S, Tartaro D T, et al. A feature-based approach to people re-identification using skeleton keypoints. In: Proceedings of IEEE International Conference on Robotics and Automation (ICRA), Hong Kong, 2014. 5644–5651

    Google Scholar 

  30. Oliver J, Albiol A, Albiol A, et al. Using latent features for short-term person re-identification with RGB-D cameras. Pattern Anal Appl, 2015, 19: 549–561

    Article  MathSciNet  Google Scholar 

  31. Wu A C, Zheng W S, Lai J H. Depth-based person re-identification. In: Proceedings of the 3rd IAPR Asian Conference on Pattern Recognition, Kuala Lumpur, 2015. 026–030

    Google Scholar 

  32. Backes A R, Casanova D, Bruno O M. Texture analysis and classification: a complex network-based approach. Inf Sci, 2013, 219: 168–180

    Article  Google Scholar 

  33. Barabasi A L, Oltvai Z N. Network biology: understanding the cell’s functional organization. Nat Rev Genet, 2004, 5: 101–113

    Article  Google Scholar 

  34. Newman M E J, Park J. Why social networks are different from other types of networks. Phys Rev E, 2003, 68: 036122

    Article  Google Scholar 

  35. Gonçalves W, Martinez A, Bruno O. Complex network classification using partially self-avoiding deterministic walks. Chaos, 2012, 22: 033139

    Article  MathSciNet  MATH  Google Scholar 

  36. Gonçalves W N, Machado B B, Bruno O M. A complex network approach for dynamic texture recognition. Neuro- comput, 2015, 153: 211–220

    Google Scholar 

  37. Amaral L A N, Ottino J M. Complex networks: augmenting the framework for the study of complex systems. Eur Phys J B, 2004, 38: 147–162

    Article  Google Scholar 

  38. Gonçalves W N, Backes A R, Martinez A S, et al. Texture descriptor based on partially self-avoiding deterministic walker on networks. Expert Syst Appl, 2012, 39: 11818–11829

    Article  Google Scholar 

  39. Gonçalves W N, Silva J A, Bruno O M. A rotation invariant face recognition method based on complex network. In: Bloch I, Cesar R M, eds. Progress in Pattern Recognition, Image Analysis, Computer Vision, and Applications. CIARP 2010. Berlin/Heidelberg: Springer, 2010. 426–433

  40. Costa L F, Rodrigues F A, Travieso G, et al. Characterization of complex networks: a survey of measurements. Adv Phys, 2006, 56: 167–242

    Article  Google Scholar 

  41. Bazzani L, Farenzena M, Perina A, et al. Multiple-shot person re-identification by HPE signature. In: Proceedings of IEEE International Conference on Pattern Recognition, Istanbul, 2010. 1413–1416

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Electrical and Computer Engineering Faculty, Semnan Univercity, Semnan, 46198, Iran

    Zeynab Imani & Hadi Soltanizadeh

Authors
  1. Zeynab Imani
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Hadi Soltanizadeh
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Hadi Soltanizadeh.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Imani, Z., Soltanizadeh, H. Histogram of the node strength and histogram of the edge weight: two new features for RGB-D person re-identification. Sci. China Inf. Sci. 61, 092108 (2018). https://doi.org/10.1007/s11432-016-9086-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s11432-016-9086-8

Keywords

Search

Navigation