Skip to main content
SpringerLink
Log in

Multi-frame twin-channel descriptor for person re-identification in real-time surveillance videos

  • Regular Paper
  • Published:
International Journal of Multimedia Information Retrieval Aims and scope Submit manuscript

Abstract

Automatic re-identification of people entering the camera network is an important and challenging task. Multiple frames of the same person will be easily available in surveillance videos for re-identification. Dealing with pose variations of the person in the image and partial occlusion issues is major challenge in single-frame re-identification process. The use of more frames from the surveillance videos can generate robust descriptor to tackle issues of pose variations and occlusion. In this paper, we have emphasized on using multiple frames from the same video to generate a multi-frame twin-channel descriptor. The work deals with building a spatial-temporal descriptor which takes advantage of the twin paths to extract features of the person image. Mahalanobis distance metric learning algorithms is used for matching and evaluation. Our descriptor is evaluated on two benchmark datasets and found to surpass the performance of the existing methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  1. Bak S, Corvee E, Bremond F, Thonnat M (2010) Person re-identification using haar-based and dcd-based signature. In: Proceedings of 7th IEEE international confernce on advanced video and signal based surveillance (AVSS), pp 1–8

  2. Bazzani L, Cristani M, Perina A, Farenzena M, Murino V (2010) Multiple-shot person re-identification by HPE signature. In: 20th international conference on pattern recognition (ICPR)

  3. Bazzani L, Cristani M, Perina A, Murino V (2012) Multipleshot person re-identification by chromatic and epitomic analyses. Pattern Recogn Lett 33:898–903

    Article  Google Scholar 

  4. Bingpeng MA, Su Y, Jurie F (2012) Bicov: A novel image representation for person re-identification and face verification. In: British machine vision conference

  5. Cheng DS, Cristani M, Stoppa M, Bazzani L, Murino V (2011) Custom pictorial structures for re-identification. In: British machine vision conference

  6. Cho Y-J, Yoon K-J (2016) Improving person re-identification via pose-aware multi-shot matching. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1354–1362

  7. Davis JV, Kulis B, Jain PS, Dhillon IS (2007) Information-theoretic metric learning. In: Proceedings of international conference on machine learning

  8. Farenzena M, Bazzani L, Perina A, Murino V, Cristani M (2010) Person re-identification by symmetry-driven accumulation of local features. In: IEEE conference on computer vision and pattern recognition

  9. Gray D, Tao H (2008) Viewpoint invariant pedestrian recognition with an ensemble of localized features. In: European Conference on computer vision. Marseille, France, pp 262–275

  10. Hamdoun O, Moutarde F, Stanciulescu B, Steux B (2008) Person re-identification in multi-camera system by signature based on in-terest point descriptors collected on short video sequences. In: ACM international conference on distributed smart cameras, pp 1–6

  11. Hirzer M, Beleznai C, Roth PM, Bischof H (2011) Person re-identification by descriptive and discriminative classification. In: Proceedings of Scandinavian conference on image analysis (SCIA)

  12. Hirzer M, Roth PM, Bischof H (2012) Person re-identification by efficient metric learning. In: Proceedings IEEE international conference on advanced video and signal-based surveillance

  13. Ijiri Y, Lao S (2012) Human re-identification through distance metric learning based on Jensen-Shannon Kernel. In: Visapp, (c), pp 603–612

  14. Köostinger M, Hirzer M, Wohlhart P, Roth P M, Bischof H (2012) Large scale metric learning from equivalence constraints. In: Proceedings of IEEE conference on computer vision and pattern recognition

  15. Lowe D (2004) Distinctive image features from scale invariant features. Int J Comput Vis 60:91–110

    Article  Google Scholar 

  16. Leng Q, Hu R, Liang C, Wang Y, Chen J (2015) Person re-identification with content and context re-ranking. Multimed Tool Appl 74(17):6989–7014

    Article  Google Scholar 

  17. Liao S, Hu Y, Zhu X, Li SZ (2015) Person re-identification by local maximal occurrence representation and metric learning. In: CVPR, IEEE

  18. Pedagadi S, Orwell J, Velastin S, Boghossian B (2013) Local fisher discriminant analysis for pedestrian re-identification. In: Proceedings of the IEEE computer society conference on computer vision and pattern recognition, pp 3318–3325

  19. Roth PM, Hirzer M, Kstinger M, Beleznai C, Bischof H (2014) Mahalanobis distance learning for person re-identification. Springer, Berlin, pp 247–267

    Book  MATH  Google Scholar 

  20. Schölkopf B, Smola A, Mller K-R (1998) Nonlinear component analysis as a Kernel eigenvalue problem. Neural Comput 10(5):1299–1319

    Article  Google Scholar 

  21. Schwartz W, Davis LS (2009) Learning discriminative appearance-based models using partial least squares. In: Brazilian symposium on computer graphics and image processing

  22. Štruc V, Pavešic N (2009) Gabor-based Kernel partial-least-squares discrimination features for face recognition. Informatica (Vilnius) 20(1):115–138

    MATH  Google Scholar 

  23. Štruc V, Pavešic N (2010) The complete Gabor-Fisher classifier for robust face recognition, EURASIP Adv Signal Process 26

  24. Vedaldi A, Fulkerson B (2008) VLFeat: an open and portable library of computer vision algorithms. http://www.vlfeat.org

  25. Wang T, Gong S, Zhu X, Wang S (2014) Person re-identification by video ranking. In: European Conference on Computer Vision, Zurich, Switzerland, pp 688–703

  26. Weber M, Buml M, Stiefelhagen R (2011) Part-based clothing segmentation for person retrieval. In: 2011 8th IEEE international conference on advanced video and signal based surveillance, AVSS, pp 361–366

  27. Weinberger KQ, Saul LK (2008) Fast solvers and efficient implementations for distance metric learning. In: Proceedings of international conference on machine learning

  28. Xiang ZJ, Chen Q, Liu Y (2014) Person re-identification by fuzzy space colour histogram. Multimed Tool Appl 73(1):91–107

    Article  Google Scholar 

  29. Zheng WS, Gong S, Xiang T (2009) Associating groups of people. In: BMVC

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science and Engineering, Christ University, Bengaluru, 560074, India

    P. K. Sathish

  2. Centre for Incubation, Innovation, Research and Consultancy, Jyothi Institute of Technology, Bengaluru, India

    S. Balaji

Authors
  1. P. K. Sathish
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. S. Balaji
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to P. K. Sathish.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Sathish, P.K., Balaji, S. Multi-frame twin-channel descriptor for person re-identification in real-time surveillance videos. Int J Multimed Info Retr 6, 289–294 (2017). https://doi.org/10.1007/s13735-017-0136-9

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s13735-017-0136-9

Keywords

Search

Navigation