Skip to main content
SpringerLink
Log in

Low illumination person re-identification

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Low illumination is a common problem for recognition and tracking. Low illumination video-based person re identification (re-id) is an important application in practice. Low illumination usually results in severe loss of visual appearance and space-time information contained in pedestrian image or video, which brings large difficulty to re-identification. However, the problem of low illumination video-based person re-id (LIVPR) has not been well studied. In this paper, we propose a novel triplet-based manifold discriminative distance learning (TMD2L) approach for LIVPR. By regarding each video as an image set, TMD2L aims to learn a manifold-based distance metric, under which the intrinsic structure of image sets can be preserved, and the distance between truly matching sets is smaller than that between wrong matching sets. Experiment results on the new collected low illumination person sequence (LIPS) dataset, as well as two simulated datasets LI-PRID 2011 and LI-iLIDS-VID show that our proposed approach TMD2L outperforms existing representative person re-id methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15

Similar content being viewed by others

Notes

  1. https://sites.google.com/site/whulips

References

  1. Chen J, Wang Y, Tang YY (2016) Person re-identification by exploiting spatio-temporal cues and multi-view metric learning. IEEE Signal Process Lett 23 (7):998–1002

    Article  Google Scholar 

  2. Farenzena M, Bazzani L, Perina A, Murino V, Cristani M (2010) Person re-identification by symmetry-driven accumulation of local features. In: IEEE Conference on computer vision and pattern recognition (CVPR), pp 2360–2367

  3. Gong S, Cristani M, Yan S, Loy CC (2014) Person re-identification. Springer

  4. Hirzer M, Beleznai C, Roth PM, Bischof H (2011) Person re-identification by descriptive and discriminative classification. In: Scandinavian conference on image analysis, pp 91–102

  5. Hirzer M, Roth P, Koestinger M, Bischof H (2012) Relaxed pairwise learned metric for person re-identification. In: European Conference on computer vision (ECCV), pp 780–793

  6. Hu H (2015) Sparse discriminative multimanifold Grassmannian analysis for face recognition with image sets. IEEE Trans Circ Syst Vid Technol 25(10):1599–1611

    Article  Google Scholar 

  7. Jing X-Y, Zhu X, Wu F, Hu R, You X, Wang Y, Feng H, Yang J-Y (2017) Super-resolution person re-identification with semi-coupled low-rank discriminant dictionary learning. IEEE Trans Image Process 26(3):1363–1378

    Article  MathSciNet  Google Scholar 

  8. Kim T-K, Arandjelovic O, Cipolla R (2007) Boosted manifold principal angles for image set-based recognition. Pattern Recogn 40(9):2475–2484

    Article  Google Scholar 

  9. Koestinger M, Koestinger M, Wohlhart P, Roth PM, Bischof H (2012) Large scale metric learning from equivalence constraints. In: IEEE Conference on computer vision and pattern recognition (CVPR), pp 2288–2295

  10. Kviatkovsky I, Adam A, Rivlin E (2013) Color invariants for person reidentification. IEEE Trans Pattern Anal Mach Intell 35(7):1622–1634

    Article  Google Scholar 

  11. Li W, Zhao R, Xiao T, Wang X (2014) Deepreid: deep filter pairing neural network for person re-identification. In: IEEE Conference on computer vision and pattern recognition (CVPR), pp 152–159

  12. Li X, Zheng W-S, Wang X, Xiang T, Gong S (2015) Multi-scale learning for low-resolution person re-identification. In: IEEE Conference on computer vision (ICCV), pp 3765–3773

  13. Liao S, Hu Y, Zhu X, Li SZ (2015) Person re-identification by local maximal occurrence representation and metric learning. In: IEEE Conference on computer vision and pattern recognition (CVPR), pp 2197–2206

  14. Lin T, Zha H (2008) Riemannian manifold learning. IEEE Trans Pattern Anal Mach Intell 30(5):796–809

    Article  Google Scholar 

  15. Lisanti G, Masi I, Bagdanov AD, Del Bimbo A (2015) Person re-identification by iterative re-weighted sparse ranking. IEEE Trans Pattern Anal Mach Intell 37 (8):1629–1642

    Article  Google Scholar 

  16. Liu H, Qi M, Jiang J (2015) Kernelized relaxed margin components analysis for person re-identification. IEEE Signal Process Lett 22(7):910–914

    Article  Google Scholar 

  17. Liu K, Ma B, Zhang W, Huang R (2015) A spatio-temporal appearance representation for viceo-based pedestrian re-identification. In: IEEE Conference on computer vision (ICCV), pp 3810–3818

  18. Liu M, Shan S, Wang R, Chen X (2016) Learning expressionlets via universal manifold model for dynamic facial expression recognition. IEEE Trans Image Process 25(12):5920–5932

    Article  MathSciNet  Google Scholar 

  19. Lu Y, Wang R, Shan S, Chen X (2016) Multiple-shot person re-identification via Riemannian discriminative learning. In: Asian Conference on computer vision. Springer (ACCV), pp 408–425

  20. McLaughlin N, Martinez del Rincon J, Miller P (2016) Recurrent convolutional network for video-based person re-identification. In: IEEE Conference on computer vision and pattern recognition (CVPR), pp 1325–1334

  21. Rao Y, Hou L, Wang Z, Chen L (2014) Illumination-based nighttime video contrast enhancement using genetic algorithm. Multimed Tools Appl 70(3):2235–2254

    Article  Google Scholar 

  22. Sun C, Wang D, Lu H (2017) Person re-identification via distance metric learning with latent variables. IEEE Trans Image Process 26(1):23–34

    Article  MathSciNet  Google Scholar 

  23. Tao D, Li X, Wu X, Maybank SJ (2007) General tensor discriminant analysis and Gabor features for gait recognition. IEEE Trans Pattern Anal Mach Intell 29(10):1700–1715

    Article  Google Scholar 

  24. Tao D, Guo Y, Song M, Li Y, Yu Z, Tang YY (2016) Person re-identification by dual-regularized kiss metric learning. IEEE Trans Image Process 25 (6):2726–2738

    Article  MathSciNet  Google Scholar 

  25. Thompson WB, Shirley P, Ferwerda JA (2002) A spatial post-processing algorithm for images of night scenes. J Graph Tools 7(1):1–12

    Article  Google Scholar 

  26. Tunç B, Gökmen M (2011) Manifold learning for face recognition under changing illumination. Telecommun Syst 47(3–4):185–195

    Article  Google Scholar 

  27. Turk M, Pentland A (1991) Eigenfaces for recognition. J Cogn Neurosci 3 (1):71–86

    Article  Google Scholar 

  28. Wang R, Chen X (2009) Manifold discriminant analysis. In: IEEE Conference on computer vision and pattern recognition (CVPR), pp 429–436

  29. Wang X, Doretto G, Sebastian T, Rittscher J, Tu P (2007) Shape and appearance context modeling. In: IEEE Conference on computer vision (ICCV), pp 1–8

  30. Wang R, Shan S, Chen X, Gao W (2008) Manifold-manifold distance with application to face recognition based on image set. In: IEEE Conference on computer vision and pattern recognition (CVPR), pp 1–8

  31. Wang T, Gong S, Zhu X, Wang S (2014) Person re-identification by video ranking. In: European Conference on computer vision (ECCV), pp 688–703

  32. Wang W, Wang R, Huang Z, Shan S, Chen X (2015) Discriminant analysis on Riemannian manifold of Gaussian distributions for face recognition with image sets. In: IEEE Conference on computer vision and pattern recognition (CVPR), pp 2048–2057

  33. Wang F, Zuo W, Lin L, Zhang D, Zhang L (2016) Joint learning of single-image and cross-image representations for person re-identification. In: IEEE Conference on computer vision and pattern recognition (CVPR), pp 1288–1296

  34. Wang Z, Hu R, Yu Y, Jiang J, Liang C, Wang J (2016) Scale-adaptive low-resolution person re-identification via learning a discriminating surface. IJCAI, pp 2669–2675

  35. Wen J, Fowler JE, He M, Zhao Y-Q, Deng C, Menon V (2016) Orthogonal nonnegative matrix factorization combining multiple features for spectral–spatial dimensionality reduction of hyperspectral imagery. IEEE Trans Geosci Remote Sens 54(7):4272–4286

    Article  Google Scholar 

  36. Xiao T, Li H, Ouyang W, Wang X (2016) Learning deep feature representations with domain guided dropout for person re-identification. In: IEEE Conference on computer vision and pattern recognition (CVPR), pp 1249–1258

  37. Xiong F, Gou M, Camps O, Sznaier M (2014) Person re-identification using kernel-based metric learning methods. In: European Conference on computer vision (ECCV), pp 1–16

  38. Yan Y, Ni B, Song Z, Ma C, Yan Y, Yang X (2016) Person re-identification via recurrent feature aggregation. In: European Conference on computer vision (ECCV), pp 701–716

  39. Yang Y, Yang J, Yan J, Liao S, Yi D, Li SZ (2014) Salient color names for person re-identification. In: European Conference on computer vision (ECCV), pp 536–551

  40. You J, Wu A, Li X, Zheng W-S (2016) Top-push video-based person re-identification. In: IEEE Conference on computer vision and pattern recognition (ICCV), pp 1345–1353

  41. Zhang R, Lin L, Zhang R, Zuo W, Zhang L (2015) Bit-scalable deep hashing with regularized similarity learning for image retrieval and person re-identification. IEEE Trans Image Process 24(12):4766–4779

    Article  MathSciNet  Google Scholar 

  42. Zhao R, Ouyang W, Wang X (2013) Person re-identification by salience matching. In: IEEE Conference on computer vision (ICCV), pp 2528–2535

  43. Zhao R, Ouyang W, Wang X (2013) Unsupervised salience learning for person re-identification. In: IEEE Conference on computer vision and pattern recognition (CVPR), pp 3586–3593

  44. Zhao R, Ouyang W, Wang X (2014) Learning mid-level filters for person re-identification. In: IEEE Conference on computer vision and pattern recognition (CVPR), pp 144–151

  45. Zheng W-S, Gong S, Xiang T (2013) Reidentification by relative distance comparison. IEEE Trans Pattern Anal Mach Intell 35(3):653–668

    Article  Google Scholar 

  46. Zhou Q, Zheng S, Ling H, Su H, Wu S (2017) Joint dictionary and metric learning for person re-identification. Pattern Recogn, 196–206

  47. Zhu X, Jing X-Y, Wu F, Feng H (2016) Video-based person re-identification by simultaneously learning intra-video and inter-video distance metrics. In: International joint conference on artificial intelligence, pp 3552–3559

  48. Zhu X, Jing X-Y, Wu F, Wang Y, Zuo W, Zheng W-S (2017) Learning heterogeneous dictionary pair with feature projection matrix for pedestrian video retrieval via single query image. In: Association for the advancement of artificial intelligence (AAAI), pp 4341–4348

Download references

Author information

Authors and Affiliations

  1. School of Computer Science, Wuhan University, Wuhan, 430072, China

    Fei Ma, Xinyu Zhang, Liang Yang, Mei Zuo & Xiao-Yuan Jing

  2. School of Computer and Information Engineering, Henan University, Kaifeng, 475001, China

    Xiaoke Zhu

Authors
  1. Fei Ma
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Xiaoke Zhu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Xinyu Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Liang Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Mei Zuo
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Xiao-Yuan Jing
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Xiao-Yuan Jing.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ma, F., Zhu, X., Zhang, X. et al. Low illumination person re-identification. Multimed Tools Appl 78, 337–362 (2019). https://doi.org/10.1007/s11042-018-6239-3

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-018-6239-3

Keywords

Search

Navigation