Skip to main content
SpringerLink
Log in

People re-identification under occlusion and crowded background

  • 1200: Machine Vision Theory and Applications for Cyber Physical Systems
  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

A Correction to this article was published on 02 June 2022

This article has been updated

Abstract

The performance of video surveillance systems with network cameras depends on their accuracy in people re-identification. Body occlusion, crowded background, and variations in scene illumination and pose are challenging issues in people re-identification. In this paper, a technique is proposed to improve the performance of re-identification approaches using (a) a pre-processing step; and (b) a proposed weighing mechanism. In this approach, first, the input image is segmented into the person’s body, background, and possible carried objects. Then, considering the image’s segments, the occluded parts of the body are retrieved using their neighboring pixels. The processed image is transformed into the log chromatically color space which is robust to scene illumination changes. Using the transformed images along with descriptors which are robust to appearance changes such as Gaussian of Gaussian (GOG) and Hierarchical Gaussian Descriptor (HGD) can improve performance of the descriptors. In this paper, the GOG and HGD are used in a weighed form to represent the pre-processed images considering the importance of each segment of the images in people re-identification. The proposed re-identification system is evaluated using VIPeR and PRID450s datasets, where it respectively achieves 61.9% and 83.4% rank-1 matching rates. Experimental results show that our proposed approach outperforms other existing approaches in people re-identification.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

Change history

References

  1. Berwick D, Lee S (1998) A chromaticity space for specularity, illumination color- and illumination pose-invariant 3-D object recognition. 6th International Conference on Computer Vision. Bombay, pp. 165–170

  2. Bosch A, Zisserman A, Munoz X (2007) Representing shape with a spatial pyramid kernel. In Proceedings of the 6th ACM international conference on image and video retrieval. Amsterdam, pp. 401–408

  3. Bromley J, Bentz JW, Bottou L, Guyon I, LeCun Y, Moore C, Sackinger E, Shah R (1993) Signature verification using a “Siamese” time delay neural network. Int J Pattern Recognit Artif Intell 7(4):669–688

    Article  Google Scholar 

  4. Cao Z, Simon T, Wei SE, Sheikh Y (2017) Realtime multi-person 2d pose estimation using part affinity fields. In: Proceedings of the IEEE conference on computer vision and pattern recognition. Honolulu, pp 7291–7299

  5. Chu H, Qi M, Liu H, Jiang J (2019) Local region partition for person re-identification. Multimed Tools Appl 78:27067–27083

    Article  Google Scholar 

  6. Delac K, Grgic M, Grgic CS. (2005) Statistics in face recognition: analyzing probability distributions of PCA, ICA and LDA performance results. In: ISPA 2005. Proceedings of the 4th IEEE International Symposium on Image and Signal Processing and Analysis. Zagreb, pp. 289–294

  7. Feizi A (2019) Convolutional gating network for object tracking. Int J Eng 32(7):931–939

    Google Scholar 

  8. Finlayson G, Drew M, Funt B (1993) Diagonal transforms suffice for color constancy. 4th International Conference on Computer Vision. Berlin, pp 164–171

  9. Finlayson G, Drew M, Funt B (1994) Spectral sharpening: sensor transformations for improved color Constancy. J Optic Soc Am A 11(5):1553–1563

    Article  Google Scholar 

  10. Gray D, Tao H (2008) Viewpoint invariant pedestrian recognition with an ensemble of localized features. In: European Conference on Computer Vision. Springer, Berlin, pp 262–275

    Google Scholar 

  11. Guo R, Li CG, Li Y, Lin J, Guo J (2020) Density-adaptive kernel based efficient reranking approaches for person reidentification. Neurocomputing 411:91–111

    Article  Google Scholar 

  12. Harel J, Koch C, Perona P (2007) Graph-based visual saliency. In: Advances in neural information processing systems. Vancouver, pp 545–552

  13. He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Las Vegas, pp. 770–778

  14. Huang H, Li D, Zhang Z, Chen X, Huang K (2018) Adversarially occluded samples for person re-identification. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Salt Lake City, pp 5098–5107

  15. Jia J, Ruan Q, Jin Y, An G, Ge S (2020) View-specific subspace learning and re-ranking for semi-supervised person re-identification. Pattern Recogn 108:107568

    Article  Google Scholar 

  16. Kong J, Teng Z, Jiang M, Huo H (2020) Video-based person re-identification with parallel spatial–temporal attention module. J Electron Imaging 29(1):013001

    Article  Google Scholar 

  17. Kviatkovsky I, Adam A, Rivlin E (2012) Color invariants for person reidentification. IEEE Trans Pattern Anal Mach Intell 35(7):1622–1634

    Article  Google Scholar 

  18. Leng Q (2018) Co-metric learning for person re-identification. Adv Multimed. https://doi.org/10.1155/2018/3586191

  19. Li P, Wang Q, Zhang L (2013) A novel earth mover’s distance methodology for image matching with gaussian mixture models. In: Proceedings of the IEEE International Conference on Computer Vision. Sydney, (pp 1689–1696)

  20. Liao S, Zhao G, Kellokumpu V, Pietikäinen M, Li SZ (2010) Modeling pixel process with scale invariant local patterns for background subtraction in complex scenes. In: 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. San Francisco, pp 1301–1306

  21. Liao S, Hu Y, Zhu X, Li SZ (2015) Person re-identification by local maximal occurrence representation and metric learning. In: Proceedings of the IEEE conference on computer vision and pattern recognition. Boston, pp 2197–2206

  22. Liu Y, Zhang Y, Coleman S, Bhanu B, Liu S (2020) A new patch selection method based on parsing and saliency detection for person re-identification. Neurocomputing 374:86–99

    Article  Google Scholar 

  23. Lovri’c M, Min-Oo M, Ruh EA (2000) Multivariate normal distributions parametrized as a Riemannian symmetric space. J Multivar Anal 74(1):36–48

    Article  MathSciNet  Google Scholar 

  24. Matsukawa T, Suzuki E (2016) Person re-identification using CNN features learned from combination of attributes. In: 2016 23rd International Conference on Pattern Recognition (ICPR). Cancun, pp 2428–2433

  25. Matsukawa T, Okabe T, Suzuki E, Sato Y (2016) Hierarchical gaussian descriptor for person re-identification. In: Proceedings of the IEEE conference on computer vision and pattern recognition. Las Vegas, pp. 1363–1372.

  26. Matsukawa T, Okabe T, Suzuki E, Sato Y (2019) Hierarchical gaussian descriptors with application to person re-identification. IEEE Trans Pattern Anal Mach Intell 42(9):2179–2194

    Article  Google Scholar 

  27. Miao J, Wu Y, Liu P, Ding Y, Yang Y (2019) Pose-guided feature alignment for occluded person re-identification. In: Proceedings of the IEEE International Conference on Computer Vision. Seoul, pp 542–551

  28. Mortezaie Z, Hassanpour H (2019) A survey on age-invariant face recognition methods. Jordan J Comput Inform Technol (JJCIT) 5(02):87–96

    Google Scholar 

  29. Prates R, Schwartz WR (2019) Kernel cross-view collaborative representation based classification for person re-identification. J Vis Commun Image Represent 58:304–315

    Article  Google Scholar 

  30. Prates R, Schwartz WR (2019) Matching people across surveillance cameras. In: Anais Estendidos da XXXII Conference on Graphics, Patterns and Images. SBC, pp. 84–90

  31. Ren QQ, Tian WD, Zhao ZQ (2019) Person re-identification based on feature fusion. In: International Conference on Intelligent Computing. Springer, Cham, pp 65–73

    Google Scholar 

  32. Roth PM, Hirzer M, Köstinger M, Beleznai C, Bischof H (2014) Mahalanobis distance learning for person re-identification. In: Advances in computer vision and pattern recognition. Springer, London, pp 247–267

    Google Scholar 

  33. Sadatnejad K, Shiry Ghidari S, Rahmati M (2018) A geometry preserving kernel over Riemannian manifolds. J AI Data Min 6(2):321–334

    Google Scholar 

  34. Tian M, Yi S, Li H, Li S, Zhang X, Shi J, Yan J, Wang X (2018) Eliminating background-bias for robust person re-identification. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Salt Lake City, pp. 5794–5803

  35. Vishwakarma DK, Upadhyay S (2018) A deep structure of person re-identification using multi-level gaussian models. IEEE Trans Multi-Scale Comput Syst 4(4):513–521

    Article  Google Scholar 

  36. Wang GA, Yang S, Liu H, Wang Z, Yang Y, Wang S, Yu G, Zhou E, Sun J (2020) High-order information matters: learning relation and topology for occluded person re-identification. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Seattle, pp 6449–6458

  37. Xu Y, Fang X, Wu J, Li X, Zhang D (2015) Discriminative transfer subspace learning via low-rank and sparse representation. IEEE Trans Image Process 25(2):850–863

    Article  MathSciNet  Google Scholar 

  38. Yang Y, Yang J, Yan J, Liao S, Yi D, Li SZ (2014) Salient color names for person re-identification. In: European Conference on Computer Vision. Springer, Cham, pp 536–551

    Google Scholar 

  39. Yao H, Zhang S, Hong R, Zhang Y, Xu C, Tian Q (2019) Deep representation learning with part loss for person re-identification. IEEE Trans Image Process 28(6):2860–2871

    Article  MathSciNet  Google Scholar 

  40. Zhang X, Yan Y, Xue JH, Hua Y, Wang H (2020) Semantic-aware occlusion-robust network for occluded person re-identification. IEEE Trans Circ Syst Video Technol 31(7):2764–2778

    Article  Google Scholar 

  41. Zhang Z, Lan C, Zeng W, Jin X, Chen Z (2020) Relation-aware global attention for person re-identification. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Seattle, pp. 3186–3195

  42. Zhao R, Ouyang W, Wang X (2014) Learning mid-level filters for person re-identification. In: Proceedings of the IEEE conference on computer vision and pattern recognition. Columbus, pp. 144–151

  43. Zhao R, Oyang W, Wang X (2016) Person re-identification by saliency learning. IEEE Trans Pattern Anal Mach Intell 39(2):356–370

    Article  Google Scholar 

  44. Zhao H, Tian M, Sun S, Shao J, Yan J, Yi S, Wang X, Tang X (2017) Spindle net: person re-identification with human body region guided feature decomposition and fusion. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Honolulu, pp 1077–1085

  45. Zhao C, Wang X, Zuo W, Shen F, Shao L, Miao D (2020) Similarity learning with joint transfer constraints for person re-identification. Pattern Recogn 97:107014

    Article  Google Scholar 

  46. Zhou Q, Fan H, Zheng S, Su H, Li X, Wu S, Ling H (2018) Graph correspondence transfer for person re-identification. In: Thirty-second AAAI Conference on Artificial Intelligence (AAAI-18). New Orleans, pp 7599–7606

  47. Zhou Q, Fan H, Yang H, Su H, Zheng S, Wu S, Ling H (2019) Robust and efficient graph correspondence transfer for person re-identification. IEEE Trans Image Process 30:1623–1638

    Article  Google Scholar 

  48. Zhu J, Zeng H, Huang J, Zhu X, Lei Z, Cai C, Zheng L (2020) Body symmetry and part-locality-guided direct nonparametric deep feature enhancement for person reidentification. IEEE Internet Things J 7(3):2053–2065

    Article  Google Scholar 

  49. Zhuo J, Chen Z, Lai J, Wang G (2018) Occluded person re-identification. In: IEEE International Conference on Multimedia and Expo (ICME). San Diego, pp 1–6

  50. Megrhi S, Jmal M, Souidene W, Beghdadi A (2016) Spatio-temporal action localization and detection for human action recognition in big dataset, Journal of Visual Communication and Image Representation, 41:375–390

  51. Bouttefroy PLM, Bouzerdoum A, Phung SL, Beghdadi A (2009) Vehicle Tracking Using Projective Particle Filter, 6th IEEE International Conference on Advanced Video and Signal Based Surveillance, pp 7–12

  52. Mortezaie Z, Hassanpour H, Beghdadi A (2021) A Color-Based Re-Ranking Process for People Re-Identification: Paper ID 21. 9th IEEE European Workshop on Visual Information Processing (EUVIP), pp. 1–5

  53. Chen LC, Zhu Y, Papandreou G, Schroff F, Adam H (2018) Encoder-decoder with atrous separable convolution for semantic image segmentation. In Proceedings of the European conference on computer vision (ECCV), pp. 801–818

  54. Parraga CA, Akbarinia A (2016) NICE: A computational solution to close the gap from colour perception to colour categorization. PloS one, 11(3), p.e0149538

Download references

Author information

Authors and Affiliations

  1. Faculty of Computer Engineering, Shahrood University of Technology, Shahrood, Iran

    Zahra Mortezaie & Hamid Hassanpour

  2. Institut Galilée Université Sorbonne Paris Nord, Villetaneuse, France

    Azeddine Beghdadi

Authors
  1. Zahra Mortezaie
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Hamid Hassanpour
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Azeddine Beghdadi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Hamid Hassanpour.

Ethics declarations

The authors have no funding, and potential conflicts of interest (financial or non-financial). Also, the research does not involve human participants, and animals.

Conflict of interest

The authors have no conflicts of interest to declare that are relevant to the content of this article.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

The original online version of this article was revised: The original publication of this article contains errors in references and equations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Mortezaie, Z., Hassanpour, H. & Beghdadi, A. People re-identification under occlusion and crowded background. Multimed Tools Appl 81, 22549–22569 (2022). https://doi.org/10.1007/s11042-021-11868-y

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-021-11868-y

Keywords

Search

Navigation