Skip to main content
SpringerLink
Log in

Moving object detection via robust background modeling with recurring patterns voting

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

This paper proposes a simple yet effective background modeling method based on recurring patterns voting for moving object detection under challenging scenes. Our method performs the following two steps. First, we employ Gaussian Mixture Model (GMM) to generate the initial background probability map for each frame, in which the value of each pixel represents its probability belonging to the background. Second, we perform recurring patterns voting by employing the graph-based manifold ranking algorithm on the spatially constrained graph to refine the probability map. This prior bases on the observation that the same patterns tend to recur frequently in same semantic regions (background or foreground). We verify it in our problem by calculating the background-background, foreground-foreground and background-foreground densities on some video sequences with ground truths. Experimental results on public video sequences suggest that the proposed method significantly outperforms other moving object detection methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

References

  1. Achanta R, Shaji A, Smith K et al (2012) SLIC superpixels compared to state-of-the-art superpixel methods. IEEE Trans Pattern Anal Mach Intell 34 (11):2274–2282

    Article  Google Scholar 

  2. Barnich O, Van Droogenbroeck M (2011) ViBe: a universal background subtraction algorithm for video sequences[J]. IEEE Trans Image Process 20(6):1709–1724

  3. Bouttefroy PLM, Bouzerdoum A, Phung SL et al (2010) On the analysis of background subtraction techniques using Gaussian mixture models[C]. In: 2010 IEEE international conference on acoustics speech and signal processing (ICASSP). IEEE, pp 4042–4045

  4. Bouwmans T (2012) Background subtraction for visual surveillance: a fuzzy approach[J]. Handbook Soft Comput Video Surveillance 5:103–138

    Article  Google Scholar 

  5. Candés EJ, Li X, Ma Y et al (2011) Robust principal component analysis?[J]. J ACM (JACM) 58(3):11

    Article  MathSciNet  MATH  Google Scholar 

  6. Chan AB, Mahadevan V, Vasconcelos N (2011) Generalized Stauffer–Grimson background subtraction for dynamic scenes[J]. Mach Vis Appl 22(5):751–766

    Article  Google Scholar 

  7. Dalal N, Triggs B (2005) Histograms of oriented gradients for human detection[C]. In: IEEE computer society conference on computer vision and pattern recognition, CVPR 2005, vol 1. IEEE, pp 886–893

  8. Dempster AP, Laird NM, Rubin DB (1977) Maximum likelihood from incomplete data via the EM algorithm[J]. J R Stat Soc Ser B Methodol 1–38

  9. Derpanis KG, Lecce M, Daniilidis K et al (2012) Dynamic scene understanding: the role of orientation features in space and time in scene classification[C]. In: 2012 IEEE conference on computer vision and pattern recognition (CVPR), vol 2012. IEEE, pp 1306–1313

  10. Faktor A, Irani M (2014) Video segmentation by non-local consensus voting[C]. BMVC 2(7):8

    Google Scholar 

  11. Goyette N, Jodoin PM, Porikli F et al (2012) Changedetection. net: a new change detection benchmark dataset[C]. In: 2012 IEEE computer society conference on computer vision and pattern recognition workshops (CVPRW). IEEE, pp 1–8

  12. Guo C, Liu D, Guo YF et al (2014) An adaptive graph cut algorithm for video moving objects detection[J]. Multimed Tools Appl 72(3):2633

    Article  Google Scholar 

  13. Hammami M, Jarraya SK, Ben-Abdallah H (2013) On line background modeling for moving object segmentation in dynamic scenes[J]. Multimed Tools Appl 1–28

  14. Jalal AS, Singh V (2014) A framework for background modelling and shadow suppression for moving object detection in complex wavelet domain[J]. Multimed Tools Appl 73(2):779

    Article  Google Scholar 

  15. Jian M, Lam KM, Dong J (2014) Facial-feature detection and localization based on a hierarchical scheme[J]. Inf Sci 262:1–14

    Article  Google Scholar 

  16. Jian M, Lam KM, Dong J et al (2015) Visual-patch-attention-aware saliency detection[J]. IEEE Trans Cybern 45(8):1575–1586

    Article  Google Scholar 

  17. KaewTraKulPong P, Bowden R (2002) An improved adaptive background mixture model for real-time tracking with shadow detection[J]. Video-Based Surveillance Syst 1:135–144

    Article  Google Scholar 

  18. Kulchandani JS, Dangarwala KJ (2015) Moving object detection: review of recent research trends[C]. In: 2015 international conference on pervasive computing (ICPC). IEEE, pp 1–5

  19. Li C, Lin L, Zuo W et al (2016) An approach to streaming video segmentation with sub-optimal low-rank decomposition[J]. IEEE Trans Image Process 25(5):1947–1960

    Article  MathSciNet  Google Scholar 

  20. Li C, Lin L, Zuo W et al (2015) Sold: sub-optimal low-rank decomposition for efficient video segmentation[C]. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 5519–5527

  21. Li C, Wang X, Zhang L et al (2017) Weighted low-rank decomposition for robust grayscale-thermal foreground detection[J]. IEEE Trans Circuits Syst Video Technol 27(4):725–738

    Article  Google Scholar 

  22. Li L, Huang W, Gu IYH et al (2004) Statistical modeling of complex backgrounds for foreground object detection[J]. IEEE Trans Image Process 13(11):1459–1472

    Article  Google Scholar 

  23. Liu X, Xu Q, Ma J et al (2014) MsLRR: a unified multiscale low-rank representation for image segmentation[J]. IEEE Trans Image Process 23(5):2159–2167

    Article  MathSciNet  MATH  Google Scholar 

  24. Pilet J, Strecha C, Fua P (2008) Making background subtraction robust to sudden illumination changes[J]. In: Computer vision–ECCV 2008, pp 567–580

  25. Shakeri M, Zhang H (2016) COROLA: a sequential solution to moving object detection using low-rank approximation[J]. Comput Vis Image Underst 146:27–39

    Article  Google Scholar 

  26. Song J, Gao L, Nie F et al (2016) Optimized graph learning using partial tags and multiple features for image and video annotation[J]. IEEE Trans Image Process 25 (11):4999–5011

    Article  MathSciNet  Google Scholar 

  27. Stauffer C, Grimson WEL (1999) Adaptive background mixture models for real-time tracking[C]. In: IEEE computer society conference on computer vision and pattern recognition, vol 2. IEEE, pp 246–252

  28. Yubing T, Cheikh FA, Guraya FFE et al (2011) A spatiotemporal saliency model for video surveillance[J]. Cogn Comput 3(1):241–263

    Article  Google Scholar 

  29. Tu Z, Abel A, Zhang L et al (2016) A new spatio-temporal saliency-based video object segmentation[J]. Cogn Comput 4(8):629–647

    Article  Google Scholar 

  30. Walha A, Wali A, Alimi AM (2015) Video stabilization with moving object detecting and tracking for aerial video surveillance[J]. Multimed Tools Appl 74(17):6745

    Article  Google Scholar 

  31. Wren CR, Azarbayejani A, Darrell T et al (1997) Pfinder: real-time tracking of the human body[J]. IEEE Trans Pattern Anal Mach Intell 19(7):780–785

    Article  Google Scholar 

  32. Xu D, Ricci E, Yan Y et al (2015) Learning deep representations of appearance and motion for anomalous event detection[J]. arXiv:1510.01553

  33. Zheng A, Zhang L, Zhang W et al (2017) Local-to-global background modeling for moving object detection from non-static cameras[J]. Multimed Tools Appl 76(8):11003–11019

    Article  Google Scholar 

  34. Zhou D, Weston J, Gretton A et al (2004) Ranking on data manifolds[C]. In: Advances in neural information processing systems, pp 169–176

  35. Zhou X, Yang C, Yu W (2013) Moving object detection by detecting contiguous outliers in the low-rank representation[J]. IEEE Trans Pattern Anal Mach Intell 35 (3):597–610

    Article  Google Scholar 

Download references

Acknowledgments

This work was supported in part by the National Natural Science Foundation of China under Grant 61472002, in part by the Natural Science Foundation of Anhui Higher Education Institution of China under Grant KJ2017A017 and in part by the Co-Innovation Center for Information Supply & Assurance Technology of Anhui University under Grant Y01002449.

Author information

Authors and Affiliations

  1. School of Computer Science and Technology, Anhui University, Hefei, 230601, China

    Chenglong Li, Zhimin Bao, Xiao Wang & Jin Tang

Authors
  1. Chenglong Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Zhimin Bao
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Xiao Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jin Tang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Chenglong Li.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Li, C., Bao, Z., Wang, X. et al. Moving object detection via robust background modeling with recurring patterns voting. Multimed Tools Appl 77, 13557–13570 (2018). https://doi.org/10.1007/s11042-017-4975-4

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-017-4975-4

Keywords

Search

Navigation