Abstract
Background subtraction in complex scenes is a challenging problem of computer vision. Most existing algorithms analyze the variation in pixels or regions for background subtraction. Unfortunately, these works ignoring the neighborhood information or similarity among pixels and do not work well in complex scenes. To solve this problem, a novel background subtraction method based on SuperPixels under Multi-Scale (SPMS) is proposed. In SPMS, the foreground consists of superpixels with foreground or background label, which decided by the statistic of its variation. The variation in superpixels is robust to noise and environmental changes, which endows the SPMS with the ability to work in extreme environment such as adverse weather and dynamic scenes. Finally, the summary of foregrounds under multiple scales improve the accuracy of the proposed approach. The experiments on standard benchmarks demonstrate encouraging performance of the proposed approach in comparison with several state-of-the-art algorithms.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Achanta, R., Shaji, A., Smith, K., Lucchi, A., Fua, P., Susstrunk, S.: SLIC superpixels compared to state-of-the-art superpixel methods. IEEE Trans. Pattern Anal. Mach. Intell. 34(11), 2274–2282 (2012)
Bouwmans, T.: Traditional and recent approaches in background modeling for foreground detection: an overview. Comput. Sci. Rev. 1112, 31–66 (2014)
Wren, C., Azarbayejani, A., Darrell, T., Pentland, A.: Pfinder: realtime tracking of the human body. IEEE Trans. Pattern Anal. Mach. Intell. 19(7), 780–785 (1997)
Stauffer, C., Grimson, W.: Adaptive background mixture models for real-time tracking. Proc. IEEE Conf. Comput. Vis. Pattern Recognit. 2, 252 (1999)
Kim, K., Chalidabhongse, T., Harwood, D., Davis, L.: Background modeling and subtraction by codebook construction. In: Proceedings of International Conference on Image Processing, vol. 5, pp. 3061–3064, October 2004
Kim, K., Chalidabhongse, T.H., Harwood, D., Davis, L.: Real-time foreground-background segmentation using codebook model. Real-Time Imaging 11, 172–185 (2005)
Barnich, O., Van Droogenbroeck, M.: ViBe: a powerful random technique to estimate the background in video sequences. In: Proceedings of IEEE International Conference on Acoustics Speech Signal Processing, pp. 945–948, April 2009
Barnich, O., Droogenbroeck, M.V.: ViBe: a universal background subtraction algorithm for video sequences. IEEE Trans. Image Process. 20(6), 1709–1724 (2011)
Heikkila, M., Pietikainen, M.: A texture-based method for modeling the background and detecting moving objects. IEEE Trans. Pattern Anal. Mach. Intell. 28(4), 657–662 (2006)
Kita, Y.: Background modeling by combining joint intensity histogram with time-sequential data. In: Proceedings of International Conference on Pattern Recognition, pp. 991–994, August 2010
Kuo, C.M., Chang, W.H., Wang, S.B., Liu, C.S.: An efficient histogram-based method for background modeling. In: Proceedings of IEEE International Conference on Innovation Computing, Information and Control, pp. 480–483 (2009)
Liao, S., Zhao, G., Kellokumpu, V., et al.: Modeling pixel process with scale invariant local patterns for background subtraction in complex scenes. In: 2010 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1301-1306 (2010)
Yeh, C.H., Lin, C.Y., Muchtar, K., Kang, L.W.: Real-time background modeling based on a multi-level texture description. Inf. Sci. 269, 106–127 (2014)
Riahi, D., St-Onge, P., Bilodeau, G.: RECTGAUSS-Tex: blockbased background subtraction. In: Proce Dept. genie Inform. genie logiciel, Ecole Polytechn. Montr. Montr. QC, Canada, pp. 1–9 (2012)
Lin, L., Xu, Y., Liang, X., Lai, J.: Complex background subtraction by pursuing dynamic spatio-temporal models. IEEE Trans. Image Process. 23(7), 3191–3202 (2014)
Chiranjeevi, P., Sengupta, S.: Neighborhoodhood supported model level fuzzy aggregation for moving object segmentation. IEEE Trans. Image Process. 2, 645–657 (2014)
Zaharescu, A., Jamieson, M.: Multi-scale multi-feature codebookbased background subtraction. In: Proceedings of IEEE International Conference on Computer Vision Work, pp. 1753–1760 (2011)
Yao, J.Y.J., Odobez, J.-M.: Multi-layer background subtraction based on color and texture. In: Proceedings of IEEE Conference on Computer Vision Pattern Recognition, pp. 1–8 (2007)
Wang, Y., Jodoin, P.-M., Porikli, F., Konrad, J., Benezeth, Y., Ishwar, P.: CDnet 2014: an expanded change detection benchmark dataset. In: Proceedings of IEEE Workshop on Change Detection (CDW-2014) at CVPR-2014, pp. 387-394 (2014)
Lu, X.: A multiscale spatio-temporal background model for motion detection. In: Proceedings of IEEE International Conference on Image Processing, pp. 3268–3271 (2014)
Varadarajan, S., Miller, P., Zhou, H.: Spatial mixture of Gaussians for dynamic background modelling. In: Proceedings IEEE International Conference on Advance Video Signal Based Surveillance, pp. 63–68 (2013)
Van Droogenbroeck, M., Paquot, O.: Background subtraction: experiments and improvements for ViBe. In: IEEE Conference on Computer Vision and Pattern Recognition Work, pp. 32–37 (2012)
Varadarajan, S., Miller, P., Zhou, H.: Spatial mixture of Gaussians for dynamic background modelling. In: 2013 10th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), pp. 63–68, 27–30 August 2013
Zhu, W., Liang, S., Wei, Y., Sun, J.: Saliency optimization from robust background detection. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2814–2821, June 2014
Patwardhan, K., Sapiro, G., Morellas, V.: Robust foreground detection in video using pixel layers. IEEE Trans. Pattern Anal. Mach. Intell. 30(4), 746–751 (2008)
Wu, Y., He, X., Nguyen, T.: Moving objects detection with freely moving camera via background motion subtraction. IEEE Trans. Circuits Syst. Video Technol. PP(99), 1–1 (2015)
Zivkovic, Z.: Improved adaptive Gaussian mixture model for background subtraction. In: Proceedings of International Conference on Pattern Recognition, vol. 2 (2004)
Wu, L., Zhang, Z., Wang, Y., Liu, Q.: A segmentation based change detection method for high resolution remote sensing image. In: Li, S., Liu, C., Wang, Y. (eds.) CCPR 2014, Part I. CCIS, vol. 483, pp. 314–324. Springer, Heidelberg (2014)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Zhao, C. et al. (2016). Background Subtraction Based on Superpixels Under Multi-scale in Complex Scenes. In: Tan, T., Li, X., Chen, X., Zhou, J., Yang, J., Cheng, H. (eds) Pattern Recognition. CCPR 2016. Communications in Computer and Information Science, vol 662. Springer, Singapore. https://doi.org/10.1007/978-981-10-3002-4_33
Download citation
DOI: https://doi.org/10.1007/978-981-10-3002-4_33
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-10-3001-7
Online ISBN: 978-981-10-3002-4
eBook Packages: Computer ScienceComputer Science (R0)