Abstract
We propose an adaptive model for backgrounds containing significant stochastic motion (e.g. water). The new model is based on a generalization of the Stauffer–Grimson background model, where each mixture component is modeled as a dynamic texture. We derive an online K-means algorithm for updating the parameters using a set of sufficient statistics of the model. Finally, we report on experimental results, which show that the proposed background model both quantitatively and qualitatively outperforms state-of-the-art methods in scenes containing significant background motions.
Similar content being viewed by others
References
Sheikh Y., Shah M.: Bayesian modeling of dynamic scenes for object detection. IEEE Trans. PAMI 27(11), 1778–1792 (2005)
Stauffer, C., Grimson, W.: Adaptive background mixture models for real-time tracking. In: CVPR, pp. 246–52 (1999)
Doretto G., Chiuso A., Wu Y.N., Soatto S.: Dynamic textures. Int. J. Comp. Vis. 51(2), 91–109 (2003)
Saisan, P., Doretto, G., Wu, Y., Soatto, S.: Dynamic texture recognition. In: IEEE Conference Computer Vision and Pattern Recognition, vol. 2, pp. 58–63 (2001)
Chan, A.B., Vasconcelos, N.: Probabilistic kernels for the classification of auto-regressive visual processes. In: IEEE Conference Computer Vision and Pattern Recognition, vol. 1, pp. 846–851 (2005)
Doretto, G., Cremers, D., Favaro, P., Soatto, S.: Dynamic texture segmentation. In: IEEE International Conference Computer Vision, vol. 2, pp. 1236–1242 (2003)
Chan, A.B., Vasconcelos, N.: Mixtures of dynamic textures. In: IEEE International Conference Computer Vision, vol. 1, pp. 641–647 (2005)
Fitzgibbon, A.W.: Stochastic rigidity: image registration for nowhere-static scenes. In: IEEE International Conference Computer Vision, vol. 1, pp. 662–670 (2001)
Zhong, J., Sclaroff, S.: Segmenting foreground objects from a dynamic textured background via a robust Kalman filter. In: ICCV (2003)
Monnet, A., Mittal, A., Paragios, N., Ramesh, V.: Background modeling and subtraction of dynamic scenes. In: CVPR (2003)
Chan A.B., Vasconcelos N.: Modeling, clustering, and segmenting video with mixtures of dynamic textures. IEEE Trans. Pattern Anal. Mach. Intell. 30(5), 909–926 (2008)
Kay S.M.: Fundamentals of Statistical Signal Processing: Estimation Theory. Prentice-Hall, Englewood Cliffs (1993)
Heikkila M., Pietikainen M.: A texture-based method for modeling the background and detecting moving objects. IEEE Trans. PAMI 28(4), 657–662 (2006)
Mittal, A., Paragios, N.: Motion-based background subtraction using adaptive kernel density estimation. In: CVPR (2004)
Elgammal, A., Harwood, D., Davis, L.: Non-parametric model for background subtraction. In: ECCV, pp. 751–57 (2000)
Latecki, L.J., Miezianko, R., Pokrajac, D.: Motion detection based on local variation of spatiotemporal texture. In: CVPR Workshops (2004)
Kahl, F., Hartley, R., Hilsenstein, V.: Novelty detection in image sequences with dynamic backgrounds. In: ECCV Workshop on Statistical Methods in Video Processing (2004)
Oliver N.M., Rosario B., Pentland A.P.: Bayesian computer vision system for modeling human interactions. IEEE Trans. PAMI 22(8), 831–843 (2000)
Li Y.: On incremental and robust subspace learning. Pattern Recogn. 37(7), 1509–1519 (2004)
Dalley, G., Migdal, J., Grimson, W.: Background subtraction for temporally irregular dynamic textures. In: Workshop on Applications of Computer Vision, Jan (2008)
Wixson L.: Detecting salient motion by accumulating directionally-consistent flow. IEEE Trans. Pattern Anal. Mach. Intell. 22(8), 774–780 (2000)
Tian, Y.-L., Hampapur, A.: Robust salient motion detection with complex background for real-time video surveillance. In: IEEE Workshop on Motion and Video Computing (WACV/MOTION’05), vol. 2, pp. 30–35 (2005)
Shumway R.H., Stoffer D.S.: An approach to time series smoothing and forecasting using the EM algorithm. J. Time Series Anal. 3(4), 253–264 (1982)
Ghahramani, Z., Hinton, G.: Parameter estimation for linear dynamical systems. Department of Computer Science, University of Toronto, Tech Report CRG-TR-96-2 (1996)
Zivkovic, Z.: Improved adaptive Gaussian mixture model for background subtraction. In: ICVR (2004)
Zivkovic, Z.: [Online]. Available: http://staff.science.uva.nl/~zivkovic/DOWNLOAD.html (2004)
Chan, A.B.: Generalized Stauffer–Grimson background subtraction for dynamic scenes [Online]. Available: http://www.svcl.ucsd.edu/projects/dytexbkgnd (2008)
Boult, T.: Coastal surveillance datasets. Vision and Security Lab, U. Colorado at Colorado Springs [Online]. Available: http://www.vast.uccs.edu/~tboult/PETS2005 (2005)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Chan, A.B., Mahadevan, V. & Vasconcelos, N. Generalized Stauffer–Grimson background subtraction for dynamic scenes. Machine Vision and Applications 22, 751–766 (2011). https://doi.org/10.1007/s00138-010-0262-3
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00138-010-0262-3