Xinyi Cui
ABSTRACT
Saliency detection has attracted much attention in recent years. It aims at locating semantic regions in images for further image understanding. In this paper, we address the issue of motion saliency detection for video content analysis. Inspired by the idea of Spectral Residual for image saliency detection, we propose a new method Temporal Spectral Residual on video slices along X-T and Y-T planes, which can automatically separate foreground motion objects from backgrounds, also with the help of threshold selection and voting schemes. Different from conventional background modeling methods with complex mathematical model, the proposed method is only based on Fourier spectrum analysis, so it is simple and fast. The power of our proposed method is demonstrated in the experiments of four typical videos with different dynamic background.
- http://homepages.inf.ed.ac.uk/rbf/caviardata1/.Google Scholar
- A. Elgammal, R. Duraiswami, D. Harwood, L. S. Davis, R. Duraiswami, and D. Harwood. Background and foreground modeling using nonparametric kernel density for visual surveillance. In Proceedings of the IEEE, 2002.Google ScholarCross Ref
- D. Gao and N. Vasconcelos. Discriminant saliency for visual recognition from cluttered scenes. In NIPS, 2004.Google Scholar
- X. Hou and L. Zhang. Saliency detection: A spectral residual approach. CVPR, 2007.Google ScholarCross Ref
- L. Itti and C. Koch. A saliency-based search mechanism for overt and covert shifts of visual attention. Vision Research, 2000.Google ScholarCross Ref
- L. Itti and C. Koch. Computational modelling of visual attention. Nature Review Neuroscience, 2001.Google Scholar
- L. Itti, C. Koch, and E. Niebur. A model of saliency-based visual attention for rapid scene analysis. PAMI, 1998. Google ScholarDigital Library
- A. Mittal and N. Paragios. Motion-based background subtraction using adaptive kernel density estimation. CVPR, 2004.Google ScholarCross Ref
- A. Monnet, A. Mittal, N. Paragios, and V. Ramesh. Background modeling and subtraction of dynamic scenes. ICCV, 2003. Google ScholarDigital Library
- C. Stauffer and W. Grimson. Adaptive background mixture models for real-time tracking. CVPR, 1999.Google ScholarCross Ref
- O. Tuzel, F. Porikli, and P. Meer. A bayesian approach to background modeling. In CVPR, 2005. Google ScholarDigital Library
- D. Walther, L. Itti, M. Riesenhuber, T. Poggio, and C. Koch. Attentional selection for object recognition -- a gentle way. In 2nd Workshop on Biologically Motivated Computer Vision, 2002. Google ScholarDigital Library
- J. Zhong and S. Sclaroff. Segmenting foreground objects from a dynamic textured background via a robust kalman filter. ICCV, 2003. Google ScholarDigital Library
Index Terms
- Temporal spectral residual: fast motion saliency detection
Recommendations
Temporal Spectral Residual for fast salient motion detection
Motion saliency detection aims at finding the semantic regions in a video sequence. It is an important pre-processing step in many vision applications. In this paper, we propose a new algorithm, Temporal Spectral Residual, for fast motion saliency ...
Motion Analysis Based on Spatial-Temporal Visual Attention
CIS '10: Proceedings of the 2010 International Conference on Computational Intelligence and SecurityMotion analysis can be applied in a number of fields including, e.g. video surveillance, human-computer interaction, smart homes, etc. Due to the large amounts of data associated with usual videos, it is essential for motion analysis algorithms to be ...
Automatic spectral video matting
This paper proposes automatic spectral video matting based on adaptive component detection and component-matching-based spectral matting. In the proposed automatic spectral video matting, adaptive component detection is used to automatically generate ...
Comments