Liyuan Li
ABSTRACT
This paper proposes a novel method for detection and segmentation of foreground objects from a video which contains both stationary and moving background objects and undergoes both gradual and sudden "once-off" changes. A Bayes decision rule for classification of background and foreground from selected feature vectors is formulated. Under this rule, different types of background objects will be classified from foreground objects by choosing a proper feature vector. The stationary background object is described by the color feature, and the moving background object is represented by the color co-occurrence feature. Foreground objects are extracted by fusing the classification results from both stationary and moving pixels. Learning strategies for the gradual and sudden "once-off" background changes are proposed to adapt to various changes in background through the video. The convergence of the learning process is proved and a formula to select a proper learning rate is also derived. Experiments have shown promising results in extracting foreground objects from many complex backgrounds including wavering tree branches, flickering screens and water surfaces, moving escalators, opening and closing doors, switching lights and shadows of moving objects.
- T. E. Boult, R. Micheals, X. Gao, P. Lewis, C. Power, W. Yin, and A. Erkan. Frame-rate omnidirectional surveillance & tracking of camouflaged and occluded targets. In Proceedings IEEE Workshop on Visual Surveillance, pages 48--55. IEEE Computer Society, 1999. Google Scholar
Digital Library
- X. Gao, T. Boult, F. Coetzee, and V. Ramesh. Error analysis of background adaption. In Proceedings of IEEE Computer Vision and Pattern Recognition, pages 503--510. IEEE Computer Society, 2000.Google Scholar
- I. Haritaoglu, D. Harwood, and L. Davis. W4: Real-time surveillance of people and their activities. IEEE Trans. Pattern Analysis and Machine Intelligence, 22(8):809-830, August 2000. Google ScholarDigital Library
- A. Iketani, A. Nagai, Y. Kuno, and Y. Shirai. Detecting persons on changing background. In Proceedings of International Conference on Pattern Recognition, pages 74--76, 1998. Google ScholarDigital Library
- K. Karmann and A. V. Brandt. Moving object recognition using an adaptive background memory. Time-Varing Image Processing and Moving Object Recognition, 2:289--296, 1990.Google Scholar
- D. Koller, J. Weber, T. Huang, J. Malik, G. Ogasawara, B. Rao, and S. Russel. Toward robust automatic traffic scene analysis in real-time. In Proceedings Int'l Conf. Pattern Recognition, pages 126--131, 1994.Google ScholarCross Ref
- L. Li, W. M. Huang, I. Y. H. Gu, and Q. Tian. Foreground object detection in changing background based on color co-occurrenece statistics. In Proceedings IEEE Workshop on Application of Computer Vision, pages 269--274, 2002. Google ScholarDigital Library
- L. Li and M. K. H. Leung. Integrating intensity and texture differences for robust change detection. IEEE Trans. Image Processing, 11(2):105--112, February 2002. Google ScholarDigital Library
- A. Lipton, H. Fujiyoshi, and R. Patil. Moving target classification and tracking from real-time video. In Proceedings IEEE Workshop on Application of Computer Vision, pages 8--14. IEEE Computer Society, 1998. Google ScholarDigital Library
- P. Rosin. Thresholding for change detection. In Proceedings of IEEE Int'l Conf. on Computer Vision, pages 274-279, 1998. Google ScholarDigital Library
- C. Stauffer and W. Grimson. Learning patterns of activity using real-time tracking. IEEE Trans. Pattern Analysis and Machine Intelligence, 22(8):747--757, August 2000. Google ScholarDigital Library
- K. Toyama, J. Krumm, B. Brumitt, and B. Meyers. Wallflower: Principles and practice of background maintenance. In Proceedings of IEEE Int'l Conf. on Computer Vision, pages 255--261. IEEE Computer Society, 1999.Google ScholarCross Ref
- L. Wixson. Detecting salient motion by accumulating directionary-consistenct flow. IEEE Trans. Pattern Analysis and Machine Intelligence, 22(8):774--780, August 2000. Google ScholarDigital Library
- C. Wren, A. Azarbaygaui, T. Darrell, and A. Pentland. Pfinder: Real-time tracking of the human body. IEEE Trans. Pattern Analysis and Machine Intelligence, 19(7):780--785, July 1997. Google ScholarDigital Library
Index Terms
- Foreground object detection from videos containing complex background
Recommendations
A background modeling and foreground segmentation approach based on the feedback of moving objects in traffic surveillance systems
Background modeling and foreground segmentation are the foundation of traffic surveillance systems. The preciseness of the background model and the accuracy of the foreground segmentation will directly affect the subsequent operations, such as object ...
A Hybrid Background Subtraction Method with Background and Foreground Candidates Detection
Background subtraction for motion detection is often used in video surveillance systems. However, difficulties in bootstrapping restrict its development. This article proposes a novel hybrid background subtraction technique to solve this problem. For ...
An edge-based approach for robust foreground detection
ACIVS'11: Proceedings of the 13th international conference on Advanced concepts for intelligent vision systemsForeground segmentation is an essential task in many image processing applications and a commonly used approach to obtain foreground objects from the background. Many techniques exist, but due to shadows and changes in illumination the segmentation of ...
Comments