Abstract
In this paper, we propose two novel video object (VO) extraction schemes, specifically designed for two different scenarios of content-based video analysis applications. One is a change detection-based VO extraction algorithm appropriate to surveillance type video sequences, where automatic detection of new appearance of objects are important in envisaging on-line object-oriented applications as well as object-based coding. The other is an object tracking-based method, which is especially robust to video sequences with moving background, although human intervention is needed in the process. In both cases, the semantically meaningful video objects are obtained by a final regularization stage realized by means of a cascade of morphological filters. Experimental results obtained on the MPEG-4 test sequences are presented respectively.
Similar content being viewed by others
References
MPEG Video and SNHC Groups, “Committee Draft of MPEG-4, Part 2, 14496-2, ” Tech. Rep. ISO/IEC JTC/SC29/ WG11/N1902,ISO/IEC, Fribourg, Switzerland, Oct. 1997.
T. Sikora, “The MPEG-4 Video Standard Verification Model, ” IEEE Trans. Circuits Syst. Video Technology, vol. 7, 1997, pp. 19–31.
Changick Kim and Jenq-Neng Hwang, “An Integrated Scheme for Object-Based Video Abstraction, ” ACM International Multimedia Conference, L.A., Oct. 2000, pp. 303–311.
Til Aach, Andre Kaup, and Rudolf Mester, “Statistical Model-Based Change Detection in Moving Video, ” Signal Processing, vol. 31, no. 2, 1993, pp. 165–180.
R. Mech and M. Wollborn, “A Noise Robust Method for Segmentation of Moving Objects in Video Sequences, ” ICASSP97, vol. 4, 1997, pp. 2657–2660.
A. Neri, S. Colonnese, G. Russo, and P. Talor, “Automatic Moving Object and Background Separation, ” Signal Processing, vol. 66, no. 2, 1998, pp. 219–232.
Ju Guo, J. Kim, and C.-C. Jaykuo, “Fast and Accurate Moving Object Extraction Technique for MPEG-4 Object-Based Video Coding, ” SPIE, vol. 3653, 1999, pp. 1210–1221.
C. Gu and M.-C. Lee, “Semantic Segmentation and Tracking of Semantic Video Objects, ” IEEE Trans. Circuits Syst. Video Technology, vol. 8, 1998, pp. 572–584.
M. Kim, J.G. Choi, D. Kim, H. Lee, M.H. Lee, and Y. Ho, “A VOP Generation Tool: Automatic Segmentation of Moving Objects in Image Sequences Based on Spatio-Temporal Information, ” IEEE Trans. Circuits Syst. Video Technology, vol. 9, no. 8, 1999.
C. Gu and M.-C. Lee, “Tracking of Multiple Semantic Video Objects for Internet Applications, ” SPIE, vol. 3653, 1999, pp. 806–820.
Roberto Castagno, T. Ebrahimi, and M. Kunt, “Video Segmentation Based on Multiple Features for Interactive Multimedia Applications, ” IEEE Tr. on CSVT, vol. 8, no. 5, 1998.
Changick Kim and Jenq-Neng Hwang, “Fast and Robust Moving Object Segmentation in Video Sequences, ” Int. Conf. on Image Processing (ICIP'99), Kobe, Japan, Oct. 1999, vol. 2, pp. 131–134.
William E. Grimson, From Images to Surfaces, The MIT Press, 1981, pp. 3–5.
J.F. Canny, “A Computational Approach to Edge Detection, ” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 6, no. 6, 1986, pp. 679–698.
M. Bierling, “Displacement Estimation by Hierarchical Block-matching, ” SPIE Visual Commun. Image Processing, VCIP'88, Cambridge, MA, Nov. 1988, vol. 1001, pp. 942–951.
M.J. Swain and D.H. Ballard, “Color Indexing, ” International Journal of Computer Vision, vol. 7, no. 1, 1991, pp. 11–32.
G. Borgefors, “Distance Transformations in Digital Images, ” Computer Vision, Graphics, and Image Processing, vol. 34, 1986, pp. 344–371.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Kim, C., Hwang, JN. Video Object Extraction for Object-Oriented Applications. The Journal of VLSI Signal Processing-Systems for Signal, Image, and Video Technology 29, 7–21 (2001). https://doi.org/10.1023/A:1011115312953
Published:
Issue Date:
DOI: https://doi.org/10.1023/A:1011115312953