Abstract
This paper proposes a new tracking mechanism for semi-automatic video object segmentation. An interactive video object segmentation tool is presented for the user to easily define the desired video objects in the first frame, and then the video objects are automatically segmented using the proposed tracking mechanism of bi-directional projection. Forward projection is first exploited to locate the current video object with rough boundary information. Watershed segmentation is then applied to the simplified gradient image of the current frame to obtain a reasonable partition. An improved backward projection, which incorporates pixel classification with region classification, is finally performed on some segmented regions in a rather small search range, and the tracking performance is enhanced in respect of both reliability and efficiency. Experimental results for various types of the MPEG-4 test sequences demonstrate an efficient and faithful segmentation performance of the proposed approach.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Kim, M., Jeon, J.G., Kwak, J.S., Lee, M.H., Ahn, C.: Moving Object Segmentation in Video Sequence by User Interaction and Automatic Object Tracking. Image and Vision Computing 5, 245–260 (2001)
Guo, J., Kim, J.W., Kuo, C.-C.J.: An Interactive Object Segmentation System for MPEG Video. In: IEEE Int. Conf. Image Processing, vol. 2, pp. 140–144 (1999)
Luo, H.T., Eleftheriadis, A.: An Interactive Authoring System for Video Object Segmentation and Annotation. Signal Processing: Image Communication 7, 559–572 (2002)
Sun, S.J., Haynor, D.R., Kim, Y.M.: Semiautomatic Video Object Segmentation using Vsnakes. IEEE Trans. Circuits Syst. Video Technol. 1, 75–82 (2003)
Cooray, S., O’Connor, N., Marlow, S., Murphy, N., Curran, T.: Hierarchical Semiautomatic Video Object Segmentation for Multimedia Applications. In: Proc. SPIE Internet Multimedia Management Systems II, vol. 4519, pp. 10–19 (2001)
Zhi, L., Jie, Y.: Interactive Video Object Segmentation: Fast Seeded Region Merging Approach. Electronics Letters 5, 302–304 (2004)
Gu, C., Lee, M.C.: Semiautomatic Segmentation and Tracking of Semantic Video Objects. IEEE Trans. Circuits Syst. Video Technol. 5, 572–584 (1998)
Lim, J., Cho, H.K., Beom Ra, J.: An Improved Video Object Tracking Algorithm Based on Motion Re-estimation. IEEE Int. Conf. Image Processing 1, 339–342 (2000)
Gu, C., Lee, M.C.: Semantic Video Object Tracking Using Region-based Classification. IEEE Int. Conf. Image Processing 3, 643–647 (1998)
Gatica-Perez, D., Sun, M.T., Gu, C.: Semantic Video Object Extraction Based on Backward Tracking of Multivalued Watershed. IEEE Int. Conf. Image Processing 2, 145–149 (1999)
Tekalp, A.M.: Digital Video Processing. Tsinghua University Press, Beijing (1998)
Vincent, L., Soille, P.: Watersheds in Digital Spaces: an Efficient Algorithm Based on Immersion Simulations. IEEE Trans. Pattern Anal. Mach. Intell. 6, 583–598 (1991)
Di Zenzo, S.: A Note on the Gradient of a Multi-image. Computer Vision Graphics Image Processing 1, 116–125 (1986)
Vincent, L.: Morphological Grayscale Reconstruction in Image Analysis: Applications and Efficient algorithms. IEEE Trans. Image Processing. 2, 176–201 (1993)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Liu, Z., Yang, J., Peng, N. (2004). A New Tracking Mechanism for Semi-automatic Video Object Segmentation. In: Aizawa, K., Nakamura, Y., Satoh, S. (eds) Advances in Multimedia Information Processing - PCM 2004. PCM 2004. Lecture Notes in Computer Science, vol 3332. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-30542-2_102
Download citation
DOI: https://doi.org/10.1007/978-3-540-30542-2_102
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-23977-2
Online ISBN: 978-3-540-30542-2
eBook Packages: Computer ScienceComputer Science (R0)