Abstract
This paper describes an approach for integrating motion estimation and region clustering techniques with the purpose of obtaining precise multiple motion segmentation. Motivated by the good results obtained in static segmentation we propose a hybrid approach where motion segmentation is achieved within a region-based clustering approach taken the initial result of a spatial pre-segmentation and extended to include motion information. Motion vectors are first estimated with a multiscale variational method applied directly over the input images and then refined by incorporating segmentation results into a region-based warping scheme. The complete algorithm facilitates obtaining spatially continuous segmentation maps which are closely related to actual object boundaries. A comparative study is made with some of the best known motion segmentation algorithms.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Ayer, S., Sawhney, H.S.: Layered representation of motion video using robust maximum-likelihood estimation of mixture models and mdl encoding. In: Proc. IEEE International Conference on Computer Vision, June 1995, pp. 777–784 (1995)
Brox, T.: From pixels to regions: Partial differential equation in image analysis. PhD thesis, Department of Mathematics and Computer Science, Saarland University, Germany (2005)
Brox, T., Bruhn, A., Papenberg, N., Weickert, J.: High Accuracy Optical Flow Estimation Based on a Theory for Warping. In: Pajdla, T., Matas, J(G.) (eds.) ECCV 2004. LNCS, vol. 3024, pp. 25–36. Springer, Heidelberg (2004)
Bruhn, A., Weickert, J., Schnörr, C.: Lucas/Kanade meets Horn/ Schunck: combining local and global optic flow methods. International Journal of Computer Vision 61(3), 1–21 (2005)
Chang, S.-F., Sikora, T., Puri, A.: Overview of the MPEG-7 standard. IEEE Transactions on Circuits and Systems for Video Technology 11(6), 688–695 (2001)
Horn, B.K.P., Schunck, B.G.: Determining optical flow. Artificial Intelligence 17(1-3), 185–203 (1981)
Monteiro, F.C.: Region-based spatial and temporal image segmentation. PhD thesis, Faculdade de Engenharia da Universidade do Porto, Portugal (2007)
Monteiro, F.C., Campilho, A.: Spectral Methods in Image Segmentation: A Combined Approach. In: Marques, J.S., Pérez de la Blanca, N., Pina, P. (eds.) IbPRIA 2005. LNCS, vol. 3523, pp. 191–198. Springer, Heidelberg (2005)
MPEG4. MPEG-4 video verification model, version 15.0. ISO/IEC/JTC1/SC29/ WG11 N3093 (1999)
Papenberg, N., Bruhn, A., Brox, T., Didas, S., Weickert, J.: Highly accurate optic flow computation with theoretically justified warping. Int. Journal of Computer Vision 67(2), 141–158 (2006)
Shi, J., Malik, J.: Motion segmentation and tracking using normalized cuts. In: Proc. of IEEE Int. Conference on Computer Vision, pp. 1154–1160 (1998)
Smith, P.: Edge-based motion segmentation. PhD thesis, Department of Engineering, University of Cambridge (2001)
Vasconcelos, N., Lippman, A.: Empirical bayesian motion segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence 23(2), 217–221 (2001)
Wang, J., Adelson, E.: Representing moving images with layers. IEEE Transactions on Image Processing 3(5), 625–638 (1994)
Weiss, Y., Adelson, E.H.: A unified mixture framework for motion segmentation: incorporating spatial coherence and estimating the number of models. In: Proc. of IEEE International Conference on Computer Vision and Pattern Recognition, San Francisco, USA, June 1996, pp. 321–326 (1996)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Monteiro, F.C., Campilho, A. (2008). Region and Graph-Based Motion Segmentation. In: Campilho, A., Kamel, M. (eds) Image Analysis and Recognition. ICIAR 2008. Lecture Notes in Computer Science, vol 5112. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-69812-8_60
Download citation
DOI: https://doi.org/10.1007/978-3-540-69812-8_60
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-69811-1
Online ISBN: 978-3-540-69812-8
eBook Packages: Computer ScienceComputer Science (R0)