Skip to main content

Pixel matching and motion segmentation in image sequences

  • Structure from Motion
  • Conference paper
  • First Online:
  • 270 Accesses

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 1035))

Abstract

This paper presents a coarse-to-fine algorithm to obtain pixel trajectories in a long image sequence and to segment it into subsets corresponding to distinctly moving objects. Much of the previous related work has addressed the computation of optical flow over two frames or sparse feature trajectories in sequences. The features used are often small in number and restrictive assumptions are made about them such as the visibility of features in all the frames. The algorithm described here uses a coarse scale point feature detector to form a 3-D dot pattern in the spatio temporal space. The trajectories are extracted as 3-D curves-formed by the points using perceptual grouping. Increasingly dense correspondences are obtained iteratively from the sparse feature trajectories. At the finest level, which is the focus of this paper, all pixels are matched and the finest boundaries of the moving objects are obtained.

This is a preview of subscription content, log in via an institution.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. I. K. Sethi and R. Jain, “Finding trajectories of feature points in a monocular image sequence,” IEEE Transactions on Pattern Analysis and Machine intelligence, vol. PAMI-9, January 1987.

    Google Scholar 

  2. I. K. Sethi, V. Salari, and S. Vemuri, “Feature point matching using temporal smoothness in velocity,” in Pattern Recognition Theory and Applications (P. A. Devijver and J. Kittler, eds.), pp. 119–131, New York: Springer-Verlag, June 1986.

    Google Scholar 

  3. K. Rangarajan and M. Shah, “Establishing motion correspondences,” CVGIP: Image Understanding, vol. 54, pp. 56–73, July 1991.

    Google Scholar 

  4. C. L. Cheng and J. K. Aggarwal, “A two-stage hybrid approach to the correspondence problem via forward searching and backward correcting,” in Proceedings of the International Conference on Pattern Recognition, pp. 173–179, 1990.

    Google Scholar 

  5. C. Debrunner and N. Ahuja, “Motion and structure factorization and segmentation of long multiple motion image sequences,” in European Conference on Computer Vision, pp. 217–221, 1992.

    Google Scholar 

  6. J. K. Aggarwal and Y. F. Wang, “Analysis of a sequence of images using point and line correspondences,” in Proceedings of the International Conference on Robotics and Automation, 1987.

    Google Scholar 

  7. J. Weng, N. Ahuja, and T. Huang, “Motion and structure from point correspondences: A robust algorithm for planar case with error estimation,” in Proceedings of the International Conference on Pattern Recognition, 1988.

    Google Scholar 

  8. J. L. Barron, D. J. Fleet, and S. S. Beauchemin, “Performance of optical flow techniques, ” in Proceedings of the Conference on Computer Vision and Pattern Recognition, pp. 236–242, 1992.

    Google Scholar 

  9. J. H. Duncan and T. C. Chou, “The detection of motion and computation of optical flow,” in Proceedings of the International Conference on Computer Vision, pp. 374–382, 1988.

    Google Scholar 

  10. D. Heeger, “Model for the extraction of image flow,” Journal of the Optical Society of America, pp. 1455–1471, 1987.

    Google Scholar 

  11. B. Horn and B. Schunck, “Determining optical flow,” Artificial Intelligence, vol. 17, pp. 185–204, 1981.

    Google Scholar 

  12. A. Singh, Optical Flow Computation: A Unified Perspective. Los Alamitos: IEEE Computer Society Press, 1992.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Stan Z. Li Dinesh P. Mital Eam Khwang Teoh Han Wang

Rights and permissions

Reprints and permissions

Copyright information

© 1996 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Ahuja, N., Charan, R. (1996). Pixel matching and motion segmentation in image sequences. In: Li, S.Z., Mital, D.P., Teoh, E.K., Wang, H. (eds) Recent Developments in Computer Vision. ACCV 1995. Lecture Notes in Computer Science, vol 1035. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-60793-5_69

Download citation

  • DOI: https://doi.org/10.1007/3-540-60793-5_69

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-60793-9

  • Online ISBN: 978-3-540-49448-5

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics