Skip to main content
Log in

Extracting Structure from Optical Flow Using the Fast Error Search Technique

  • Published:
International Journal of Computer Vision Aims and scope Submit manuscript

Abstract

In this paper, we present a globally optimal and computationally efficient technique for estimating the focus of expansion (FOE) of an optical flow field, using fast partial search. For each candidate location on a discrete sampling of the image area, we generate a linear system of equations for determining the remaining unknowns, viz. rotation and inverse depth. We compute the least squares error of the system without actually solving the equations, to generate an error surface that describes the goodness of fit across the hypotheses. Using Fourier techniques, we prove that given an N × N flow field, the FOE, and subsequently rotation and structure, can be estimated in \(\mathcal{O}(N^2 \log N)\) operations. Since the resulting system is linear, bounded perturbations in the data lead to bounded errors.

We support the theoretical development and proof of our technique with experiments on synthetic and real data. Through a series of experiments on synthetic data, we prove the correctness, robustness and operating envelope of our algorithm. We demonstrate the utility of our technique by applying it for detecting obstacles from a monocular sequence of images.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Adiv, G. 1985. Determining 3-D motion and structure from optical flow generated by several moving objects. IEEE Trans. on Pattern Analysis and Machine Intelligence, 7(4):384–401.

    Google Scholar 

  • Adiv, G. 1989. Inherent ambiguities in recovering 3-D motion and structure from a noisy flow field. IEEE Trans. on Pattern Analysis and Machine Intelligence, 11(5):477–489.

    Google Scholar 

  • Aloimonos, Y. and Brown, C. 1984. Direct processing of curvilinear sensor motion from a sequence of perspective images. In IEEEWorkshop on Computer Vision, Representation and Control, Annapolis, MD, pp. 72–77.

  • Barron, J., Fleet, D., and Beauchemin, S. 1994. Performance of optical flow techniques. International Journal of Computer Vision, 12(1):43–77. Software and test sequences available at ftp.csd.uwo.ca/pub/vision.

    Google Scholar 

  • Bruss, A. and Horn, B. 1983. Passive navigation. Computer Vision, Graphics and Image Processing, 21(1):3–20.

    Google Scholar 

  • Fejes, S. and Davis, L. 1998. What can projections of flow fields tell us about visual motion. In International Conference on Computer Vision, Mumbai, India, pp. 979–986.

  • Fermuller, C. and Aloimonos, Y. 1995. Qualitative egomotion. International Journal of Computer Vision, 15(1/2):7–29.

    Google Scholar 

  • Fermuller, C. and Aloimonos, Y. 1997. On the geometry of visual correspondence. International Journal of Computer Vision, 21(3):223–247.

    Google Scholar 

  • Gibson, J. 1955. The Perception of the Visual World. Houghton Mifflin.

  • Gibson, J. 1957. Optical motion and transformations as stimuli for visual perceptions. Psychological Review, 64(5):288–295.

    Google Scholar 

  • Gupta, N. and Kanal, L. 1995. 3-D motion estimation from motion field. Artificial Intelligence, 78(1/2):45–86.

    Google Scholar 

  • Heeger, D. and Jepson, A. 1992. Linear subspace methods for recovering translation direction. Technical Report RBCVTR-92-40, University of Toronto. www.cs.utoronto.ca/~jepson/abstracts/dither.html.

  • Horn, B. and Weldon, E., Jr. 1988. Direct methods for recovering motion. International Journal of Computer Vision, 2(1):51–76.

    Google Scholar 

  • Koenderink, J. and vanDoorn, A. 1976. Local structure of movement parallax of the plane. Journal of the Optical Society of America A, 66(7):717–723.

    Google Scholar 

  • Lawton, D. 1983. Processing translational motion sequences. Computer Vision, Graphics and Image Processing, 22(1):116–144.

    Google Scholar 

  • Longuet-Higgins, H. 1981. A computer algorithm for reconstructing a scene from two projections. Nature, 293:133–135.

    Google Scholar 

  • Longuet-Higgins, H. and Prazdny, K. 1980. The interpretation of a moving retinal image. Proceedings of the Royal Society of London B, B-208:385–397.

    Google Scholar 

  • Mitiche, A. 1994. Computational Analysis of Visual Motion. Plenum.

  • Mitiche, A., Zhuang, X., and Haralick, R. 1987. Interpretation of optical flowby rotational decoupling. In IEEE Workshop on Computer Vision, Representation and Control, Miami Beach, FL, pp. 195–200.

  • Nakayama, K. and Loomis, J.M. 1974. Optical velocity patterns, velocity-sensitive neurons and space perception. Perception, 3:63–80.

    Google Scholar 

  • Negahdaripour, S. and Horn, B. 1987. Direct passive navigation. IEEE Trans. on Pattern Analysis and Machine Intelligence, 9(1):168–176.

    Google Scholar 

  • Oliensis, J. 1997. A critique of structure from motion algorithms. Technical Report www.neci.nj.com/homepages/oliensis/Critique.html, NECI.

  • Prazdny, K. 1981. Determining the instantaneous direction of motion from optical flow generated by a curvilinearly moving observer. Computer Vision, Graphics and Image Processing, 17(3):238–248.

    Google Scholar 

  • Press, W.H., Teukolsky, S.A., Vetterling, W.T., and Flannery, B.P. 1992. Numerical Recipes in C, 2nd edn. Cambridge University Press: Cambridge, UK.

    Google Scholar 

  • Simoncelli, E.P. 1993. Distributed representation and analysis of visual motion. Ph.D. Thesis, MIT.

  • Srinivasan, S. 1998. Image sequence analysis-estimation of optical flow and focus of expansion, with applications. Ph.D. Thesis, University of Maryland, College Park.

    Google Scholar 

  • Tsai, R. and Huang, T. 1981. Estimating 3-D motion parameters of a rigid planar patch I. IEEE Trans. on Acoustics, Speech and Signal Processing, 29(12):1147–1152.

    Google Scholar 

  • Ullman, S. 1979. The interpretation of structure from motion. Proceedings of the Royal Society of London B, B-203:405–426.

    Google Scholar 

  • Wallach, H. and O'Connell, D.N. 1953. The kinetic depth effect. Journal of Experimental Psychology, 45:205–217.

    Google Scholar 

  • Waxman, A., Kamgar-Parsi, B., and Subbarao, M. 1987. Closed-form solutions to image flow equations for 3D structure and motion. International Journal of Computer Vision, 1(3):239–258.

    Google Scholar 

  • Waxman, A. and Ullman, S. 1985. Surface structure and three-dimensional motion from image flow kinematics. International Journal of Robotics Research, 4(3):72–94.

    Google Scholar 

  • Weng, J., Hwang, T.S., and Ahuja, N. 1991. Motion and Structure from Image Sequences. Springer-Verlag: Berlin.

    Google Scholar 

  • Young, G. and Chellappa, R. 1992. Statistical analysis of inherent ambiguities in recovering 3-D motion from a noisy flowfield. IEEE Trans. on Pattern Analysis and Machine Intelligence, 14(10):995–1013.

    Google Scholar 

  • Zhuang, X., Huang, T., Ahuja, N., and Haralick, R. 1984. Rigid body motion and the optic flow image. In First IEEE Conference on AI Applications, pp. 366–375.

  • Zhuang, X., Huang, T., Ahuja, N., and Haralick, R. 1988. A simplified linear optical flow-motion algorithm. Computer Vision, Graphics and Image Processing, 42(3):334–344.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

About this article

Cite this article

Srinivasan, S. Extracting Structure from Optical Flow Using the Fast Error Search Technique. International Journal of Computer Vision 37, 203–230 (2000). https://doi.org/10.1023/A:1008111923880

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/A:1008111923880

Navigation