Abstract
In this paper, we present a globally optimal and computationally efficient technique for estimating the focus of expansion (FOE) of an optical flow field, using fast partial search. For each candidate location on a discrete sampling of the image area, we generate a linear system of equations for determining the remaining unknowns, viz. rotation and inverse depth. We compute the least squares error of the system without actually solving the equations, to generate an error surface that describes the goodness of fit across the hypotheses. Using Fourier techniques, we prove that given an N × N flow field, the FOE, and subsequently rotation and structure, can be estimated in \(\mathcal{O}(N^2 \log N)\) operations. Since the resulting system is linear, bounded perturbations in the data lead to bounded errors.
We support the theoretical development and proof of our technique with experiments on synthetic and real data. Through a series of experiments on synthetic data, we prove the correctness, robustness and operating envelope of our algorithm. We demonstrate the utility of our technique by applying it for detecting obstacles from a monocular sequence of images.
Similar content being viewed by others
References
Adiv, G. 1985. Determining 3-D motion and structure from optical flow generated by several moving objects. IEEE Trans. on Pattern Analysis and Machine Intelligence, 7(4):384–401.
Adiv, G. 1989. Inherent ambiguities in recovering 3-D motion and structure from a noisy flow field. IEEE Trans. on Pattern Analysis and Machine Intelligence, 11(5):477–489.
Aloimonos, Y. and Brown, C. 1984. Direct processing of curvilinear sensor motion from a sequence of perspective images. In IEEEWorkshop on Computer Vision, Representation and Control, Annapolis, MD, pp. 72–77.
Barron, J., Fleet, D., and Beauchemin, S. 1994. Performance of optical flow techniques. International Journal of Computer Vision, 12(1):43–77. Software and test sequences available at ftp.csd.uwo.ca/pub/vision.
Bruss, A. and Horn, B. 1983. Passive navigation. Computer Vision, Graphics and Image Processing, 21(1):3–20.
Fejes, S. and Davis, L. 1998. What can projections of flow fields tell us about visual motion. In International Conference on Computer Vision, Mumbai, India, pp. 979–986.
Fermuller, C. and Aloimonos, Y. 1995. Qualitative egomotion. International Journal of Computer Vision, 15(1/2):7–29.
Fermuller, C. and Aloimonos, Y. 1997. On the geometry of visual correspondence. International Journal of Computer Vision, 21(3):223–247.
Gibson, J. 1955. The Perception of the Visual World. Houghton Mifflin.
Gibson, J. 1957. Optical motion and transformations as stimuli for visual perceptions. Psychological Review, 64(5):288–295.
Gupta, N. and Kanal, L. 1995. 3-D motion estimation from motion field. Artificial Intelligence, 78(1/2):45–86.
Heeger, D. and Jepson, A. 1992. Linear subspace methods for recovering translation direction. Technical Report RBCVTR-92-40, University of Toronto. www.cs.utoronto.ca/~jepson/abstracts/dither.html.
Horn, B. and Weldon, E., Jr. 1988. Direct methods for recovering motion. International Journal of Computer Vision, 2(1):51–76.
Koenderink, J. and vanDoorn, A. 1976. Local structure of movement parallax of the plane. Journal of the Optical Society of America A, 66(7):717–723.
Lawton, D. 1983. Processing translational motion sequences. Computer Vision, Graphics and Image Processing, 22(1):116–144.
Longuet-Higgins, H. 1981. A computer algorithm for reconstructing a scene from two projections. Nature, 293:133–135.
Longuet-Higgins, H. and Prazdny, K. 1980. The interpretation of a moving retinal image. Proceedings of the Royal Society of London B, B-208:385–397.
Mitiche, A. 1994. Computational Analysis of Visual Motion. Plenum.
Mitiche, A., Zhuang, X., and Haralick, R. 1987. Interpretation of optical flowby rotational decoupling. In IEEE Workshop on Computer Vision, Representation and Control, Miami Beach, FL, pp. 195–200.
Nakayama, K. and Loomis, J.M. 1974. Optical velocity patterns, velocity-sensitive neurons and space perception. Perception, 3:63–80.
Negahdaripour, S. and Horn, B. 1987. Direct passive navigation. IEEE Trans. on Pattern Analysis and Machine Intelligence, 9(1):168–176.
Oliensis, J. 1997. A critique of structure from motion algorithms. Technical Report www.neci.nj.com/homepages/oliensis/Critique.html, NECI.
Prazdny, K. 1981. Determining the instantaneous direction of motion from optical flow generated by a curvilinearly moving observer. Computer Vision, Graphics and Image Processing, 17(3):238–248.
Press, W.H., Teukolsky, S.A., Vetterling, W.T., and Flannery, B.P. 1992. Numerical Recipes in C, 2nd edn. Cambridge University Press: Cambridge, UK.
Simoncelli, E.P. 1993. Distributed representation and analysis of visual motion. Ph.D. Thesis, MIT.
Srinivasan, S. 1998. Image sequence analysis-estimation of optical flow and focus of expansion, with applications. Ph.D. Thesis, University of Maryland, College Park.
Tsai, R. and Huang, T. 1981. Estimating 3-D motion parameters of a rigid planar patch I. IEEE Trans. on Acoustics, Speech and Signal Processing, 29(12):1147–1152.
Ullman, S. 1979. The interpretation of structure from motion. Proceedings of the Royal Society of London B, B-203:405–426.
Wallach, H. and O'Connell, D.N. 1953. The kinetic depth effect. Journal of Experimental Psychology, 45:205–217.
Waxman, A., Kamgar-Parsi, B., and Subbarao, M. 1987. Closed-form solutions to image flow equations for 3D structure and motion. International Journal of Computer Vision, 1(3):239–258.
Waxman, A. and Ullman, S. 1985. Surface structure and three-dimensional motion from image flow kinematics. International Journal of Robotics Research, 4(3):72–94.
Weng, J., Hwang, T.S., and Ahuja, N. 1991. Motion and Structure from Image Sequences. Springer-Verlag: Berlin.
Young, G. and Chellappa, R. 1992. Statistical analysis of inherent ambiguities in recovering 3-D motion from a noisy flowfield. IEEE Trans. on Pattern Analysis and Machine Intelligence, 14(10):995–1013.
Zhuang, X., Huang, T., Ahuja, N., and Haralick, R. 1984. Rigid body motion and the optic flow image. In First IEEE Conference on AI Applications, pp. 366–375.
Zhuang, X., Huang, T., Ahuja, N., and Haralick, R. 1988. A simplified linear optical flow-motion algorithm. Computer Vision, Graphics and Image Processing, 42(3):334–344.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Srinivasan, S. Extracting Structure from Optical Flow Using the Fast Error Search Technique. International Journal of Computer Vision 37, 203–230 (2000). https://doi.org/10.1023/A:1008111923880
Issue Date:
DOI: https://doi.org/10.1023/A:1008111923880