Abstract
We analyze the least-squares error for structure from motion with a single infinitesimal motion (“structure from optical flo”). We present asymptotic approximations to the noiseless error over two, complementary regions of motion estimates: roughly forward and non-forward translations. Our approximations are powerful tools for understanding the error. Experiments show that they capture its detailed behavior over the entire range of motions. We illustrate the use of our approximations by deriving new properties of the least-squares error. We generalize the earlier results of Jepson/Heeger/Maybank on the bas-relief ambiguity and of Oliensis on the reflected minimum. We explain the error's complexity and its multiple local minima for roughly forward translation estimates (epipoles within the field of view) and identify the factors that make this complexity likely. For planar scenes, we clarify the effects of the two-fold ambiguity, show the existence of a new, double bas-relief ambiguity, and analyze the error's local minima. For nonplanar scenes, we derive simplified error approximations for reasonable assumptions on the image and scene. For example, we show that the error tends to have a simpler form when many points are tracked. We show experimentally that our analysis for zero image noise gives a good model of the error for large noise. We show theoretically and experimentally that the error for projective structure from motion is simpler but flatter than the error for calibrated images.
Similar content being viewed by others
References
Adiv, G. 1989. Inherent ambiguities in recovering 3-D motion and structure from a noisy flow field. PAMI, 11:477–489.
Belhumeur, P., Kriegman, D., and Yuille, A. 1999. The Bas–Relief Ambiguity. IJCV, 35(1):33–44.
Chiuso, A., Brockett, R., and Soatto, S. 2000. Optimal structure from motion: Local ambiguities and global estimates. IJCV, 39(3):95–228.
Daniilidis, K. and Spetsakis, M. 1993. Understanding noise sensitivity in structure from motion. In Visual Navigation, Y. Aloimonos (Ed.), Lawrence Erlbaum, pp. 61–88.
Daniilidis, K. and Nagel, H.H. 1990. Analytical results on error sensitivity of motion estimation from two views. IVC, 8:297–303.
Dutta, R., Manmatha, R., Williams, L.R., and Riseman, E.M. 1989. A data set for quantitative motion analysis. CVPR, 159–164.
Erdelyi, A. 1956. Asymptotic Expansions, New York, Dover.
Fermüller, C. and Aloimonos, Y. 2000. Observability of 3D motion. IJCV, 37(1):43–63.
Jepson, A.D. and Heeger, D.J. 1990. Subspace methods for recovering rigid motion II: Theory. U. of Toronto TR RBCV-TR–90–36.
Hartley, R. and Zisserman, A. 2000. Multiple ViewGeometry in Computer Vision. Cambridge.
Hornegger, J. and Tomasi, C. 1999. Representation issues in the ML estimation of camera motion. In ICCV, pp. 640–647.
Kanatani, K. 1993. Geometric Computation for Machine Vision. Oxford.
Koenderink, J.J. and Van Doorn, A.J. 1991. Affine structure from motion. JOSA, 8(2):377–385.
Kumar, R. and Hanson, A.R. 1990. Sensitivity of the pose refinement problem to accurate estimation of camera parameters. In ICCV, pp. 365–369.
Ma, Y., Kosecka, J., and Sastry, S. 2001. Optimization criteria and geometric algorithnms for motion and structure estimation. IJCV, 44(3):219–249.
Maybank, S. 1987. A theoretical study of optical flow. Doctoral Dissertation, University of London.
Maybank, S. 1993. Theory of Reconstruction from Image Motion. Springer: Berlin.
Oliensis, J. 1998. Computing the camera heading from multiple frames. CVPR, pp. 203–210.
Oliensis, J. 1999. A new structure-from-motion ambiguity. CVPR, pp. 185–191.
Oliensis, J. 2000. A new structure from motion ambiguity. PAMI, 22(7):685–700.
Oliensis, J. and Genc, Y. 2001. Fast and accurate algorithms for projective multi-image structure from motion. PAMI, 23(6):546–559.
Soatto, S. and Brocket, R. 1998. Optimal structure from motion: Local ambiguities and global estimates. CVPR, pp. 282–288.
Soatto, S. and Perona, P. 1997. Recursive 3-D visual motion estimation using subspace constraints. IJCV, 22(3):235–259.
Spetsakis, M. and Aloimonos, Y. 1992. Optimal visual motion estimation: A note. PAMI, 14:959–964.
Szeliski, R. and Kang, S.B. 1997. Shape ambiguities in structure from motion. PAMI, 19:506–512.
Triggs, B., McLauchlan, P., Hartley, R., and Fitzgibbon, A. 1999. Bundle adjustment—A modern synthesis. Workshop on Vision Algorithms: Theory and Practice, pp. 298–372.
Tian, T.Y., Tomasi, C., and Heeger, D.J. 1996. Comparison of approaches to egomotion computation. CVPR, pp. 315–320.
Tomasi, C. and Shi, J. 1993. Direction of heading from image deformations. In CVPR, pp. 422–427.
Vieville, T. and Faugeras, O. 1996. The first order expansion of motion equations in the uncalibrated case. CVIU, 64(1):128–146.
Weng, J., Ahuja, N., and Huang, T.S. 1993. Optimal motion and structure estimation. PAMI, 15(9):864–884.
Weng, J., Huang, T.S., and Ahuja, N. 1989. Motion and structure from two perspective views: Algorithms, error analysis, and error estimation. PAMI, 11(5):451–476.
Xiang, T. and Cheong, L.-F. 2003. Understanding the behavior of sfm algorithms: A geometric approach. IJCV, 51(2):111–137.
Young, G. and Chellappa, R. 1992. Statistical analysis of inherent ambiguities in recovering 3-D motion from a noisy flow field. PAMI, 14(10):995–1013.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Oliensis, J. The Least-Squares Error for Structure from Infinitesimal Motion. International Journal of Computer Vision 61, 259–299 (2005). https://doi.org/10.1023/B:VISI.0000045326.88734.8b
Issue Date:
DOI: https://doi.org/10.1023/B:VISI.0000045326.88734.8b