Skip to main content
SpringerLink
Log in

The Critical Sets of Lines for Camera Displacement Estimation: A Mixed Euclidean-Projective and Constructive Approach

  • Published:
International Journal of Computer Vision Aims and scope Submit manuscript

Abstract

The problem of the recovery of the motion, and the structure from motion is relevant to many computer vision applications. Many algorithms have been proposed to solve this problem. Some of these use line correspondences. For obvious practical reasons, it is important to study the limitation of such algorithms. In this paper, we are concerned with the problem of recovering the relative displacements of a camera by using line matches in three views. In particular, we want to know whether there exist sets of 3D lines such that no matter how many lines we observe there will always be several solutions to the relative displacement estimation problem. Such sets of lines may be called critical in the sense that they defeat the corresponding algorithm. This question has been studied in detail in the case of point matches by early-century Austrian photogrammeters and, independently, in the mid-seventies and early-eighties by computer vision scientists. The answer lies in the idea of a critical surface.

The case of lines has been much less studied. Recently, Buchanan (1992a, 1992b) provided a first analysis of the problem in which he gave a positive answer: there exist critical sets of lines and they are pretty big (∞2 lines). In general these sets are algorithm dependent, for example the critical set of lines for the Liu-Huang algorithm introduced in (Buchanan, 1992a), but Buchanan has shown that there is a critical set that defeats any algorithm. This paper is an attempt to build on his work and extend it in several directions. First, we cast his purely projective analysis in a more euclidean framework better suited to applications and, currently, more familiar to most of the computer vision community. Second, we clearly relate his critical set to those of previously published algorithms, in particular (Liu and Huang, 1988a, 1988b). Third, we provide an effective, i.e., computational, approach for describing these critical sets in terms of simple geometric properties. This has allowed us to scrutinize the structure of the critical sets which we found to be both intricate and beautiful.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Abdel-Aziz, Y. I. and Karara, H. M. 1971. Direct linear transformation into object space coordinates in close-range photogrammetry. In Proceedings of the Symposium on Close-Range Photogrammetry, University of Illinois at Urbana-Champaign, Urbana, Illinois, pp. 1-18.

    Google Scholar 

  • Adiv, G. 1985. Determining three-dimensional motion and structure from optical flow generated by several moving objects. IEEE Trans. PAMI, 7: 384-401.

    Google Scholar 

  • Brown, C. 1971. Close-range camera calibration. Photogrammetric Engineering, 37(8): 855-866.

    Google Scholar 

  • Buchanan, T. 1992a. Critical sets for 3d reconstruction using lines. In Proc. Second European Conf. on Comput. Vision, Santa Margherita Ligure, Italy, pp. 730-738.

    Google Scholar 

  • Buchanan, T. 1992b. On the critical set for photogrammetric reconstruction using line tokens in p 3 (c). Geometricae Dedicata, 44: 223-232.

    Google Scholar 

  • Chasles, M. 1855. Question No. 296. Nouv. Ann. Math., 14: 50.

    Google Scholar 

  • Faig, W, 1975. Calibration of close range photogrammetry systems: Mathematical formulation. Photogrammetric Engineering and Remote Sensing, 41(12): 1479-1486.

    Google Scholar 

  • Faugeras, O. 1993. Three-Dimensional Computer Vision: A Geometric Viewpoint. MIT Press: Cambridge, MA.

    Google Scholar 

  • Faugeras, O. D. and Toscani, G. 1986. The calibration problem for stereo. In Proc. IEEE Conf. Comput. Vision Pattern Recog., Miami, FL, pp. 15-20. IEEE.

  • Faugeras, O. D., Lustman, F., and Toscani, G. 1987. Motion and structure from motion from point and line matches. In Proc. First Int'l Conf. Comput. Vision, London, UK, pp. 25-34.

  • Faugeras, O. D. and Maybank, S. 1990. Motion from point matches: Multiplicity of solutions. The International Journal of Computer Vision, 4(3): 225-246. Also INRIA Tech. Report 1157.

    Google Scholar 

  • Faugeras, O. D., Navab, N., and Deriche, R. 1990. On the information contained in the motion field of lines and the cooperation between motion and stereo. International Journal on Imaging Systems and Technology, 2: 356-370.

    Google Scholar 

  • Finsterwalder, S. 1987. Die geometrischen grundlagen der photogrammetrie. Jahresber. Der Deutschen Math. Vereinigung, 6(2): 1-41.

    Google Scholar 

  • Hildreth, E. C. 1983. The Measurement of Visual Motion. MIT Press: Cambridge, MA.

    Google Scholar 

  • Hofmann, W. 1950. Das problem der “Gefährlichen Flächen” in theorie und pr axis. Ph. D. thesis, Fakultät für Bauwesen der technischen Hochschule Mü nchen.

  • Horn, B. K. P. 1987. Motion fields are hardly ever ambiguous. Int'l J. Comput. Vision, 1(3): 263-278.

    Google Scholar 

  • Horn, B. K. P. 1990. Relative orientation. Int'l J. Comput. Vision, 4(1): 59-78.

    Google Scholar 

  • Horn, B. K. P. and Schunk, B. G. 1981. Determining optical flow. Artif. Intell., 20: 199-228.

    Google Scholar 

  • Kanatani, K. 1992. Geometric Computation for Machine Vision. Oxford University Press.

  • Krames, J. 1940. Zur ermittlung eines objektes aus zwei perspektiven. (Ein Beitra g zur Theorie der “gefährlichen Örter.). Monatshefte für Mathematik und Physik, 49: 327-354.

    Google Scholar 

  • Liu, Y. and Huang, T. S. 1986. Estimation of rigid body motion using straight line correspondences: Further results. In Proc. 8th Int'l Conf. Pattern Recog., Paris, France, pp. 306-307. IEEE.

  • Liu, Y. and Huang, T. S. 1988a. Estimation of rigid body motion using straight line correspondences. Comput. Vision, Graphics Image Process., 43(1): 37-52.

    Google Scholar 

  • Liu, Y. and Huang, T. S. 1988b. A linear algorithm for determining motion and structure from line correspondences. Comput. Vision, Graphics Image Process., 44(1): 35-57.

    Google Scholar 

  • Liu, Y., Huang, T. S., and Faugeras, O. D. 1990. Determination of camera location from 2-D to 3-D line and point correspondences. IEEE Trans. PAMI, 12(1): 28-37.

    Google Scholar 

  • Longuet-Higgins, H. C. 1981. A computer algorithm for reconstructing a scene from two projections. Nature, 293: 133-135.

    Google Scholar 

  • Longuet-Higgins, H. C. 1984. The reconstruction of a scene from two projections-configurations that defeat the 8-point algorithm. In Proc. First Conf. Artif. Intell. Applications, Denver, Colorado, pp. 395-397.

  • Longuet-Higgins, H. C. 1988. Multiple interpretations of a pair of images of a surface. Proc. Roy. Soc. Lond. A., Vol. 418, pp. 1-15.

    Google Scholar 

  • Luong, T. and Faugeras, O. 1994. A stability analysis of the fundamental matrix. In 3rd European Conference on Computer Vision, Stockholm, accepted.

  • Maybank, S. J. 1987. A theoretical study of optical flow. Ph. D. thesis, Birkbeck College, University of London, London, UK.

    Google Scholar 

  • Maybank, S. J. 1990. The projective geometry of ambiguous surfaces. Proceedings of the Royal Society London, A, Vol. 332, pp. 1- 47.

    Google Scholar 

  • Maybank, S. J. 1992. Theory of Reconstruction from Image Motion. Springer-Verlag.

  • Navab, N. 1993. Visual motion of lines, and cooperation between motion and stereo. Dissertation, University of Paris XI, Orsay, Paris, France (in English).

    Google Scholar 

  • Navab, N. and Faugeras, O. D. 1993. Monocular pose determination from lines: Critical sets and maximum number of solutions. In Proc. IEEE Conf. Comput. Vision Pattern Recog., New York, USA. IEEE Computer Society, pp. 254-260.

    Google Scholar 

  • Navab, N., Faugeras, O. D., and Vieville, T. 1993. The critical sets of lines for camera displacement estimation: A mixed euclidean-projective and constructive approach. In Proc. Fourth Int'l Conf. Comput. Vision, Berlin, Germany. IEEE.

    Google Scholar 

  • Negahdaripour, S. 1989. Critical surface pairs and triplets. Int'l J. Comput. Vision, 3(4): 293-312.

    Google Scholar 

  • Okamoto, A. 1981. Orientation and construction of models, Part I: The orientation problem in close-range photogrammetry. Photogrammetric Engineering and Remote Sensing, 47(10): 1437- 1454.

    Google Scholar 

  • Okamoto, A. 1984. The model construction problem using the collinearity condition. Photogrammetric Engineering and Remote Sensing, L(6): 705-711.

    Google Scholar 

  • Semple, J. G. and Roth, L. 1949. Introduction to Algebraic Geometry. Oxford Clarendon Press. Reprinted 1987.

  • Semple, J. G. and Kneebone, G. T. 1952. Algebraic Projective Geometry. Oxford Clarendon Press. Reprinted 1979.

  • Spetsakis, M. E. and Aloimonos, J. 1990. Structure from motion using line correspondences. Int'l J. Comput. Vision, 4: 171-183.

    Google Scholar 

  • Sturm Rudolf. 1909. Die Lehre Von Den Geometrischen Verwandischaften. Leipzig-Berlin, B. G. Teubner.

    Google Scholar 

  • Subbarao, M. 1987. Solution and uniqueness of image flow equations for rigid curved surfaces in motion. In Proc. First Int'l Conf. Comput. Vision, London, UK, pp. 687-692. IEEE.

  • Tsai, R. 1986. An efficient and accurate camera calibration technique for 3D machine vision. In Proc. IEEE Conf. Comput. Vision Pattern Recog., Miami, FL. IEEE, pp. 364-374.

    Google Scholar 

  • Tsai, R. and Huang, T. S. 1982. Estimating three-dimensional motion parameters of a rigid planar patch, II: Singular value decomposition. IEEE Trans. ASSP, 30.

  • Tsai, R. Y. and Huang, T. S. 1984. Uniqueness and estimation of three-dimensional motion parameters of rigid objects with curved surface. IEEE Trans. PAMI, 6(1): 13-26.

    Google Scholar 

  • Viéville, T. and Faugeras, O. 1990. Feed-forward recovery of motion and structure from a sequence of 2D-lines matches. In Proc. Third Int'l Conf. Comput. Vision, Osaka, Japan, pp. 517- 520.

  • Waxman, A. M. and Duncan, J. H. 1986. Binocular image flows: Steps toward stereo-motion fusion. IEEE Trans. PAMI, 8(6): 715- 729.

    Google Scholar 

  • Weng, J., Ahuja, N., and Huang, T. S. 1992. Motion and structure from line correspondences: Closed-form solution, uniqueness and optimization. IEEE Trans. PAMI, 14(3).

  • Wolf, P. R. Elements of Photogrammetry. McGraw-Hill: New York, 2nd edition.

  • Wong, K. W. 1975. Mathematical formulation and digital analysis in close-range pho togrammetry. Photogrammetric Engineering and remote Sensing, 41(11): 1355-1373.

    Google Scholar 

  • Wunderlich, W. 1941. Zur Eindeutigkeitsfrage der hauptaufgabe der Photogrammetrie. Monatshefte f¨ur Mathematik und Physik, 50: 151-164.

    Google Scholar 

  • Zeller, M. 1952. Textbook of Photogrammetry. H. K. Lewis & Company: London.

    Google Scholar 

Download references

Authors
  1. Nassir Navab
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Olivier D. Faugeras
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

About this article

Cite this article

Navab, N., Faugeras, O.D. The Critical Sets of Lines for Camera Displacement Estimation: A Mixed Euclidean-Projective and Constructive Approach. International Journal of Computer Vision 23, 17–44 (1997). https://doi.org/10.1023/A:1007911807871

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/A:1007911807871

Keywords

Search

Navigation