Abstract
Before corresponding points in images taken with two cameras can be used to recover distances to objects in a scene, one has to determine the position and orientation of one camera relative to the other. This is the classic photogrammetric problem of relative orientation, central to the interpretation of binocular stereo information. Iterative methods for determining relative orientation were developed long ago; without them we would not have most of the topographic maps we do today. Relative orientation is also of importance in the recovery of motion and shape from an image sequence when successive frames are widely separated in time. Workers in motion vision are rediscovering some of the methods of photogrammetry.
Described here is a simple iterative scheme for recovering relative orientation that, unlike existing methods, does not require a good initial guess for the baseline and the rotation. The data required is a pair of bundles of corresponding rays from the two projection centers to points in the scene. It is well known that at least five pairs of rays are needed. Less appears to be known about the existence of multiple solutions and their interpretation. These issues are discussed here. The unambiguous determination of all of the parameters of relative orientation is not possible when the observed points lie on a critical surface. These surfaces and their degenerate forms are analyzed as well.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
L.U. Bender, “Derivation of parallax equation,” Photogrammetric Engineering 33 (10): 1175–1179, 1967.
A. Brandenberger, “Fehlertheorie der äusseren Orientierung von Steilaufnahmen,” Ph.D. Thesis, Eidgenössische Technische Hochschule, Zürich, Switzerland, 1947.
P. Brou, “Using the Gaussian image to find the orientation of an object,” Intern. J. Robotics Res. 3 (4): 89–125, 1983.
A.R. Bruss and B.K.P. Horn, “Passive navigation,” Comput. Vision, Graphics, Image Process. 21 (1): 3–20, 1983.
O.D. Faugeras and S. Maybank, “Motion from point matches: Multiplicity of solutions,” Proc. IEEE Workshop Motion Vision, March 20–22, 1989.
W. Forstner, “Rellability analysis of parameter estimation in linear models with applications to mensuration problems in computer vision,” Comput. Vision, Graphics, Image Process. 40 (3): 273–310, 1987.
R.B. Forrest, “AP-C plotter orientation,” Photogrammetric Engineering 32 (5): 1024–1027, 1966.
C.S. Fraser and D.C. Brown, “Industrial photogrammetry: New developments and recent applications,” Photogrammetric Record 12 (68): 197–217, October 1986.
M.A. Gennert, “A computational framework for understanding problems in stereo vision.” Ph.D. thesis, Department of Electrical Engineering and Computer Science, MIT, August 1987.
C.D. Ghilani, “Numerically assisted relative orientation of the Kern PG-2,” Photogramm. Enginner. Remote Sensing 49 (10): 1457–1459, 1983.
S.K. Ghosh, “Relative orientation improvement,” Photogrammetric Engineering 32 (3): 410–414, 1966.
S.K. Ghosh, Theory of Stereophotogrammetry, Ohio University Bookstores: Columbus, OH, 1972.
C. Gill, “Relative orientation of segmented, panoramic grid models on the AP-II,” Photogrammetric Engineering 30: 957–962, 1964.
B. Hallert, Photogrammetry. McGraw-Hill: New York, 1960.
D. Hilbert and S. Cohn-Vossen, Geometry and the Imagination. Chelsea Publishing: New York, 1953, 1983.
L. Hinsken, “Algorithmen zur Beschaffung von Näherungswerten für die Orientierung von beliebig im Raum angeordneten Strahlenbündeln,” Dissertation, Deutsche Geodätische Kommission, Reihe C, Heft Nr. 333, München, Federal Republic of Germany, 1987.
L. Hinsken, “A singularity-free algorithm for spatial orientation of bundles,” Intern. Arch. Photogramm. Remote Sensing 27, B5, comm. v, pp. 262–272, 1988.
W. Hofmann, “Das Problem der ‘Gefährlichen Flächen’ in Theorie und Praxis,” Ph.D. Thesis, Technische Hochschule München. Published in 1953 by Deutsche Geodätische Kommission, München, Federal Republic of Germany, 1949.
B.K.P. Horn, Robot Vision. MIT Press: Cambridge, MA, and McGraw-Hill, New York, 1986.
B.K.P. Horn, “Closed-form solution of absolute orientation using unit quaternions,” J. Opt. Soc. Am. A 4 (4): 629–642, 1987.
B.K.P. Horn, “Motion fields are hardly ever ambiguous,” Intern. J. Comput. Vision 1 (3): 263–278, 1987.
B.K.P. Horn, “Relative orientation,” memo 994, Artificial Intelligence Laboratory, MIT, Cambridge, MA, 1987. Also, Proc. Image Understanding Workshop, 6–8 April, Morgan Kaufman Publishers: San Mateo, CA, pp. 826–837, 1988.
B.K.P. Horn, H.M. Hilden, and S. Negahdaripour, “Closed-form solution of absolute orientation using orthonormal matrices, J. Opt. Soc. Am. A 5 (7): 1127–1135, July 1988.
B.K.P. Horn and E.J. WeldonJr., “Direct methods for recovering motion,” Intern. J. Comput. Vision 2 (1): 51–76, June 1988.
H. Jochmann, “Number of orientation points,” Photogrammetric Engineering 31 (4): 670–679, 1965.
G.A. Korn and T.M. Korn, Mathematical Handbook for Scientists and Engineers, 2nd ed. McGraw-Hill: New York, 1968.
H.C. Longuet-Higgins, “A computer algorithm for reconstructing a scene from two projections,” Nature 293: 133–135, September 1981.
H.C. Longuet-Higgins, “The reconstruction of a scene from two projections—Configurations that defeat the eight-point algorithm,” IEEE, Proc. 1st Conf. Artif. Intell. Applications, Denver, CO, 1984.
H.C. Longuet-Higgins, “Multiple interpretations of a pair of images of a surface,” Proc. Roy. Soc. London, 418: 1–15, 1988.
H.C. Longuet-Higgins and K. Prazdny, “The interpretation of a moving retinal image,” Proc. Roy. Soc. London B 208: 385–397, 1980.
E.M. Mikhail and F. Ackerman, Observations and Least Squares. Harper & Row: New York, 1976.
F. Moffit and E.M. Mikhail, Photogrammetry, 3rd ed. Harper & Row: New York, 1980.
S. Negahdaripour, “Multiple interpretation of the shape and motion of objects from two perspective images.” Unpublished manuscript of the Waikiki Surfing and Computer Vision Society of the Department of Electrical Engineering at the University of Hawaii at Manoa, Honolulu, HI, 1989.
A.N. Netravali, T.S. Huang, A.S. Krisnakumar, and R.J. Holt, “Algebraic methods in 3-D motion estimation from two-view point correspondences.” Unpublished internal report, A.T.&T. Bell Laboratories: Murray Hill, NJ, 1980.
A. Okamoto, “Orientation and construction of models—Part I: The orientation problem in close-range photogrammetry,” Photogramm. Engineer. Remote Sensing 47 (10): 1437–1454, 1981.
H.L. Oswal, “Comparison of elements of relative orientation,” Photogrammetric Engineering 33 (3): 335–339, 1967.
A. Pope, “An advantageous, alternative parameterization of rotations for analytical photogrammetry,” ESSA Technical Report CaGS-39, Coast and Geodetic Survey, U.S. Department of Commerce, Rockville, MA. Also Symposium on Computational Photogrammetry. American Society of Photogrammetry: Alexandria, Virginia, January 7–9, 1970.
K. Rinner, “Studien über eine allgemeine, vorraussetzungslose Lösung des Folgebildanschlusses,” Österreichische Zeitschrift für Vermessung, Sonderheft 23, 1963.
S. Sailor, “Demonstration board for stereoscopic plotter orientation,” Photogrammetric Engineering 31 (1): 176–179, January, 1965.
E. Salamin, “Application of quaternions to computation with potations.” Unpulbished Internal Report, Stanford University, Stanford, CA, 1979.
G.H. Schut, “An analysis of methods and results in analytical aerial triangulation,” Photogrammetria 14: 16–32, 1957–1958.
G.H. Schut, “Construction of orthogonal matrices and their application in analytical photogrammetry,” Photogrammetria 15 (4): 149–162, 1958–1959.
K. Schwidefsky, An Outline of Photogrammetry. Translated by John Fosberry, 2nd ed. Pitman & Sons: London, 1973.
K. Schwidefsky, and F. Ackermann, Photogrammetrie, Teubner: Stuttgart, Federal Republic of Germany, 1976.
C.C. Slama, C. Theurer, and S.W. Hendrikson (eds.), Manual of Photogrammetry. American Society of Photogrammetry: Falls Church, VA, 1980.
J.H. Stuelpnagle, “On the parameterization of the three-dimensional rotation group,” SIAM Review 6 (4): 422–430, October 1964.
R.H. Taylor, “Planning and execution of straight line manipulator trajectories.” In Robot Motion: Planning and Control, M.J. Brady, J.M. Hollerbach, T.L. Johnson, R. Lozano-Pérez, and M.T. Mason (eds.), MIT Press: Cambridge, MA, 1982.
E.H. Thompson, “A Method for the construction of orthonormal matries,” Photogrammetric Record 3 (13): 55–59, April 1959.
E.H. Thompson, “A rational algebraic formulation of the problem of relative orientation,” Photogrammetric Record 3 (14): 152–159, 1959.
E.H. Thompson, “A note on relative orientation,” Photogrammetric Record 4 (24): 483–488, 1964.
E.H. Thompson, “The projective theory of relative orientation,” Photogrammetria 23: 67–75, 1968.
R.Y. Tsai and T.S. Huang, “Uniqueness and estimation of three-dimensional motion parameters of rigid objects with curved surfaces,” IEEE Trans. PAMI 6 (1): 13–27, 1984.
S. Ullman, The Interpretation of Visual Motion. MIT Press: Cambridge, MA, 1979.
A.J.Van Der Weele, “The relative orientation of photographs of mountainous terrain,” Photogrammetria 16 (2): 161–169, 1959–1960.
P.R. Wolf, Elements of Photogrammetry, 2nd ed. McGraw-Hill: New York, 1983.
M. Zeller, Textbook of Photogrammetry. H.K. Lewis & Company: London, 1952.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Horn, B.K.P. Relative orientation. Int J Comput Vision 4, 59–78 (1990). https://doi.org/10.1007/BF00137443
Issue Date:
DOI: https://doi.org/10.1007/BF00137443