Abstract
In this paper several new methods for estimating scene structure and camera motion from an image sequence taken by affine cameras are presented. All methods can incorporate both point, line and conic features in a unified manner. The correspondence between features in different images is assumed to be known.
Three new tensor representations are introduced describing the viewing geometry for two and three cameras. The centred affine epipoles can be used to constrain the location of corresponding points and conics in two images. The third order, or alternatively, the reduced third order centred affine tensors can be used to constrain the locations of corresponding points, lines and conics in three images. The reduced third order tensors contain only 12 components compared to the 16 components obtained when reducing the trifocal tensor to affine cameras.
A new factorization method is presented. The novelty lies in the ability to handle not only point features, but also line and conic features concurrently. Another complementary method based on the so-called closure constraints is also presented. The advantage of this method is the ability to handle missing data in a simple and uniform manner. Finally, experiments performed on both simulated and real data are given, including a comparison with other methods.
Similar content being viewed by others
References
Atkinson, K.B. 1996. Close Range Photogrammetry and Machine Vision. Whittles Publishing.
Bretzner, L. and Lindeberg, T. 1998. Use your hand as a 3-d mouse, or, relative orientation from extended sequences of sparse point and line correspondences using the affine trifocal tensor. In Proc. 5th European Conf. on Computer Vision, Freiburg, Germany.
Faugeras, O.D. 1992. What can be seen in three dimensions with an uncalibrated stereo rig? In Proc. 2nd European Conf. on Computer Vision, G. Sandini (Ed.), Springer-Verlag: Santa Margherita Ligure, Italy, pp. 563–578.
Heyden, A. 1995. Geometry and Algebra of Multipe Projective Transformations. Ph.D. Thesis, Lund Institute of Technology, Sweden.
Jacobs, D. 1997. Linear fitting with missing data: Applications to structure-from-motion and to characterizing intensity images. In Proc. Conf. Computer Vision and Pattern Recognition, Puerto Rico, USA, pp. 206–212.
Kahl, F. and Heyden, A. 1998. Structure and motion from points, lines and conics with affine cameras. In Proc. 5th European Conf. on Computer Vision, Freiburg, Germany.
Koenderink, J.J. and van Doorn, A.J. 1991. Affine structure from motion. J. Opt. Soc. America, 8(2):377–385.
Ma, S.D. 1993. Conic-based stereo, motion estimation, and pose determination. Int. Journal of Computer Vision, 10(1):7–25.
Maybank, S. 1993. Theory of Reconstruction from Image Motion. Springer-Verlag: Berlin, Heidelberg, New York.
McLauchlan, P.F. and Murray, D.W. 1995. A unifying framework for structure and motion recovery from image sequences. In Proc. 5th Int. Conf. on Computer Vision, MIT, Boston, MA, IEEE Computer Society Press, Los Alamitos, California, pp. 314–320.
Mundy, J.L. and Zisserman, A. (Eds). 1992. Geometric Invariance in Computer Vision. MIT Press, Cambridge Ma, USA.
Quan, L. and Kanade, T. 1997. Affine structure from line correspondences with uncalibrated affine cameras. IEEE Trans. Pattern Analysis and Machine Intelligence, 19(8).
Quan, L. and Ohta, Y. 1998. A new linear method for euclidean motion/structure from three calibrated affine views. In Proc. Conf. Computer Vision and Pattern Recognition, Santa Barbara, USA, pp. 172–177.
Semple, J.G. and Kneebone, G.T. 1952. Algebraic Projective Geometry. Clarendon Press, Oxford.
Shapiro, L.S. 1995. Affine Analysis of Image Sequences. Cambridge University Press.
Shapiro, L.S., Zisserman, A., and Brady, M. 1995. 3d motion recovery via affine epipolar geometry. Int. Journal of Computer Vision, 16(2):147–182.
Shashua, A. and Navab, N. 1996. Relative affine structure: Canonical model for 3d from 2d geometry and applications. IEEE Trans. Pattern Anal. Machine Intell, 18(9):873–883.
Sparr, G. 1996. Simultaneous reconstruction of scene structure and camera locations from uncalibrated image sequences. In Proc. Int. Conf. on Pattern Recognition, Vienna, Austria.
Sturm, P. and Triggs, B. 1996. A factorization based algorithm for multi-image projective structure and motion. In Proc. 4th European Conf. on Computer Vision, Cambridge, UK, pp. 709–720.
Tomasi, C. and Kanade, T. 1992. Shape and motion from image streams under orthography: A factorization method. Int. Journal of Computer Vision, 9(2):137–154.
Torr, P. 1995. Motion Segmentation and Outlier Detection. Ph.D. Thesis, Department of Engineering Science, University of Oxford.
Triggs, B. 1996. Factorization methods for projective structure and motion. In Proc. Conf. Computer Vision and Pattern Recognition, San Francisco, USA.
Triggs, B. 1997. Linear projective reconstruction from matching tensors. Image and Vision Computing, 15(8):617–625.
Weng, J., Huang, T.S., and Ahuja, N. 1992. Motion and structure from line correspondences: Closed-form solution, uniqueness, and optimization. IEEE Trans. Pattern Analysis and Machine Intelligence, 14(3):318–336.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Kahl, F., Heyden, A. Affine Structure and Motion from Points, Lines and Conics. International Journal of Computer Vision 33, 163–180 (1999). https://doi.org/10.1023/A:1008192713051
Issue Date:
DOI: https://doi.org/10.1023/A:1008192713051