Abstract
The objective of this work is to automatically estimate the trifocal tensor and feature correspondences over images triplets, under unrestricted camera motions and changes in internal parameters between views. To this end we extend a previous wide baseline 2-view algorithm to 3-views. The algorithm is based on establishing feature correspondences between views together with a homography which enables a viewpoint invariant affinity score. The input is the three images, and the output the trifocal tensor and image correspondences, which in turn facilitate a projective reconstruction of the cameras and scene.
We also investigate the direct computation of the fundamental matrix for view pairs, and the trifocal tensor for view triplets, from the homographies alone. This method is successful, but not as yet as accurate as computation from point correspondences.
Finally, it is shown that the 3-view algorithm allows reconstruction of 3D points, lines and cameras from a disparate set of 11 views. All the algorithms have been implemented and assessed on real images, and processing is automatic throughout.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
E.H. Adelson and P.J. Burt. Image data compression with the laplacian pyramid. In PRIP81, pages 218–223, 1981.
P. Beardsley, P. Torr, and A. Zisserman. 3D model acquisition from extended image sequences. In Proc. ECCV, LNCS 1064/1065, pages 683–695. Springer-Verlag, 1996.
R. C. Bolles and R. Horaud. 3DPO: A three-dimensional part orientation system. In T. Kanade, editor, Three Dimensional Vision, pages 399–450. Kluwer Academic Publishers, 1987.
P. E. Debevec, C. J. Taylor, and J. Malik. Modeling and rendering architecture from photographs: A hybrid geometry-and image-based approach. In Proceedings, ACM SIGGRAPH, pages 11–20, 1996.
O.D. Faugeras and F. Lustman. Motion and structure from motion in a piecewise planar environment. International Journal of Pattern Recognition and Artificial Intelligence, 2:485–508, 1988.
M. A. Fischler and R. C. Bolles. Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography. Comm. ACM, 24(6):381–395, 1981.
A. W. Fitzgibbon and A. Zisserman. Automatic camera recovery for closed or open image sequences. In Proc. ECCV, pages 311–326, 1998.
N. Georgis, M. Petrou, and J. Kittler. Error guided design of a 3d vision system. IEEE T-PAMI, 20:366–379, 4 1998.
F. Glazer, G. Reynolds, and P. Anandan. Scene matching by hierarchical correlation. In Proc. CVPR, pages 432–441, 1983.
C. J. Harris and M. Stephens. A combined corner and edge detector. In Alvey Vision Conf., pages 147–151, 1988.
R. I. Hartley. A linear method for reconstruction from lines and points. In Proc. ICCV, pages 882–887, 1995.
S. Laveau. Geometry of a system of N cameras. Theory, estimation, and applications. PhD thesis, INRIA, 1996.
P. Pritchett and A. Zisserman. Wide baseline stereo matching. In Proc. ICCV, pages 754–760, January 1998.
C. Rothwell, A. Zisserman, D. Forsyth, and J. Mundy. Planar object recognition using projective shape representation. IJCV, 16(2), 1995.
C. Schmid, R. Mohr, and C. Bauckhage. Comparing and evaluating interest points. In Proc. ICCV, pages 230–235, 1998.
C. Schmid and A. Zisserman. Automatic line matching across views. In Proc. CVPR, pages 666–671, 1997.
L. S. Shapiro. Affine Analysis of Image Sequences. PhD thesis, University of Oxford, England, 1993.
A. Shashua. Trilinearity in visual recognition by alignment. In Proc. ECCV, volume 1, pages 479–484, May 1994.
D. Sinclair, H. Christensen, and C. Rothwell. Using the relation between a plane projectivity and the fundamental matrix. SCIA, 1995.
M. E. Spetsakis and J. Aloimonos. Structure from motion using line correspondences. IJCV, 4(3):171–183, 1990.
C. E. Springer. Geometry and Analysis of Projective Spaces. Freeman, 1964.
C. Taylor, P. Debevec, and J. Malik. Reconstructing polyhedral models of architectural scenes from photographs. In Proc. ECCV. Springer-Verlag, 1996.
P. H. S. Torr and D. W. Murray. Outlier detection and motion segmentation. In Proc SPIE Sensor Fusion VI, pages 432–443, Boston, Sep 1993.
P. H. S. Torr and A. Zisserman. Performance characterizaton of fundamental matrix estimation under image degradation. Machine Vision and Applications, 9:321–333, 1997.
P. H. S. Torr and A. Zisserman. Robust parameterization and computation of the trifocal tensor. Image and Vision Computing, 15:591–605, 1997.
L. Van Gool, M. Proesmans, and A. Zisserman. Grouping and invariants using planar homologies. In Workshop on Geometrical Modeling and Invariants for Computer Vision. Xidian University Press, 1995.
C. Zeller. Projective, Affine and Euclidean Calibration in Compute Vision and the Application of Three Dimensional Perception. PhD thesis, RbotVis Group, INRIA Sophia-Antipolis, 1996.
Z. Zhang, R. Deriche, O. Faugeras, and Q. Luong. A robust technique for matching two uncalibrated images through the recovery of the unknown epipolar geometry. Artificial Intelligence, 78:87–119, 1995.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1998 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Pritchett, P., Zisserman, A. (1998). Matching and Reconstruction from Widely Separated Views. In: Koch, R., Van Gool, L. (eds) 3D Structure from Multiple Images of Large-Scale Environments. SMILE 1998. Lecture Notes in Computer Science, vol 1506. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-49437-5_6
Download citation
DOI: https://doi.org/10.1007/3-540-49437-5_6
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-65310-3
Online ISBN: 978-3-540-49437-9
eBook Packages: Springer Book Archive