Skip to main content

A Guided Tour Through Multiview Relations

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 1506))

Abstract

The aim of this paper is to give the non-specialist reader a comprehensible and intuitive introduction to multiview relations. It focusses on the geometric interpretation of the different image relationships, but also presents a concise mathematical formalism which allows to derive the algebraic expressions explicitly in an elementary and uniform manner. Special attention has been paid both to these multiview constraints as geometric incidence relations between image features (i.e. points and lines) in different views as well as to their use for image transfer. Moreover, an attempt has been made to provide sufficient pointers to the literature where the interested reader may find additional information on particular subjects as well as alternative viewpoints and mathematical formalisms.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. S. Avidan and A. Shashua, Novel view synthesis in tensor space, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR’), Puerto Rico, IEEE Computer Society Press, Los Alamitos, 1997, pp. 1034–1040.

    Chapter  Google Scholar 

  2. S. Avidan and A. Shashua, Unifying two-view and three-view geometry, Proceedings of the ARPA Image Understanding Workshop (IUW’97), Morgan Kaufmann Publishers, Orlando, FL, 1997.

    Google Scholar 

  3. S. Avidan and A. Shashua, Novel view synthesis by cascading trilinear tensors, submitted to IEEE Transactions on Visualisation and Computer Graphics (TVCG).

    Google Scholar 

  4. P.A. Beardsley, P.H.S. Torr, and A. Zisserman, 3DModel acquisition from extended image sequence, pp. II.683–II.695, in: B. Buxton and R. Cipolla (eds.), Computer Vision-ECCV’96, LNCS, Vol. 1065, Springer-Verlag, Berlin, 1996.

    Google Scholar 

  5. O.D. Faugeras, What can be seen in three dimensions with an uncalibrated stereo rig, pp. 563–578, in: G. Sandini (ed.), Computer Vision-(ECCV’92), Lecture Notes in Computer Science, Vol. 588, Springer-Verlag, Berlin, 1992.

    Google Scholar 

  6. O. Faugeras, Three-Dimensional Computer Vision: A Geometric Viewpoint, MIT Press, Cambridge, MA / London, UK, 1993.

    Google Scholar 

  7. O. Faugeras and B. Mourrain, On the geometry and algebra of the point and line correspondences between N images, Proc. 5 th International Conference on Computer Vision (ICCV’95), Cambridge, MA, IEEE Computer Society Press, Los Alamitos, CA, 1995, pp. 951–956.

    Chapter  Google Scholar 

  8. O. Faugeras and B. Mourrain, About the correspondences of points between N images, Proceedings of the IEEE workshop on the Representation of Visual Scenes, Boston, MA, IEEE Computer Society Press, Los Alamitos, CA, 1995.

    Google Scholar 

  9. O. Faugeras and T. Papadopoulo, A nonlinear method for estimating the projective geometry of three views, Proc. 6th International Conference on Computer Vision (ICCV’98), Bombay, India, Narosa Publishing House, New Delhi / London, 1998, pp. 477–484.

    Google Scholar 

  10. A.W. Fitzgibbon and A. Zisserman, Automatic camera recovery for closed or open image sequences, pp. I.311–I.326, in: H. Burkhardt and B. Neumann (eds.), Computer Vision-ECCV’98, LNCS, Vol. 1406, Springer-Verlag, Berlin, 1998.

    Chapter  Google Scholar 

  11. R.I. Hartley, Estimation of relative camera positions for uncalibrated cameras, pp. 579–587, in: G. Sandini (ed.), Computer Vision-(ECCV’92), Lecture Notes in Computer Science, Vol. 588, Springer-Verlag, Berlin, 1992.

    Google Scholar 

  12. R.I. Hartley, Projective reconstruction from line correspondences, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR’94), Seattle, WA, IEEE Computer Society Press, Los Alamitos 1994, pp. 903–907.

    Chapter  Google Scholar 

  13. R.I. Hartley, Lines and points in three views-a unified approach, Proceedings of the ARPA Image Understanding Workshop (IUW’94), Monterey, CA, Morgan Kaufmann Publishers, Orlando, FL, 1994, pp. 1009–1016.

    Google Scholar 

  14. R.I. Hartley, A linear method for reconstruction from lines and points, Proceedings of the 5 th International Conference on Computer Vision (ICCV’95), Cambridge, MA, IEEE Computer Society Press, Los Alamitos, CA, 1995, pp. 882–887.

    Chapter  Google Scholar 

  15. R.I. Hartley, Multilinear Relationships between coordinates of corresponding image points and lines, Computer Vision Applied Geometry, Nordfjordeid, Norway, 1995.

    Google Scholar 

  16. R.I. Hartley, In defence of the 8-point algorithm, Proceedings of the 5th International Conference on Computer Vision (ICCV’95), Cambridge, MA, IEEE Computer Society Press, Los Alamitos, CA, 1995, pp. 1064–1070.

    Chapter  Google Scholar 

  17. R.I. Hartley, Lines and points in three views and the trifocal tensor, International Journal of Computer Vision, Vol. 22 (1997), no. 2, pp. 125–140.

    Article  Google Scholar 

  18. R.I. Hartley, Minimizing algebraic error in geometric estimation problems, Proceedings of the 6th International Conference on Computer Vision (ICCV’98), Bombay, India, Narosa Publishing House, New Delhi / London, 1998, pp. 469–476.

    Google Scholar 

  19. R.I. Hartley, Computation of the quadrifocal tensor, pp. I.20–I.35, in: H. Burkhardt and B. Neumann (eds.), Computer Vision-ECCV’98, Lecture Notes in Computer Science, Vol. 1406, Springer-Verlag, Berlin, 1998.

    Google Scholar 

  20. R.I. Hartley and A. Zisserman, Multiple View Geometry in Computer Vision, Cambridge University Press, Cambridge, UK, to appear.

    Google Scholar 

  21. R. Hartley, R. Gupta, and T. Chang, Stereo from uncalibrated cameras, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR’92), IEEE Computer Society Press, Los Alamitos, CA, 1992, pp. 761–764.

    Google Scholar 

  22. A. Heyden, A common framework for multiple view tensors, pp. I.3–I.19, in: H. Burkhardt and B. Neumann (eds.), Computer Vision-ECCV’98, Lecture Notes in Computer Science, Vol. 1406, Springer-Verlag, Berlin, 1998.

    Google Scholar 

  23. A. Heyden and K. Åström, Algebraic varieties in multiple view geometry, pp. II.671–II.682, in: B. Buxton and R. Cipolla (eds.), Computer Vision-ECCV’96, LNCS, Vol. 1065, Springer-Verlag, Berlin, 1996.

    Google Scholar 

  24. A. Heyden and K. Åström, Algebraic properties of multilinear constraints, Mathematical Methods in the Applied Sciences, Vol. 20 (1997), pp. 1135–1162.

    Article  MATH  MathSciNet  Google Scholar 

  25. H.C. Longuet-Higgins, A computer algorithm for reconstructing a scene from two projections, Nature, Vol. 293 (1981), no. 10, pp. 133–135.

    Article  Google Scholar 

  26. Q.-T. Luong and O.D. Faugeras, The fundamental matrix: Theory, algorithms, and stability analysis, Intern. Journal Computer Vision, Vol. 17 (1996), pp. 43–75.

    Article  Google Scholar 

  27. Q.-T. Luong and T. Viéville, Canonic representations for the geometries of multiple projective views, pp. I.589–I.599, in: J.-O. Ecklund, Computer Vision-ECCV’94, LNCS, Vol. 800, Springer-Verlag, Berlin, 1994.

    Google Scholar 

  28. Q.-T. Luong and T. Viéville, Canonic representations for the geometries of multiple projective views, Comp. Vision Image Understanding, Vol. 64 (1996), pp. 589–599.

    Google Scholar 

  29. S.J. Maybank, The critical line concruence for reconstruction from three images, Applic. Algebra in Engineering, Comm. & Computing, Vol. 6 (1995), pp. 89–113.

    Article  MATH  MathSciNet  Google Scholar 

  30. S.J. Maybank and A. Shashua, Ambiguity in reconstruction from images of six points, Proc. 6 th International Conference on Computer Vision (ICCV’98), Bombay, India, Narosa Publishing House, New Delhi / London, 1998, pp. 703–708.

    Google Scholar 

  31. N. Navab, O.D. Faugeras, and T. Viéville, The critical sets of lines for camera displacement estimation: A mixed Euclidean-projective and constructive approach, Proc. of the 4 th International Conference on Computer Vision (ICCV’93), Berlin, Germany, IEEE Computer Society Press, Los Alamitos, CA, 1993, pp. 713–723.

    Google Scholar 

  32. T. Papadopoulo and O.D. Faugeras, A new characterization of the trifocal tensor, pp. I.109–I.123, in: H. Burkhardt and B. Neumann (eds.), Computer Vision-ECCV’98, LNCS, Vol. 1406, Springer-Verlag, Berlin, 1998.

    Chapter  Google Scholar 

  33. A. Shashua, Trilinearity in visual recognition by alignment, pp. I.479–I.484, in: J.-O. Ecklund, Computer Vision-ECCV’94, Lecture Notes in Computer Science, Vol. 800, Springer-Verlag, Berlin / Heidelberg / New York / Tokyo, 1994.

    Google Scholar 

  34. A. Shashua, Projective structure from uncalibrated images, IEEE Trans. Pattern Analysis and Artificial Intellingence (T-PAMI), Vol. 16 (1994), no. 8, pp. 778–790.

    Article  Google Scholar 

  35. A. Shashua, Algebraic functions for recognition, IEEE Trans. Pattern Analysis and Artificial Intellingence (T-PAMI), Vol. 17 (1995), no. 8, pp. 779–789.

    Article  Google Scholar 

  36. A. Shashua, Multiple-view geometry and photometry and the trilinear tensor, Computer Vision and Applied Geometry, Nordfjordeid, Norway, 1995.

    Google Scholar 

  37. A. Shashua, Trilinear tensor: The fundamental construct of multiple-view geometry and its applications, Proceedings of the International Workshop on Algebraic Frames for the Perception Action Cycle (AFPAC97), Kiel, Germany, 1997.

    Google Scholar 

  38. A. Shashua and S. Avidan, The rank 4 constraint in multiple (≥ 3) view geometry, pp. II.196–II.206, in: B. Buxton and R. Cipolla (eds.), Computer Vision-ECCV’96, LNCS, Vol. 1065, Springer-Verlag, Berlin, 1996.

    Google Scholar 

  39. A. Shashua and N. Navab, Relative affine structure: Theory and application to 3D reconstruction from perspective views, Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR’94), Seattle, WA, IEEE Computer Society Press, Los Alamitos, CA, 1994, pp. 483–489.

    Chapter  Google Scholar 

  40. A. Shashua and M. Werman, Trilinearity of three perspective views and its associated tensor, Proc. 5 th International Conference on Computer Vision (ICCV’95), Cambridge, MA, IEEE Computer Society Press, Los Alamitos, 1995, pp. 920–925.

    Chapter  Google Scholar 

  41. M.E. Spetsakis, A linear method for point and line-based structure from motion, CVGIP: Image Understanding, Vol. 56 (1992), no. 2, pp. 230–241.

    Article  MATH  Google Scholar 

  42. M.E. Spetsakis and J. Aloimonos, A unified theory of structure from motion, Proceedings of the DARPA Image Understanding Workshop (IUW’90), Morgan Kaufmann Publishers, Orlando, FL, 1990, pp. 271–283.

    Google Scholar 

  43. G.P. Stein and A. Shashua, On degeneracy of linear reconstruction from three views: linear line complex and applications, pp. II.862–II.878, in: H. Burkhardt and B. Neumann (eds.), Computer Vision-ECCV’98, Lecture Notes in Computer Science, Vol. 1407, Springer-Verlag, Berlin / Heidelberg / New York / Tokyo, 1998.

    Google Scholar 

  44. P.H.S. Torr and D.W. Murray, The development and comparison of robust methods for estimating the fundamental matrix, International Journal of Computer Vision, Vol. 24 (1997), no. 3, pp. 271–300.

    Article  Google Scholar 

  45. P.H.S. Torr and A. Zisserman, Robust parameterization and computation of the trifocal tensor, Image and Vision Computing, Vol. 15 (1997), pp. 591–605.

    Article  Google Scholar 

  46. P.H.S. Torr and A. Zisserman, Robust computation and parameterization of multiview relations, Proc. 6 th International Conference on Computer Vision (ICCV’98), Bombay, India, Narosa Publishing House, New Delhi / London, 1998, pp. 727–732.

    Google Scholar 

  47. B. Triggs, Matching constraints and the joint image, Proc. 5 th International Conference on Computer Vision (ICCV’95), Cambridge, MA, IEEE Computer Society Press, Los Alamitos, CA, 1995, pp. 338–343.

    Chapter  Google Scholar 

  48. B. Triggs, The geometry of projective reconstruction I: matching constraints and the joint image, submitted to International Journal of Computer Vision, (1995).

    Google Scholar 

  49. B. Triggs, A new approach to geometric fitting, unpublished paper, 1998. (Can be obtained from: http://www.inrialpes.fr/movi/people/triggs/publications.html).

  50. J. Weng, T.S. Huang, and N. Ahuja, Motion and structure from line correspondences: Closed-form solution, uniqueness, and optimization, IEEE Trans. Pattern Analysis and Artificial Intellingence (T-PAMI), Vol. 14 (1992), no. 3, pp. 318–336.

    Article  Google Scholar 

  51. M. Werman and A. Shashua, The study of 3D-from-2D using elimination, Proceedings of the 5 th International Conference on Computer Vision (ICCV’ 95), Cambridge, MA, IEEE Computer Society Press, Los Alamitos, CA, 1995, pp. 473–479.

    Chapter  Google Scholar 

  52. A. Zisserman, A Users Guide to the Trifocal Tensor, Department of Engineering Science, University of Oxford, 1996. Also a chapter in [20].

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 1998 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Moons, T. (1998). A Guided Tour Through Multiview Relations. In: Koch, R., Van Gool, L. (eds) 3D Structure from Multiple Images of Large-Scale Environments. SMILE 1998. Lecture Notes in Computer Science, vol 1506. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-49437-5_21

Download citation

  • DOI: https://doi.org/10.1007/3-540-49437-5_21

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-65310-3

  • Online ISBN: 978-3-540-49437-9

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics