Skip to main content
SpringerLink
Log in
Book cover

International Workshop on Mathematics Mechanization

International Workshop on Geometric Invariance and Applications in Engineering

IWMM 2004, GIAE 2004: Computer Algebra and Geometric Algebra with Applications pp 429–447Cite as

Recent Methods for Reconstructing Surfaces from Multiple Images

  • Conference paper

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 3519))

Abstract

Many objects can be mathematically represented as smooth surfaces with arbitrary topology, and smooth surface reconstruction from images could be cast into a variational problem. The main difficulties are the intrinsic ill-posedness of the reconstruction, image noise, efficiency and scalability. In this paper, we discuss the reconstruction approaches that use volumetric, graph-cut, and level-set optimization tools; and the objective functionals that use different image information, silhouette, photometry, and texture. Our discussion is accompanied by the implementations of these approaches on real examples.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Aloimonos, J.: Visual Shape Computation. Proceedings of the IEEE 76(8), 899–916 (1988)

    Article  Google Scholar 

  2. Baker, S., Szeliski, R., Anandan, P.: A Layered Approach to Stereo Reconstruction. Computer Vision and Pattern Recognition, 434–441 (1998)

    Google Scholar 

  3. Boykov, Y., Kolmogorov, V.: Computing Geodesics and Minimal Surfaces via Graph Cuts. In: Int. Conf. on Computer Vision, pp. 26–33 (2003)

    Google Scholar 

  4. Caselles, V., Kimmel, R., Sapiro, G.: Geodesic active contours. Int. Journal of Computer Vision 22, 61–79 (1997)

    Article  MATH  Google Scholar 

  5. Caselles, V., Kimmel, R., Sapiro, G., Sbert, C.: Minimal surfaces based object segmentation. Trans. on Pattern Analysis and Machine Intelligence 19, 394–398 (1997)

    Article  Google Scholar 

  6. Chen, Q., Medioni, G.: A Volumetric Stereo Matching Method: Application to Image-Based Modeling. Computer Vision and Pattern Recognition, 29–34 (1999)

    Google Scholar 

  7. Cherkassky, B.V., Goldberg, A.V.: On implementing the push-relabel method for the maximum flow problem. Algorithmica 19, 390–410 (1997)

    Article  MATH  MathSciNet  Google Scholar 

  8. Collins, R.T.: A Space-Sweep Approach to True Multi-Image Matching. Computer Vision and Pattern Recognition, 358–363 (1996)

    Google Scholar 

  9. Cross, G., Zisserman, A.: Surface reconstruction from multiple views using apparent contours and surface texture. In: Advanced Research Workshop on Confluence of Computer Vision and Computer Graphics, pp. 25–47 (2000)

    Google Scholar 

  10. Culbertson, W.B., Malzbender, T., Slabaugh, G.: Generalized voxel coloring. In: Triggs, B., Zisserman, A., Szeliski, R. (eds.) ICCV-WS 1999. LNCS, vol. 1883, pp. 100–114. Springer, Heidelberg (2000)

    Chapter  Google Scholar 

  11. Curless, B., Levoy, M.: A volumetric method for building complex models from range images. In: SIGGRAPH, pp. 303–312 (1996)

    Google Scholar 

  12. Faugeras, O., Keriven, R.: Complete dense stereovision using level set methods. In: Burkhardt, H.-J., Neumann, B. (eds.) ECCV 1998. LNCS, vol. 1406, pp. 379–393. Springer, Heidelberg (1998)

    Chapter  Google Scholar 

  13. Fua, P.: From multiple stereo views to multiple 3d surfaces. Int. Journal of Computer Vision 24, 19–35 (1997)

    Article  Google Scholar 

  14. García, B., Brunet, P.: 3D Reconstruction with Projective Octrees and Epipolar Geometry. In: Int. Conf. on Computer Vision, pp. 1067–1072 (1998)

    Google Scholar 

  15. Goldberg, A., Rao, S.: Length functions for flow computations. Technical Report 97-055, NEC Research Institute (1997)

    Google Scholar 

  16. Gortler, S.J., Grzeszczuk, R., Szeliski, R., Cohen, M.: The Lumigraph. In: SIGGRAPH, pp. 43–54 (1996)

    Google Scholar 

  17. Hartley, R.I., Zisserman, A.: Multiple View Geometry in Computer Vision. CU Press (2000)

    Google Scholar 

  18. Hoppe, H., Derose, T., Duchamp, T., McDonalt, J., Stuetzle, W.: Surface reconstruction from unorganized points. Computer Graphics 26, 71–77 (1992)

    Article  Google Scholar 

  19. Intille, S.S., Bobick, A.F.: Disparity-Space Images and Large Occlusion Stereo. In: European Conf. on Computer Vision, pp. 179–186 (1994)

    Google Scholar 

  20. Ishikawa, H., Geiger, D.: Occlusions, discontinuities, and epipolar lines in stereo. In: Burkhardt, H.-J., Neumann, B. (eds.) ECCV 1998. LNCS, vol. 1406, pp. 232–248. Springer, Heidelberg (1998)

    Chapter  Google Scholar 

  21. Kichenassamy, S., Kumar, A., Olver, P., Tannenbaum, A., Yezzi, A.: Gradient flows and geometric active contour models. In: Int. Conf. on Computer Vision, pp. 810–815 (1995)

    Google Scholar 

  22. Kolmogorov, V., Zabih, R.: What Energy Functions can be Minimized via Graph Cuts? In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002. LNCS, vol. 2352, pp. 65–81. Springer, Heidelberg (2002)

    Chapter  Google Scholar 

  23. Kolmogorov, V., Zabih, R.: Multi-camera scene reconstruction via graph cuts. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002. LNCS, vol. 2352, pp. 82–96. Springer, Heidelberg (2002)

    Chapter  Google Scholar 

  24. Kutulakos, K.N., Seitz, S.M.: A theory of shape by space carving. In: Int. Conf. on Computer Vision, pp. 307–314 (1999)

    Google Scholar 

  25. Laurentini, A.: The visual hull concept for silhouette-based image understanding. Trans. on Pattern Analysis and Machine Intelligence 16(2), 150–162 (1994)

    Article  Google Scholar 

  26. Levoy, M., Hanrahan, P.: Light Field Rendering. In: SIGGRAPH, pp. 31–42 (1996)

    Google Scholar 

  27. Lhuillier, M., Quan, L.: Quasi-dense reconstruction from image sequence. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002. LNCS, vol. 2351, pp. 125–139. Springer, Heidelberg (2002)

    Chapter  Google Scholar 

  28. Lhuillier, M., Quan, L.: Surface Reconstruction by Integrating 3D and 2D Data of Multiple Views. In: Int. Conf. on Computer Vision, pp. 1313–1320 (2003)

    Google Scholar 

  29. Lorensen, W.E., Cline, H.E.: Marching Cubes: A High Resolution 3D Surface Construction Algorithm. In: SIGGRAPH, pp. 163–169 (1987)

    Google Scholar 

  30. Matusik, W., Buehler, C., Raskar, R., McMillan, L., Gortler, S.: Image-based visual hulls. In: SIGGRAPH, pp. 369–374 (2000)

    Google Scholar 

  31. Matusik, W., Buehler, C., Raskar, R., McMillan, L.: Polyhedral visual hulls for real-time rendering. In: Eurographics Workshop on Rendering Techniques, pp. 115–126 (2001)

    Google Scholar 

  32. Narayanan, P.J., Rander, P.W., Kanade, T.: Constructing Virtual Worlds using Dense Stereo. In: European Conf. on Computer Vision, pp. 3–10 (1998)

    Google Scholar 

  33. Osher, S., Sethian, J.A.: Fronts propagating with curvature-dependent speed: Algorithms based on hamilton-jacobi formulations. Journal of Computational Physics 79(1), 12–49 (1988)

    Article  MATH  MathSciNet  Google Scholar 

  34. Paris, S., Sillion, F., Quan, L.: A Surface Reconstruction Method Using Global Graph Cut Optimization. In: Asian Conf. on Computer Vision (2004)

    Google Scholar 

  35. Roy, S.: Stereo without epipolar lines: A maximum-flow formulation. Int. Journal of Computer Vision 34, 147–162 (1999)

    Article  Google Scholar 

  36. Seitz, S.M., Dyer, C.R.: View Morphing. In: SIGGRAPH, pp. 21–30 (1996)

    Google Scholar 

  37. Seitz, S.M., Dyer, C.R.: Photorealistic scene reconstruction by voxel coloring. Computer Vision and Pattern Recognition, 1067–1073 (1997)

    Google Scholar 

  38. Sethian, J.A.: Level-set methods and fast marching methods. CU Press (1999)

    Google Scholar 

  39. Slabaugh, G., Culbertson, B., Malzbender, T., Schafer, R.: A survey of methods for volumetric scene reconstruction from photographs. Volume Graphics 01, 81–100 (2001)

    Google Scholar 

  40. Srivastava, S.K., Ahuja, N.: Octree generation from object silhouettes in perspective views. Computer Vision, Graphics and Image Processing 49, 68–84 (1990)

    Article  Google Scholar 

  41. Szeliski, R., Weiss, R.: Robust shape recovery from occluding contours using a linear smoother. Technical Report DEC-CRL-93-7, Digital Equipment Corporation, Cambridge Research Lab (1993)

    Google Scholar 

  42. Szeliski, R., Tonnesen, D., Terzopoulos, D.: Modelling surfaces of arbitrary topology with dynamic particles. Computer Vision and Pattern Recognition, 82–87 (1993)

    Google Scholar 

  43. Szeliski, R.: Rapid octree construction from image sequences. Computer Vision, Graphics and Image Processing 58, 23–32 (1993)

    Article  Google Scholar 

  44. Tang, C.K., Medioni, G.: Curvature-augmented tensor voting for shape inference from noisy 3d data. Trans. on Pattern Analysis and Machine Intelligence 24, 858–864 (2002)

    Article  Google Scholar 

  45. Vaillant, R., Faugeras, O.D.: Using extremal boundaries for 3-D object modeling. Trans. on Pattern Analysis and Machine Intelligence 14(2), 157–173 (1992)

    Article  Google Scholar 

  46. Zhao, H.K., Osher, S., Merriman, B., Kang, M.: Implicit and non-parametric shape reconstruction from unorganized data using a variational level set method. Computer Vision and Image Understanding 80, 295–319 (2000)

    Article  MATH  Google Scholar 

  47. Zeng, G., Paris, S., Quan, L.: Robust Carving for Non-Lambertian Objects. In: Int. Conf. on Pattern Recognition, pp. 119–122 (2004)

    Google Scholar 

  48. Zeng, G., Paris, S., Quan, L., Lhuillier, M.: Surface Reconstruction by Propagating 3D Stereo Data in Multiple 2D Images. In: Pajdla, T., Matas, J(G.) (eds.) ECCV 2004. LNCS, vol. 3021, pp. 163–174. Springer, Heidelberg (2004)

    Chapter  Google Scholar 

  49. Zeng, G., Quan, L.: Silhouette extraction from multiple images of an unknown background. In: Asian Conf. on Computer Vision (2004)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Dep. of Computer Science, HKUST, Clear Water Bay, Kowloon, Hong Kong

    Gang Zeng & Long Quan

  2. LASMEA, UMR CNRS 6602, Université Blaise-Pascal, 63177, Aubière, France

    Maxime Lhuillier

Authors
  1. Gang Zeng
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Maxime Lhuillier
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Long Quan
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Key Laboratory of Mathematics Mechanization, Academy of Mathematics and Systems Science, CAS, P.O. Box, 100080, Beijing, P.R. China

    Hongbo Li

  2. School of Mathematics, University of Minnesota, 55455, Minneapolis, MN, U.S.A.

    Peter J. Olver

  3. Institute of Computer Science, Christian-Albrecht-University, 24098, Kiel, Germany

    Gerald Sommer

Rights and permissions

Reprints and permissions

Copyright information

© 2005 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Zeng, G., Lhuillier, M., Quan, L. (2005). Recent Methods for Reconstructing Surfaces from Multiple Images. In: Li, H., Olver, P.J., Sommer, G. (eds) Computer Algebra and Geometric Algebra with Applications. IWMM GIAE 2004 2004. Lecture Notes in Computer Science, vol 3519. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11499251_30

Download citation

  • DOI: https://doi.org/10.1007/11499251_30

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-26296-1

  • Online ISBN: 978-3-540-32119-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation