Skip to main content
SpringerLink
Log in

Multiview Visibility Estimation for Image-Based Modeling

  • Regular Paper
  • Published:
Journal of Computer Science and Technology Aims and scope Submit manuscript

Abstract

In this paper, we investigate the problem of determining regions in 3D scene visible to some given viewpoints when obstacles are present in the scene. We assume that the obstacles are composed of some opaque objects with closed surfaces. The problem is formulated in an implicit framework where the obstacles are represented by a level set function. The visible and invisible regions of the given viewpoints are determined through an efficient implicit ray tracing technique. As an extension of our approach, we apply the multiview visibility estimation to an image-based modeling technique. The unknown scene geometry and multiview visibility information are incorporated into a variational energy functional. By minimizing the energy functional, the true scene geometry as well as the accurate visibility information of the multiple views can be recovered from a number of scene images. This makes it feasible to handle the visibility problem of multiple views by our approach when the true scene geometry is unknown.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Greene N, Kass M, Miller G. Hierarchical Z-buffer visibility. In Proc. the 20th Annual Conference on Computer Graphics and Interactive Techniques, Anaheim, USA, Aug. 2–6, 1993, pp.231-240.

  2. Agarwal P K, Micha S. Ray shooting amidst convex polygons in 2D. Journal of Algorithms, 1996, 21(3): 508–519.

    Article  MATH  MathSciNet  Google Scholar 

  3. Agarwal P K, Micha S. Ray shooting amidst convex polyhedra and polyhedral terrains in three dimensions. SIAM Journal on Computing, 1996, 25(1): 100–116.

    Article  MATH  MathSciNet  Google Scholar 

  4. Franklin S C, David F. Interactive ray tracing with the visibility complex. Computers and Graphics, 1999, 23(5): 703–717.

    Article  Google Scholar 

  5. Steven P, William M, Peter-Pike J S, Peter S, Brian S, Charles H. Interactive ray tracing. In Proc. ACM Symposium on Interactive 3D Graphics, Atlanta, USA, Apr. 26–28, 1999, pp.119-126.

  6. Lempitsky V, Boykov Y, Ivanov D. Oriented visibility for multiview reconstruction. In Proc. the 9th European Conference on Computer Vision, Graz, Austria, May 7–13, 2006, pp.226-238.

  7. Vogiatzis G, Torr P, Cipolla R. Multi-view stereo via volumetric graph-cuts. In Proc. IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Diego, USA, Jun. 20–25, 2005, pp.391-398.

  8. Tran S, Davis L. 3D surface reconstruction using graph cuts with surface constraints. In Proc. the 9th European Conference on Computer Vision, Graz, Austria, May 7–13, 2006, pp.219-231.

  9. Esteban C, Schmitt F. Silhouette and stereo fusion for 3D object modeling. Computer Vision and Image Understanding, 2004, 96(3): 367–392.

    Article  Google Scholar 

  10. Kolev K, Klodt M, Brox T, Cremers D. Continuous global optimization in multiview 3D reconstruction. International Journal of Computer Vision, 2009, 84(1): 80–96.

    Article  Google Scholar 

  11. Piegel L, Tiller W. The NURBS Book, Second Edition. Springer-Verlag, 1996.

  12. Rogers D F. An introduction to NURBS. Morgan Kaufman, 2000.

  13. Edelsbrunner H. Shape reconstruction with Delaunay complex. In Proc. the 3rd Latin American Symposium, Campinas, Brazil, Apr. 20–24, 1998, pp.119-132.

  14. Zhang L X, Yang Y M, Jia Y D. State-based visibility for 3D reconstruction from multiple views. In Proc. ECCV Workshop on Multi-Camera and Multi-Modal Sensor Fusion Algorithms and Applications, Marseille, France, Oct. 12–18, 2008.

  15. ChinWP, Ntafos S. Shortest watchman routes in simple polygons. Discrete and Computational Geometry, 1991, 6(1): 9-31.

    Article  MathSciNet  Google Scholar 

  16. Tsai Y H, Cheng L T, Burchard P, Osher S, Sapiro G. Visibility and its dynamics in a PDE based implicit framework. Journal of Computational Physics, 2004, 199(1): 260–290.

    Article  MATH  MathSciNet  Google Scholar 

  17. Faugeras O, Keriven R. Variational principles, surface evolution, PDEs, level set methods, and the stereo problem. IEEE Transactions on Image Processing, 1998, 7(3): 336–344.

    Article  MATH  MathSciNet  Google Scholar 

  18. Jin H, Soatto S, Yezzi A. Multi-view beyond Lambert. In Proc. IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Madison, USA, Jun. 16–22, 2003, pp.171-178.

  19. Gargallo P, Prados E, Sturm P. Minimizing the reprojection error in surface reconstruction from images. In Proc. the 11th IEEE International Conference on Computer Vision, Rio de Janeiro, Brazil, Oct. 14–20, 2007, pp.1-8.

  20. Osher S, Sethian J A. Fronts propagating with curvature dependent speed: Algorithms based on Hamilton-Jacobi formulations. Journal of Computational Physics, 1988, 79(1): 14-49.

    Article  MathSciNet  Google Scholar 

  21. Osher S, Fedkiw R. Level Set Methods and Dynamic Implicit Surfaces. Springer-Verlag, 2002.

  22. Alejandro T, Kang S B, Seitz S. Multi-view multi-exposure stereo. In Proc. the 3rd International Symposium on 3D Data Processing, Visualization, and Transmission, Chapel Hill, USA, Jun. 14–16, 2006, pp.861-868.

  23. Kutulakos K N, Seitz S M. A theory of shape by space carving. International Journal of Computer Vision, 2000, 38(3): 199–218.

    Article  MATH  Google Scholar 

  24. Laurentini A. The visual hull concept for silhouette-based image understanding. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1994, 16(2): 150–162.

    Article  Google Scholar 

  25. Li C M, Xu C Y, Gui C F, Fox M D. Level set evolution without re-initialization: A new variational formulation. In Proc. IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Diego, USA, Jun. 20–25, 2005, pp.430-436.

  26. Chan T, Vese L. Active contours without edges. IEEE Transactions on Image Processing, 2001, 10(2): 266–277.

    Article  MATH  Google Scholar 

  27. Seitz S M, Curless B, Diebel J, Scharstein D, Szeliski R. A comparison and evaluation of multi-view stereo reconstruction algorithms. In Proc. IEEE Computer Society Conference on Computer Vision and Pattern Recognition, New York, USA, Jun. 17–22, 2006, pp.519-526.

  28. http://vision.middlebury.edu/mview, 2006.

Download references

Author information

Authors and Affiliations

  1. Beijing Laboratory of Intelligent Information Technology, School of Computer Science, Beijing Institute of Technology, Beijing, 100081, China

    Liu-Xin Zhang (Member, CCF), Ming-Tao Pei (Member, CCF) & Yun-De Jia (Senior Member, CCF)

Authors
  1. Liu-Xin Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ming-Tao Pei
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yun-De Jia
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding authors

Correspondence to Ming-Tao Pei or Yun-De Jia.

Additional information

This work was partially supported by the National Natural Science Foundation of China under Grant No. 90920009 and the National High-Tech Research and Development 863 Program of China under Grant No. 2009AA01Z323.

Electronic Supplementary Material

Below is the link to the electronic supplementary material.

(PDF 96.2 kb)

Rights and permissions

Reprints and permissions

About this article

Cite this article

Zhang, LX., Pei, MT. & Jia, YD. Multiview Visibility Estimation for Image-Based Modeling. J. Comput. Sci. Technol. 26, 1000–1010 (2011). https://doi.org/10.1007/s11390-011-1196-6

Download citation

  • Received:

  • Revised:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11390-011-1196-6

Keywords

Search

Navigation