Skip to main content
SpringerLink
Log in

Projective Visual Hulls

  • Published:
International Journal of Computer Vision Aims and scope Submit manuscript

Abstract

This article presents a novel method for computing the visual hull of a solid bounded by a smooth surface and observed by a finite set of cameras. The visual hull is the intersection of the visual cones formed by back-projecting the silhouettes found in the corresponding images. We characterize its surface as a generalized polyhedron whose faces are visual cone patches; edges are intersection curves between two viewing cones; and vertices are frontier points where the intersection of two cones is singular, or intersection points where triples of cones meet. We use the mathematical framework of oriented projective differential geometry to develop an image-based algorithm for computing the visual hull. This algorithm works in a weakly calibrated setting–-that is, it only requires projective camera matrices or, equivalently, fundamental matrices for each pair of cameras. The promise of the proposed algorithm is demonstrated with experiments on several challenging data sets and a comparison to another state-of-the-art method.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Ahuja, N. and Veenstra, J. 1989. Generating Octrees from object silhouettes in orthographic views. IEEE Transactions on Pattern Analysis and Machine Intelligence, 11(2):137–149.

    Article  Google Scholar 

  • Arbogast, E. and Mohr, R. 1991. 3D structure inference from image sequences. Journal of Pattern Recognition and Artificial Intelligence, 5(5).

  • Baumgart, B. 1974. Geometric modeling for computer vision. Technical Report AIM-249, Stanford University. Ph.D. Thesis. Department of Computer Science.

  • Bottino, A. and Laurentini, A. 2004. The visual hull of smooth curved objects. IEEE Transactions on Pattern Analysis and Machine Intelligence, 26(12):1622–1632.

    Article  Google Scholar 

  • Boyer, E. and Berger, M.-O. 1997. 3D surface reconstruction using occluding contours. International Journal of Computer Vision, 22(3):219–233.

    Article  Google Scholar 

  • Boyer, E. and Franco, J.-S. 2003. A hybrid approach for computing visual hulls of complex objects. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, vol. 1, pp. 695–701.

    Google Scholar 

  • Brand, M., Kang, K., and Cooper, D.B. 2004. An algebraic solution to visual hull. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, vol. 1, pp. 30–35.

    Google Scholar 

  • Chum, O., Werner, T., and Pajdla, T. 2003. Joint orientation of epipoles. In Proceedings of the British Machine Vision Conference, pp. 73–82.

  • Cipolla, R., åström, K., and Giblin, P. 1995. Motion from the frontier of curved surfaces. In Proceedings of the International Conference on Computer Vision, pp. 269–275.

  • Cipolla, R. and Blake, A. 1992. Surface shape from the deformation of the apparent contour. International Journal of Computer Vision, 9(2):83–112.

    Article  Google Scholar 

  • Cipolla, R. and Giblin, P. 2000. Visual Motion of Curves and Surfaces. Cambridge University Press.

  • Forsyth, D. and Ponce, J. 2002. Computer Vision: A Modern Approach. Prentice-Hall.

  • Franco, J.-S. 2005. Modélisation tridimensionelle à partir de silhouettes. Ph.D. thesis, Institut National Polytechnique de Grenoble.

  • Franco, J.-S. and Boyer, E. 2003. Exact polyhedral visual hulls. In British Machine Vision Conference, pp. 329–338. http://perception.inrialpes.fr/~Franco/EPVH/index.php.

  • Furukawa, Y. and Ponce, J. 2006. Carved visual hulls for image-based modeling. In Proceedings of the European Conference on Computer Vision.

  • Giblin, P. and Weiss, R. 1987. Reconstruction of surfaces from profiles. In Proceedings of the International Conference on Computer Vision, pp. 136–144.

  • Grauman, K., Shakhnarovich, G., and Darrell, T. 2003. A bayesian approach to image-based visual hull reconstruction. In Proceedings of the IEEE Conference on Computer Vision Pattern Recognition, vol. 1, pp. 187–194.

  • Grauman, K., Shakhnarovich, G., and Darrell, T. 2004. Virtual visual hulls: Example-based 3D shape inference from a single silhouette. In Proceedings of the 2nd Workshop on Statistical Methods in Video Processing. MIT AI Memo, AIM-2004-003.

  • Hartley, R. 1998. Computation of the quadrifocal tensor. In Proceedings of the European Conference on Computer Vision, pp. 20–35.

  • Heo, H.-S., Kim, M.-S., and Elber, G. 1999. The intersection of two ruled surfaces. Computer-Aided Design, 31:33–50.

    Article  MATH  Google Scholar 

  • Hernández Esteban, C. and Schmitt, F. 2004. Silhouette and stereo fusion for 3D object modeling. Computer Vision and Image Understanding, 96(3):367–392.

    Article  Google Scholar 

  • Hoffmann, C.M. 1989. Geometric and Solid Modeling. San Mateo, California: Morgan Kaufmann.

    Google Scholar 

  • Hoppe, H., DeRose, T., Duchamp, T., McDonald, J., and Stuetzle, W. 1993. Mesh optimization. In ACM SIGGRAPH, pp. 19–26.

  • Koenderink, J. 1984. What does the occluding contour tell us about solid shape?. Perception, 13:321–330.

    Article  Google Scholar 

  • Kutulakos, K. and Seitz, S. 1999. A theory of shape by space carving. In Proceedings of the International Conference on Computer Vision, pp. 307–314.

  • Laurentini, A. 1994. The visual hull concept for silhouette-based image understanding. IEEE Transactions on Pattern Analysis and Machine Intelligence, 16(2):150–162.

    Article  Google Scholar 

  • Lavest, J.-M., Viala, M., and Dhome, M. 1998. Do we really need an accurate calibration pattern to achieve a reliable camera calibration?. In Proceedings of the European Conference on Computer Vision, pp. 158–174.

  • Lazebnik, S. 2002. Projective Visual Hulls. Master's thesis, University of Illinois at Urbana-Champaign. Also Beckman CVR Technical Report CVR-TR-2002-01, available at http://www-cvr.ai.uiuc.edu/ponce_grp.

  • Lazebnik, S., Boyer, E., and Ponce, J. 2001. On computing exact visual hulls of solids bounded by smooth surfaces. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 156–161.

  • Lazebnik, S. and Ponce, J. 2005. The local projective shape of smooth surfaces and their outlines. International Journal of Computer Vision, 63(1):65–83.

    Article  Google Scholar 

  • Lorensen, W. and Cline, H. 1987. Marching cubes: A high-resolution 3D surface construction algorithm. In ACM SIGGRAPH, pp. 163–170.

  • Martin, W. and Aggarwal, J. 1983. Volumetric description of objects from multiple views. IEEE Transactions on Pattern Analysis and Machine Intelligence, 5(2):150–158.

    Article  Google Scholar 

  • Matsuyama, T., Wu, X., Takai, T., and Nobuhara, S. 2004. Real-time 3D shape reconstruction, dynamic 3D Mesh deformation, and high fidelity visualization for 3D video. Computer Vision and Image Understanding, 96(3):393–434.

    Article  Google Scholar 

  • Matusik, W., Buehler, C., and McMillan, L. 2001. Polyhedral visual hulls for real-time rendering. In Proceedings of the Twelfth Eurographics Workshop on Rendering, pp. 115–125.

  • Matusik, W., Buehler, C., Raskar, R., Gortler, S., and McMillan, L. 2000. Image-based visual hulls. In ACM SIGGRAPH, pp. 369–374.

  • Matusik, W., Pfister, H., Ngan, A., Beardsley, P., Ziegler, R., and McMillan, L. 2002. Image-based 3D photography using opacity hulls. In ACM SIGGRAPH, pp. 427–437.

  • Nistér, D. 2004. Untwisting a projective reconstruction. International Journal of Computer Vision, 60(2):165–183.

    Article  Google Scholar 

  • O'Rourke, J. 1998. Computational Geometry in C, 2nd edition. Cambridge: Cambridge University Press.

    MATH  Google Scholar 

  • Owen, J. and Rockwood, A. 1987. Intersection of general implicit surfaces. In Geometric Modeling: Algorithms and Trends, G. Farin (ed.). Philadelphia: SIAM Publications.

    Google Scholar 

  • Petitjean, S. 1998. A computational geometric approach to visual hulls. International Journal of Computational Geometry and Applications, 8(4):407–436.

    Article  MATH  MathSciNet  Google Scholar 

  • Porrill, J. and Pollard, S. 1991. Curve matching and stereo calibration. Image and Vision Computing, 9(1):45–50.

    Article  Google Scholar 

  • Potmesil, M. 1987. Generating octree models of 3D objects from their silhouettes in a sequence of images. Computer Vision, Graphics and Image Processing, 40:1–29.

    Article  Google Scholar 

  • Rieger, J. 1986. Three-dimensional motion from fixed points of a deforming profile curve. Optics Letters, 11:123–125.

    Google Scholar 

  • Shlyakhter, I., Rozenoer, M., Dorsey, J., and Teller, S. 2001. Reconstructing 3D tree models from intrumented photographs. IEEE Computer Graphics and Applications, 21(3):53–61.

    Article  Google Scholar 

  • Sinha, S. and Pollefeys, M. 2004. Visual-hull reconstruction from uncalibrated and unsynchronized video streams. In Second International Symposium on 3D Data Processing, Visualization and Transmission, pp. 349–356.

  • Sinha, S. and Pollefeys, M. 2005. Multi-view reconstruction using photo-consistency and exact silhouette constraints: A maximum-flow formulation. In ICCV.

  • Srivastava, S. and Ahuja, N. 1990. Octree generation from object silhouettes in perspective views. Computer Vision, Graphics and Image Processing, 49(1):68–84.

    Article  Google Scholar 

  • Stolfi, J. 1991. Oriented Projective Geometry: A Framework for Geometric Computations. Academic Press.

  • Sullivan, S. and Ponce, J. 1998. Automatic model construction, pose estimation, and object recognition from photographs using triangular splines. IEEE Transactions on Pattern Analysis and Machine Intelligence, 20(10):1091–1096.

    Article  Google Scholar 

  • Szeliski, R.: 1993. Rapid octree construction from image sequences. Computer Vision, Graphics, and Image Processing: Image Understanding, 58(1):23–32.

    Article  Google Scholar 

  • Vaillant, R. and Faugeras, O. 1992. Using extremal boundaries for 3D object modeling. IEEE Transactions on Pattern Analysis and Machine Intelligence, 14(2):157–173.

    Article  Google Scholar 

  • Vogiatzis, G., Torr, P.H., and Cipolla, R. 2005. Multi-view stereo via volumetric graph-cuts. In CVPR, pp. 391–398.

  • Werner, T. and Pajdla, T. 2001a. Cheirality in epipolar geometry. In ICCV, pp. 548–553.

  • Werner, T. and Pajdla, T. 2001b. Oriented matching constraints. In Proceedings of the British Machine Vision Conference, pp. 441–450.

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science and Beckman Institute, University of Illinois, Urbana, IL, 61801, USA

    Svetlana Lazebnik, Yasutaka Furukawa & Jean Ponce

  2. Département d’Informatique, Ecole Normale Supérieure, Paris, France

    Jean Ponce

Authors
  1. Svetlana Lazebnik
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yasutaka Furukawa
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jean Ponce
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Svetlana Lazebnik.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Lazebnik, S., Furukawa, Y. & Ponce, J. Projective Visual Hulls. Int J Comput Vision 74, 137–165 (2007). https://doi.org/10.1007/s11263-006-0008-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11263-006-0008-x

Keywords

Search

Navigation