Skip to main content
SpringerLink
Log in

3D object model reconstruction from image sequence based on photometric consistency in volume space

  • Theoretical Advances
  • Published:
Pattern Analysis and Applications Aims and scope Submit manuscript

Abstract

This paper presents a system that can reconstruct a photorealistic 3D object model from an image sequence captured at arbitrary viewpoints. The whole system consists of four steps: camera calibration, volumetric modeling, polygonal model formation and texture mapping. We adopt the shape-from-silhouette approach for volumetric modeling. There are two common types of object surface that are difficult to reconstruct—textureless surface and concave surface. To tackle the problems, we propose to perform the volumetric modeling based on the constraints of viewpoint proximity and photometric consistency in the volume space. The volumetric model is converted to the mesh model for efficient manipulation. Finally, the texture map is generated from the image sequence to give the 3D model a photorealistic appearance. Some reconstructed object models are presented to demonstrate the superior performance of our system as compared with the conventional modeling technique based on the photo-consistency in the image space.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17

Similar content being viewed by others

References

  1. Pavlidis G, Koutsoudis A, Arnaoutoglou F, Tsioukas V, Chamzas C (2007) Methods for 3D digitization of cultural heritage. J Cult Heritage 8:93–98

    Article  Google Scholar 

  2. Mendonça PRS, Wong K-YK, Cipolla R (2001) Epipolar geometry from profiles under circular motion. IEEE Trans Pattern Anal Mach Intell 23(6):604–616

    Article  Google Scholar 

  3. Niem W (1999) Automatic reconstruction of 3D object using a mobile camera. Image Vis Comput 17:125–134

    Article  Google Scholar 

  4. Tsai RY (1987) A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses. J Robot Autom RA-3(4):323–344

    Article  Google Scholar 

  5. Zhang Z (2000) A flexible new technique for camera calibration. IEEE Trans Pattern Anal Mach Intell 22(11):1330–1334

    Article  Google Scholar 

  6. Laurentini A (1994) The visual hull concept for silhouette-based image understanding. IEEE Trans Pattern Anal Mach Intell 16(2):150–162

    Article  Google Scholar 

  7. Koch R, Pollefeys M, van Gool L (1998) Multi viewpoint stereo from uncalibrated video sequences. In: Proceedings of European conference on computer vision, pp 55–71

  8. Matsumoto Y, Fujimura K, Kitamura T (1999) Shape-from-silhouette/stereo and its application to 3-D digitizer. In: Proceedings of discrete geometry for computing imagery, pp 177–188

  9. Seitz SM, Dyer CR (1999) Photorealistic scene reconstruction by voxel coloring. Int J Comput Vis 35(2):151–173

    Article  Google Scholar 

  10. Kutulakos KN, Seitz SM (2000) A theory of shape by space carving. Int J Comput Vis 38(3):199–218

    Article  MATH  Google Scholar 

  11. Hornung S, Kobbelt L (2006) Robust and efficient photo-consistency estimation for volumetric 3D reconstruction. In: Proceedings of European conference on computer vision, pp 179–190

  12. Kolmogorov V, Zabih R (2002) Multi-camera scene reconstruction via graph cuts. In: Proceedings of European conference on computer vision, pp 82–96

  13. Zeng G, Paris S, Quan L, Lhuillier M (2004) Surface reconstruction by propagating 3D stereo data in multiple 2D images. In: Proceedings of European conference on computer vision, pp 163–174

  14. Faugeras O, Keriven R (1998) Complete dense stereovision using level set methods. In: Proceedings of European conference on computer vision, pp 379–393

  15. Lhuillier M, Quan L (2003) Surface reconstruction by integrating 3D and 2D data of multiple views. In: Proceedings of international conference on computer vision, pp 1313–1320

  16. Heckbert PS (1986) Survey of texture mapping. IEEE Comput Graph Appl 6(11):56–67

    Article  Google Scholar 

  17. El-Hakim SF, Brenner C, Roth G (1998) A multi-sensor approach to creating accurate virtual environments. ISPRS J Photogram Remote Sensing 53:379–391

    Article  Google Scholar 

  18. Rocchini C, Cignoni P, Montani C, Scopigno R (1999) Multiple textures stitching and blending on 3D objects. In: Proceedings of 10th eurographics rendering workshop, June 1999, pp 119–130

  19. Lensch HPA, Heidrich W, Seidel HP (2001) A silhouette-based algorithm for texture registration and stitching. Graph Models 63:245–262

    Article  MATH  Google Scholar 

  20. Debevec PE, Taylor CJ, Malik J (1996) Modelling and rendering architecture from photographs: a hybrid geometry- and image-based approach. In: Proceedings of SIGGRAPH’96, ACM SIGGRAPH, Addison Wesley, pp 11–20

  21. Wong SS, Chan KL (2003) 3D modeling from image sequence: lens distortions and partial surface. In: Proceedings of the 3rd IASTED international conference on visualization, imaging, and image processing, pp 773–778

  22. Eid A, Farag A (2005) On the performance evaluation of 3D reconstruction techniques from a sequence of images. EURASIP J Appl Signal Process 13:1948–1955

    Google Scholar 

  23. Lorensen WE, Cline HE (1987) Marching cubes: a high resolution 3D surface construction algorithm. Comput Graph 21(4):163–169

    Article  Google Scholar 

  24. Blais F, Beraldin J-A (2006) Recent developments in 3D multi-modal laser imaging applied to cultural heritage. Mach Vis Appl 17:395–409

    Article  Google Scholar 

  25. Pighin F, Szeliski R, Salesin DH (2002) Modelling and animation realistic faces from images. Int J Comput Vis 50(2):143–169

    Article  MATH  Google Scholar 

Download references

Acknowledgments

The authors would like to thank the Associate Editor and reviewers for their comments and suggestions. The authors would like to acknowledge Mr. Chow Shu Kam for helping to get more results. The work described in this paper was partially supported by a grant from the Research Grant Council of Hong Kong Special Administrative Region, China [Project No. CityU 110807].

Author information

Authors and Affiliations

  1. Department of Computer Engineering and Information Technology, City University of Hong Kong, 83 Tat Chee Avenue, Kowloon, Hong Kong

    S. S. Wong

  2. Department of Electronic Engineering, City University of Hong Kong, 83 Tat Chee Avenue, Kowloon, Hong Kong

    K. L. Chan

Authors
  1. S. S. Wong
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. K. L. Chan
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to K. L. Chan.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Wong, S.S., Chan, K.L. 3D object model reconstruction from image sequence based on photometric consistency in volume space. Pattern Anal Applic 13, 437–450 (2010). https://doi.org/10.1007/s10044-009-0173-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10044-009-0173-y

Keywords

Search

Navigation