Abstract
This paper addresses the problem of reconstructing non- overlapping transparent and opaque surfaces from multiple view images. The reconstruction is attained through progressive refinement of an initial 3D shape by minimizing the error between the images of the object and the initial 3D shape. The challenge is to simultaneously reconstruct both the transparent and opaque surfaces given only a limited number of images. Any refinement methods can theoretically be applied if analytic relation between pixel value in the training images and vertices position of the initial 3D shape is known. This paper investigates such analytic relations for reconstructing opaque and transparent surfaces. The analytic relation for opaque surface follows diffuse reflection model, whereas for transparent surface follows ray tracing model. However, both relations can be converged for reconstruction both surfaces into texture mapping model. To improve the reconstruction results several strategies including regularization, hierarchical learning, and simulated annealing are investigated.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Matusik, M., Hanspeter, P., Zieglar, R., Ngan, N., McMillan, L.: Acquisition and Rendering of Transparent and Refractive Objects. In: Rendering Techniques, pp. 267–278 (2002)
Zongker, D.E., Werner, D.M., Curless, B., Salesin, D.: Environment Matting and Compositing. In: SIGGRAPH, pp. 205–214 (1999)
Bolle, R.M., Vemuri, B.C.: On three-dimensional surface reconstruction methods. IEEE Trans. on PAMI 13(1), 1–13 (1991)
Saito, M., Kashiwagi, H., Sato, Y., Ikeuchi, K.: Measurement of Surface Orientations of Transparent Objects Using Polarization in Highlight. In: CVPR, p. 1381 (1999)
Interrante, V., Fuchs, H., Pizer, S.M.: Conveying the 3D Shape of Smoothly Curving Transparent Surfaces via Texture. IEEE Trans. on VCG 3(2) (1997)
Murase, H.: Surface Shape Reconstruction of a Nonrigid Transport Object Using Refraction and Motion. IEEE Trans. on PAMI 14(10), 1045–1052 (1992)
Hata, S., Saitoh, Y., Kumamura, S., Kaida, K.: Shape Extraction of Transparent Object Using Genetic Algorithm. In: ICPR96, D93.6 (1996)
Chuang, Y., Zongker, E., Hindorff, J., Curless, B., Salesin, D., Szeliski, R.: Environment matting extensions: towards higher accuracy. In: SIGGRAPH, pp. 121–130 (2000)
Wexler, Y., Fitzgibbon, A.W., Zisserman, A.: Image-based Environment matting. In: Rendering Techniques, pp. 279–290 (2002)
Szeliski, R., Avidan, S., Anandan, P.: Layer Extraction from Multiple Images Containing Reflections and Transparency. In: CVPR, p. 1246 (2000)
Eckert, G., Wingbermuhle, J., Niem, W.: Mesh Based Shape Refinement for Reconstructing 3D-Objects from Multiple Images. In: CVMP04, pp. 103–110 (2004)
Yaguchi, S., Saito, H.: Mesh Based 3D Shape Deformation for Image Based Rendering from Uncalibrated Multiple Views. In: ICAT05 (2005)
Nobuhara, S., Matsuyama, T.: Dynamic 3D Shape from Multi-Viewpoint Images using Deformable Mesh Models. In: Proc. of 3rd Int. Symposium on Image and Signal Processing and Analysis, pp. 192–197 (2003)
Smith, A.R., Blinn, J.F.: Blue Screen Matting. In: SIGGRAPH, pp. 259–268 (1996)
Chen, Z., Haykin, S.: On Different Facets of Regularization Theory. Neural Computation 14(12), 2791–2846 (2002)
Hearn, D., Baker, M.P.: Computer Graphics: C Version. Prentice Hall, Englewood Cliffs (1998)
Romeo, F., Vincentelli, A.S.: A theoretical framework for Simulated Annealing. Algorithmica 6, 302–345 (1991)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer Berlin Heidelberg
About this paper
Cite this paper
Fanany, M.I., Kumazawa, I. (2007). Analytic Reconstruction of Transparent and Opaque Surfaces from Texture Images. In: Martí, J., Benedí, J.M., Mendonça, A.M., Serrat, J. (eds) Pattern Recognition and Image Analysis. IbPRIA 2007. Lecture Notes in Computer Science, vol 4478. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-72849-8_48
Download citation
DOI: https://doi.org/10.1007/978-3-540-72849-8_48
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-72848-1
Online ISBN: 978-3-540-72849-8
eBook Packages: Computer ScienceComputer Science (R0)