Abstract
This paper proposes a methodology to texture 3D objects with low geometric features from sequentially taken photos. These models pose a challenge to current approaches since they are mainly driven by geometric features—such as contours—that can be extracted from the photographs and uniquely matched with the 3D model. However, when dealing with certain types of objects, such as vases or mechanical equipments, for example, it is not uncommon to find cases where the geometric information is insufficient.
Our method compensates for the lack of geometric features by using a variation of a contour-based approach that is guided not only by external contours, but also by the internal ones extracted directly from the photos. To align the features a custom-made optimization method is described that avoids common convergence pitfalls encountered in this scenario. In addition, pursuing a fully automatic solution, a linear approach based on feature matching is employed to generate a first guess for the nonlinear optimization. The overall goal is to facilitate an on-site registration process where the photos are taken in a sequential manner and aligned as they are acquired.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Bannai, N., Agathos, A., Fisher, R.B.: Fusing multiple color images for texturing models. In: Proceedings of the 3D Data Processing, Visualization, and Transmission, 2nd International Symposium, 3DPVT’04, pp. 558–565. IEEE Computer Society, Washington (2004)
Billeter, M., Olsson, O., Assarsson, U.: Efficient stream compaction on wide SIMD many-core architectures. In: Proceedings of the Conference on High Performance Graphics 2009, HPG’09, pp. 159–166. ACM, New York (2009)
Callieri, M., Cignoni, P., Corsini, M., Scopigno, R.: Masked photo blending: mapping dense photographic dataset on high-resolution 3d models. Comput. Graph. 32(4), 464–473 (2008)
Chuang, M., Luo, L., Brown, B.J., Rusinkiewicz, S., Kazhdan, M.: Estimating the Laplace–Beltrami operator by restricting 3D functions. In: Proceedings of the Symposium on Geometry Processing, pp. 1475–1484. Eurographics Association, Geneva (2009)
Corsini, M., Dellepiane, M., Ponchio, F., Scopigno, R.: Image-to-geometry registration: a mutual information method exploiting illumination-related geometric properties. Comput. Graph. Forum 28(7), 1755–1764 (2009)
DeCarlo, D., Finkelstein, A., Rusinkiewicz, S., Santella, A.: Suggestive contours for conveying shape. ACM Trans. Graph. 22, 848–855 (2003)
Dellepiane, M., Marroquim, R., Callieri, M., Cignoni, P., Scopigno, R.: Flow-based local optimization for image-to-geometry projection. IEEE Trans. Vis. Comput. Graph. 18, 463–474 (2012)
Felzenszwalb, P.F., Huttenlocher, D.P.: Distance transforms of sampled functions. Tech. rep., Cornell Computing and Information Science (2004)
Fiore, P.D.: Efficient linear solution of exterior orientation. IEEE Trans. Pattern Anal. Mach. Intell. 23(2), 140–148 (2001)
Gal, R., Wexler, Y., Ofek, E., Hoppe, H., Cohen-Or, D.: Seamless montage for texturing models. Comput. Graph. Forum (Eurograph.) 29(2), 479–486 (2010)
Guennebaud, G., Jacob, B., et al.: Eigen v3 (2010). http://eigen.tuxfamily.org
Harris, C., Stephens, M.: A combined corner and edge detection. In: Proceedings of the Fourth Alvey Vision Conference, pp. 147–151 (1988)
Lensch, H.P.A., Heidrich, W., Seidel, H.P.: A Silhouette-based algorithm for texture registration and stitching. Graph. Models 63(4), 245–262 (2001)
Liu, L., Stamos, I., Yu, G., Wolberg, G., Zokai, S.: Multiview geometry for texture mapping 2d images onto 3d range data. In: CVPR’06: Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 2293–2300. IEEE Computer Society, Washington (2006)
Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60, 91–110 (2004)
Madsen, K., Nielsen, H.B., Tingleff, O.: Methods for Non-linear Least Squares Problems, 2nd edn. (2004)
Matsushita, K., Kaneko, T.: Efficient and handy texture mapping on 3d surfaces. Comput. Graph. Forum 18(3), 349–358 (1999)
Neugebauer, P.J., Klein, K.: Texturing 3d models of real world objects from multiple unregistered photographic views. Comput. Graph. Forum 18(3), 245–256 (1999)
Acknowledgements
The authors would like to thank the colleagues from the Visual Computing Lab (CNR-Pisa) for their help and support on using their texture blending software, and the researches and technicians from MAST (Museum of Astronomy and Affine Sciences—Rio de Janeiro) for the collaboration in the digitalization process of the meridian circle.
This work was supported by Rio de Janeiro’s research funding agency—FAPERJ.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Marroquim, R., Pfeiffer, G., Carvalho, F. et al. Texturing 3D models from sequential photos. Vis Comput 28, 983–993 (2012). https://doi.org/10.1007/s00371-012-0743-7
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00371-012-0743-7