Abstract
We describe texture generation methods for complex objects. Recently developed 3D scanning devices and high-resolution cameras can capture the complex geometry of an object and yield high-resolution images. However, generating a textured model from this input data is still a difficult problem. This task is divided into three subproblems: parameterization, texture combination, and texture restoration. A low-distortion parameterization method is presented, which minimizes geometry stretch energy. Photographs of the object taken from multiple viewpoints under modestly uncontrolled illumination conditions are merged into a seamless texture using our new texture combination method. We also demonstrate a texture restoration method that can fill in missing pixel information when the input photographs do not provide sufficient information to cover the entire surface due to self-occlusion or registration errors. Our methods are fully automatic, except for the registration process between a 3D model and input photographs. We demonstrate the application of our method to human face models for evaluation. The techniques presented in this paper make a consistent and complete pipeline to generate the texture of a complex object.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Arya S, Mount DM, Netanyahu NS, Silverman R, Wu AY (1998) An optimal algorithm for approximate nearest neighbor searching in fixed dimensions. J ACM 46(6):891–923
Ashikhmin M (2001) Synthesizing natural textures. In: Proceedings of the 2001 ACM Symposium on Interactive 3D Graphics, March 19–21 2001, pp 217–226
Ballester C, Bertalmio M, Caselles V, Sapiro G, Verdera J (2001) Filling-in by joint interpolation of vector fields and gray levels. IEEE Trans Image Process 10(8):1200–1211
Balmelli L, Taubin G, Bernardini F (2002) Space-optimized texture maps. Eurographics 21(3):411–420
Bar-Joseph Z, El-Yaniv R, Lischinski D, Werman M (2001) Texture mixing and texture movie synthesis using statistical learning. IEEE Trans Visual Comput Graph 7(2):120–135
Bennis C, Vézien J-M, Iglésias G (1991) Piecewise surface flattening for non-distorted texture mapping. In: Computer Graphics, SIGGRAPH ’91 Conference Proceedings, pp 237–246
Bertalmio M, Sapiro G, Caselles V, Ballester C (2000) Image inpainting. In: Computer Graphics, SIGGRAPH ’00 Conference Proceedings, pp 417–424
Blinn JF (1978) Simulation of wrinkled surfaces. In: Computer Graphics, SIGGRAPH ’78 Conference Proceedings, pp 12:286–292
Blinn JF, Newell ME (1976) Texture and reflection in computer generated images. Commun ACM 19(10):542–547
Brooks S, Dodgson N (2002) Self-similarity based texture editing. ACM Trans Graph, pp 653–656
Burt PJ, Adelson EH (1983) A multi-resolution spline with application to image mosaics. ACM Trans Graph 2(4):217–236
Cignoni P, Montani C, Rocchini C, Scopigno R, Tarini M (1999) Preserving attribute values on simplified meshes by resampling detail textures. Vis Comput 15(10):519–539
Cohen MF, Shade J, Hiller S, Deussen O (2003) Wang tiles for image and texture generation. ACM Trans Graph 22(3):287–294
De Bonet JS (1997) Multiresolution sampling procedure for analysis and synthesis of texture images. In: Computer Graphics, SIGGRAPH ’97 Conference Proceedings, pp 361–368
Debevec PE, Hawkins T, Tchou C, Duiker H-P, Sarokin W, Sagar M (2000) Acquiring the reflectance field of a human face. In: Computer Graphics, SIGGRAPH ’00 Conference Proceedings, pp 145–156
Desbrun M, Meyer M, Alliez P (2002) Intrinsic parameterizations of surface meshes. In: Eurographics 2002 Conference Proceedings 21(3):209–218
Desbrun M, Meyer M, Schröder P, Barr AH (1999) Implicit fairing of irregular meshes using diffusion and curvature flow. In: Computer Graphics, SIGGRAPH ’99 Conference Proceedings, pp 33:317–324
Drori I, Cohen-Or D, Yeshurun H (2003) Fragment-based image completion. ACM Trans Graph 22(3):303–312
Duchamp T, Certain A, DeRose A, Stuetzle W (1997) Hierarchical computation of PL harmonic embeddings. Technical report, University of Washington
Eck M, DeRose T, Duchamp T, Hoppe H, Lounsbery M, Stuetzle W (1995) Multiresolution analysis of arbitrary meshes. In: Computer Graphics, SIGGRAPH ’95 Conference Proceedings, pp 173–182
Efros A, Leung T (1999) Texture synthesis by non-parametric sampling, pp 1033–1038
Efros AA, Freeman WT (2001) Image quilting for texture synthesis and transfer. In: Computer Graphics, SIGGRAPH ’01 Conference Proceedings, pp 341–346
Fleischer K, Laidlaw D, Currin B, Barr A (1995) Cellular texture generation. In: Computer Graphics, SIGGRAPH ’95 Conference Proceedings, pp 239–248
Floater MS (1997) Parametrization and smooth approximation of surface triangulations. Comput Aided Geom Des 14:231–250
Floater MS (2003) Mean value coordinates. Comput Aided Geom Des 20(1):19–27
Floater MS, Hormann K (2004) Surface parameterization: a tutorial and survey. In: Advances on multiresolution in geometric modelling. Springer, Berlin Heidelberg New York, pp 259–284
Foley J, van Dam A, Feiner S, Hughes J (1992) Computer graphics principles and practice, 2nd edn. Addison-Wesley, Boston
Garber DD (1981) Computational models for texture analysis and texture synthesis. Dissertation, University of Southern California
Greene N (1986) Environment mapping and other applications of world projection. IEEE Comput Graph Appl 6(11):21–29
Guskov I, Vidimce K, Sweldens W, Schröder P (2000) Normal meshes. In: Computer Graphics, SIGGRAPH ’00 Conference Proceedings, pp 95–102
Haker S, Angenent S, Tannenbaum A, Kikinis R, Sapiro G, Halle M (2000) Conformal surface parameterization for texture mapping. IEEE Trans Visual Comput Graph 6(2):181–189
Harrison P (2001) A non-hierarchical procedure for re-synthesis of complex textures. In: WSCG 2001 Conference Proceedings, Plyen, Czech Republic, pp 190–197
Heeger DJ, Bergen JR (1995) Pyramid-based texture analysis/synthesis. In: Computer Graphics, SIGGRAPH ’95 Conference Proceedings, pp 229–238
Hertzmann A, Jacobs CE, Oliver N, Curless B, Salesin DH (2001) Image analogies. In: Computer Graphics, SIGGRAPH ’01 Conference Proceedings, pp 327–340
Hirani AN, Totsuka T (1996) Combining frequency and spatial domain information for fast interactive image noise removal. In: Computer Graphics (SIGGRAPH ’96 Conference Proceedings), pp 269–276
Hoppe H (1996) Progressive meshes. In: Computer Graphics, SIGGRAPH ’96 Conference Proceedings, pp 99–108
Hormann K, Greiner G (2000) Mips: an efficient global parametrization method. In: Laurent PJ, Sablonnière P, Schumaker LL (eds), Curve and surface design: Saint-Malo 1999. Vanderbilt University Press, Nashville pp 153–162.
Igarashi T, Cosgrove D (2001) Adaptive unwrapping for interactive texture painting. In: Proceedings of the 2001 Symposium on Interactive 3D graphics, pp 209–216
Igehy H, Pereira L (1997) Image replacement through texture synthesis. In: Proceedings of the IEEE International Conference on Image Processing 3:186–189
Kähler K, Haber J, Yamauchi H, Seidel H-P (2002) Head shop: generating animated head models with anatomical structure. In: Proceedings of the 2002 ACM SIGGRAPH Symposium on Computer Animation, San Antonio, USA, pp 55–64
Khodakovsky A, Litke N, Schröder P (2003) Globally smooth parameterizations with low distortion. ACM Trans Graph 22(3):350–357
Lee AWF, Sweldens W, Schröder P, Cowsar L, Dobkin D (1998) Maps: Multiresolution adaptive parameterization of surfaces. In: Computer Graphics, SIGGRAPH ’98 Conference Proceedings, pp 95–104
Lee W-S, Magnenat-Thalmann N (2000) Fast head modeling for animation. Image Vis Comput 18(4):355–364
Lévy B (2001) Constrained texture mapping for polygonal meshes. In: Computer Graphics, SIGGRAPH ’01 Conference Proceedings, pp 417–424
Lévy B, Petitjean S, Ray N, Maillot J (2002) Least squares conformal maps for automatic texture atlas generation. ACM Trans Graph 21(3):362–371
Liang L, Liu C, Xu Y-Q, Guo B, Shum H-Y (2001) Real-time texture synthesis by patch-based sampling. In: Computer Graphics, SIGGRAPH ’01 Conference Proceeding 20(3):127–150
Maillot J, Yahia H, Verroust A (1993) Interactive texture mapping. In: Computer Graphics, SIGGRAPH ’93 Conference Proceedings, pp 27–34
Marschner SR, Westin SH, Lafortune EPF, Torrance KE, Greenberg DP (1999) Image-based BRDF measurement including human skin. In: Proceedings of the 10th Eurographics Workshop on Rendering, pp 131–144
Miyata K (1990) A method of generating stone wall patterns. In: Computer Graphics, SIGGRAPH ’90 Conference Proceedings, pp 387–394
Nealen A, Alexa M (2003) Hybrid texture synthesis. In: Proceedings of the 13th Eurographics workshop on Rendering, pp 97–105
Neugebauer PJ, Klein K (1999) Texturing 3D models of real world objects from multiple unregistered photographic views. Eurographics 18(3):C245–C256
Oh BM, Chen M, Dorsey J, Durand F (2001) Image-based modeling and photo editing. In: Computer Graphics, SIGGRAPH ’01 Conference Proceedings, pp 433–442
Oliveira MM, Bowen B, McKenna R, Chang YS (2001) Fast digital image inpainting. In: Proceedings of the International Conference on Visualization, Imaging and Image Processing (VIIP 2001), pp 261–266
Pérez P, Gangnet M, Blake A (2003) Poisson image editing. ACM Trans Graph 22(3):313–318
Perona P, Malik J (1990) Scale-space and edge detection using anisotropic diffusion. IEEE Trans Pattern Anal Mach Intell PAMI-12(7):629–639
Pighin F, Hecker J, Lischinski D, Szeliski R, Salesin DH (1998) Synthesizing realistic facial expressions from photographs. In: Computer Graphics, SIGGRAPH ’98 Conference Proceedings, pp 75–84
Piponi D, Borshukov G (2000) Seamless texture mapping of subdivision surfaces by model pelting and texture blending. In: Computer Graphics, SIGGRAPH ’00 Conference Proceedings, pp 471–478
Popat K, Picard RW (1993) Novel cluster-based probability model for texture synthesis, classification, and compression. In: Proceedings of SPIE Visual Communications and Image Processing 2094:756–768
Praun E, Hoppe H (2003) Spherical parametrization and remeshing. ACM Trans Graph
Rocchini C, Cignoni P, Montani C, Scopigno R (1999) Multiple textures stitching and blending on 3D objects. In: Proceedings of the 10th Eurographics Workshop on Rendering, pp 127–138
Saint-Marc P, Chen JS, Medioni G (1991) Adaptive smoothing: a general tool for early vision. IEEE Trans Pattern Anal Mach Intell 13(6):514–529
Sander PV, Snyder J, Gortler SJ, Hoppe H (2001) Texture mapping progressive meshes. In: Computer Graphics, SIGGRAPH ’01 Conference Proceedings, pp 409–416
Sander PV, Gortler SJ, Snyder J, Hoppe H (2002) Signal-specialized parametrization. In: Proceedings of the 13th Eurographics Workshop on Rendering, 26–28 June 2002, pp 87–98
Shannon C (1948) A mathematical theory of communication. Bell Syst Tech J 27(3):379–423
Sheffer A, de Sturler E (2000) Parameterization of faceted surfaces for meshing using angle based flattening. Eng Comput 17(3):326–337
Sheffer A, Hart JC (2002) Seamster: inconspicuous low-distortion texture seam layout. In: Proceedings of IEEE Visualization ’02, pp 291–298
Simoncelli E, Portilla J (1998) Texture characterization via joint statistics of wavelet coefficient magnitudes. In: Fifth IEEE International Conference on Image Processing, Volume I, Chicago, 4–7 October 1998, pp 62–66
Smith SM, Brady JM (1995) SUSAN – A new approach to low level image processing. Technical Report TR95SMS1c, Defence Research Agency, Chertsey, Surrey, UK
Soler C, Cani M-P, Angelidis A (2002) Hierarchical pattern mapping. ACM Trans Graph, pp 673–680
Sorkine O, Cohen-Or D, Goldenthal R, Lischinski D (2002) Bounded-distortion piecewise mesh parameterization. In: Proceedings of IEEE Visualization ’02, pp 355–362
Soucy M, Godin G, Rioux M (1996) A texture-mapping approach for the compression of colored 3D triangulations. Vis Comput 12(10):503–514
Szummer M, Picard RW (1996) Temporal texture modeling. In: ICIP, Lausanne, Switzerland, volume 3, pp 823–826
Tarini M, Yamauchi H, Haber J, Seidel H-P (2002) Texturing faces. In: Proceedings of Graphics Interface 2002, Calgary, Canada, pp 89–98
Tomasi C, Manduchi R (1983) Bilateral filtering for gray and color images. In: ICCV-98, 4–7 January 1998, pp 839–846
Turk G (1991) Generating textures on arbitrary surfaces using reaction-diffusion. In: Computer Graphics, SIGGRAPH ’91 Conference Proceedings, pp 289–298
Turk G (2001) Texture synthesis on surfaces. In: Computer Graphics, SIGGRAPH ’01 Conference Proceedings, pp 347–354
Wei L-Y, Levoy M (2000) Fast texture synthesis using tree-structured vector quantization. In: Computer Graphics, SIGGRAPH ’00 Conference Proceedings, pp 479–488
Wei L-Y, Levoy M (2001) Texture synthesis over arbitrary manifold surfaces. In: Computer Graphics, SIGGRAPH ’01 Conference Proceedings, pp 355–360
Yamauchi H, Haber J, Seidel H-P (2003) Image restoration using multiresolution texture synthesis and image inpainting. In: Proceedings of Computer Graphics International, Tokyo, Japan, pp 120–125
Ying L, Hertzmann A, Biermann H, Zorin D (2001) Texture and shape synthesis on surfaces. In: Eurographics rendering workshop, London, United Kingdom, June 25–27, pp 301–312
Zayer R, Rössl C, Seidel H-P (2004) Variations of angle based flattening. In: Advances in multiresolution for geometric modeling. Springer, Berlin Heidelberg New York
Zelinka S, Garland M (2002) Towards real-time texture synthesis with the jump map. In: Proceedings of the 13th Eurographics Workshop on Rendering, pp 101–107
Zhang J, Zhou K, Velho L, Guo B, Shum H-Y (2003) Synthesis of progressively-variant textures on arbitrary surfaces. ACM Trans Graph 22(3):295–302
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Yamauchi, H., Lensch, H., Haber, J. et al. Textures revisited. Vis Comput 21, 217–241 (2005). https://doi.org/10.1007/s00371-005-0283-5
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00371-005-0283-5