Kersten Schuster
Skip Abstract Section
Skip Supplemental Material SectionAbstract
We present a method for example-based texturing of triangular 3D meshes. Our algorithm maps a small 2D texture sample onto objects of arbitrary size in a seamless fashion, with no visible repetitions and low overall distortion. It requires minimal user interaction and can be applied to complex, multi-layered input materials that are not required to be tileable. Our framework integrates a patch-based approach with per-pixel compositing. To minimize visual artifacts, we run a three-level optimization that starts with a rigid alignment of texture patches (macro scale), then continues with non-rigid adjustments (meso scale) and finally performs pixel-level texture blending (micro scale). We demonstrate that the relevance of the three levels depends on the texture content and type (stochastic, structured, or anisotropic textures).
Supplemental Material
Available for Download
zip
schuster.zip (192.9 MB)
Supplemental movie, appendix, image and software files for, A Three-Level Approach to Texture Mapping and Synthesis on 3D Surfaces
- Paul J. Besl and Neil D. McKay. 1992. A Method for Registration of 3-D Shapes. IEEE Trans. Pattern Anal. Mach. Intell. 14, 2 (Feb. 1992), 239--256.Google Scholar
Digital Library
- David Bommes, Marcel Campen, Hans-Christian Ebke, Pierre Alliez, and Leif Kobbelt. 2013. Integer-grid maps for reliable quad meshing. ACM Transactions on Graphics (TOG) 32, 4 (2013), 98.Google ScholarDigital Library
- David Bommes, Henrik Zimmer, and Leif Kobbelt. 2009. Mixed-integer Quadrangulation. ACM Trans. Graph. 28, 3, Article 77 (July 2009), 10 pages.Google ScholarDigital Library
- David Bommes, Henrik Zimmer, and Leif Kobbelt. 2010. Practical mixed-integer optimization for geometry processing. In International Conference on Curves and Surfaces. Springer, 193--206.Google Scholar
- Brent Burley. 2019. On Histogram-Preserving Blending for Randomized Texture Tiling. Journal of Computer Graphics Techniques (JCGT) 8, 4 (8 November 2019), 31--53.Google Scholar
- Marcel Campen, David Bommes, and Leif Kobbelt. 2015. Quantized global parametrization. ACM Transactions on Graphics (TOG) 34, 6 (2015), 192.Google ScholarDigital Library
- Thomas Deliot and Eric Heitz. 2019. Procedural Stochastic Textures by Tiling and Blending. In GPU Zen 2: Advanced Rendering Techniques, W. Engel (Ed.). Black Cat Publishing Inc., 144 West D Street Suite 204, Encinitas, CA 92009, Chapter 2 in Part IV, 177--200.Google Scholar
- Yue Dong, Sylvain Lefebvre, Xin Tong, and George Drettakis. 2008. Lazy Solid Texture Synthesis. In Proceedings of the Nineteenth Eurographics Conference on Rendering (EGSR '08). Eurographics Association, Aire-la-Ville, Switzerland, Switzerland, 1165--1174.Google ScholarDigital Library
- Qiang. Du, Vance. Faber, and Max. Gunzburger. 1999. Centroidal Voronoi Tessellations: Applications and Algorithms. SIAM Rev. 41, 4 (1999), 637--676.Google Scholar
- Jérémie Dumas, An Lu, Sylvain Lefebvre, Jun Wu, and Christian Dick. 2015. By-example Synthesis of Structurally Sound Patterns. ACM Trans. Graph. 34, 4, Article 137 (July 2015), 12 pages.Google ScholarDigital Library
- Alexei A. Efros and William T. Freeman. 2001. Image Quilting for Texture Synthesis and Transfer. In Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '01). ACM, New York, NY, USA, 341--346.Google Scholar
- Alexei A. Efros and Thomas K. Leung. 1999. Texture Synthesis by Non-Parametric Sampling. In Proceedings of the International Conference on Computer Vision-Volume 2 - Volume 2 (ICCV '99). IEEE Computer Society, Washington, DC, USA, 1033-.Google ScholarDigital Library
- Martin A. Fischler and Robert C. Bolles. 1981. Random Sample Consensus: A Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography. Commun. ACM 24, 6 (June 1981), 381--395.Google ScholarDigital Library
- Bruno Galerne, Ares Lagae, Sylvain Lefebvre, and George Drettakis. 2012. Gabor noise by example. ACM Transactions on Graphics (TOG) 31, 4 (2012), 73.Google ScholarDigital Library
- Leon Gatys, Alexander S Ecker, and Matthias Bethge. 2015. Texture synthesis using convolutional neural networks. In Advances in neural information processing systems. 262--270.Google Scholar
- Guillaume Gilet, Basile Sauvage, Kenneth Vanhoey, Jean-Michel Dischler, and Djamchid Ghazanfarpour. 2014. Local random-phase noise for procedural texturing. ACM Transactions on Graphics (TOG) 33, 6 (2014), 195.Google ScholarDigital Library
- Gabriele Gorla, Victoria Interrante, and Guillermo Sapiro. 2001. Growing fitted textures. SIGGRAPH 2001 Sketches and Applications (2001), 191.Google Scholar
- Gael Guennebaud, Benoît Jacob, et al. 2010. Eigen v3. http://eigen.tuxfamily.org.Google Scholar
- Jianwei Han, Kun Zhou, Li-Yi Wei, Minmin Gong, Hujun Bao, Xinming Zhang, and Baining Guo. 2006. Fast example-based surface texture synthesis via discrete optimization. The Visual Computer 22, 9-11 (2006), 918--925.Google ScholarDigital Library
- Christopher G Harris, Mike Stephens, et al. 1988. A combined corner and edge detector.. In Alvey vision conference, Vol. 15. Citeseer, 10--5244.Google Scholar
- David J. Heeger and James R. Bergen. 1995. Pyramid-based Texture Analysis/Synthesis. In Proceedings of the 22Nd Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '95). ACM, New York, NY, USA, 229--238.Google Scholar
- Eric Heitz and Fabrice Neyret. 2018. High-Performance By-Example Noise Using a Histogram-Preserving Blending Operator. Proc. ACM Comput. Graph. Interact. Tech. 1, 2, Article 31 (Aug. 2018), 25 pages.Google ScholarDigital Library
- Alec Jacobson, Daniele Panozzo, et al. 2018. libigl: A simple C++ geometry processing library. https://libigl.github.io/.Google Scholar
- Nikolay Jetchev, Urs Bergmann, and Roland Vollgraf. 2016. Texture synthesis with spatial generative adversarial networks. arXiv preprint arXiv:1611.08207 (2016).Google Scholar
- Jiaya Jia, Jian Sun, Chi-Keung Tang, and Heung-Yeung Shum. 2006. Drag-and-drop Pasting. ACM Trans. Graph. 25, 3 (July 2006), 631--637.Google ScholarDigital Library
- Johannes Kopf, Chi-Wing Fu, Daniel Cohen-Or, Oliver Deussen, Dani Lischinski, and Tien-Tsin Wong. 2007. Solid Texture Synthesis from 2D Exemplars. ACM Trans. Graph. 26, 3, Article 2 (July 2007).Google ScholarDigital Library
- Vivek Kwatra, Arno Schödl, Irfan Essa, Greg Turk, and Aaron Bobick. 2003. Graphcut textures: image and video synthesis using graph cuts. In ACM Transactions on Graphics (ToG), Vol. 22. ACM, 277--286.Google ScholarDigital Library
- Ares Lagae, Peter Vangorp, Toon Lenaerts, and Philip Dutré. 2010. Procedural Isotropic Stochastic Textures by Example. Computers & Graphics (Special issue on Procedural Methods in Computer Graphics) 34, 4 (2010), 312--321.Google Scholar
- Anass Lasram and Sylvain Lefebvre. 2012. Parallel Patch-based Texture Synthesis. In Proceedings of the Fourth ACM SIGGRAPH/Eurographics Conference on High-Performance Graphics (EGGH-HPG'12). Eurographics Association, Goslar Germany, Germany, 115--124.Google ScholarDigital Library
- Sylvain Lefebvre and Hugues Hoppe. 2005. Parallel Controllable Texture Synthesis. In ACM SIGGRAPH 2005 Papers (SIGGRAPH '05). ACM, New York, NY, USA, 777--786.Google Scholar
- Sylvain Lefebvre and Hugues Hoppe. 2006. Appearance-space Texture Synthesis. In ACM SIGGRAPH 2006 Papers (SIGGRAPH '06). ACM, New York, NY, USA, 541--548.Google Scholar
- Bruno Lévy, Sylvain Petitjean, Nicolas Ray, and Jérome Maillot. 2002. Least Squares Conformal Maps for Automatic Texture Atlas Generation. ACM Trans. Graph. 21, 3 (July 2002), 362--371.Google ScholarDigital Library
- Andrew Nealen and Marc Alexa. 2003. Hybrid Texture Synthesis. In Proceedings of the 14th Eurographics Workshop on Rendering (EGRW '03). Eurographics Association, Aire-la-Ville, Switzerland, Switzerland, 97--105.Google ScholarDigital Library
- Marcin Novotni, Reinhard Klein, et al. 2002. Computing geodesic distances on triangular meshes. In In Proc. of WSCG'2002.Google Scholar
- Patrick Pérez, Michel Gangnet, and Andrew Blake. 2003. Poisson Image Editing. ACM Trans. Graph. 22, 3 (July 2003), 313--318.Google ScholarDigital Library
- Ken Perlin. 1985. An image synthesizer. ACM Siggraph Computer Graphics 19, 3 (1985), 287--296.Google ScholarDigital Library
- Nico Pietroni, Paolo Cignoni, Miguel Otaduy, and Roberto Scopigno. 2010. Solid-texture synthesis: a survey. IEEE Computer Graphics and Applications 30, 4 (2010), 74--89.Google ScholarDigital Library
- Javier Portilla and Eero P. Simoncelli. 2000. A Parametric Texture Model Based on Joint Statistics of Complex Wavelet Coefficients. International Journal of Computer Vision 40, 1 (01 Oct 2000), 49--70.Google ScholarDigital Library
- Emil Praun, Adam Finkelstein, and Hugues Hoppe. 2000. Lapped Textures. In Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '00). ACM Press/Addison-Wesley Publishing Co., New York, NY, USA, 465--470.Google Scholar
- Michael Rabinovich, Roi Poranne, Daniele Panozzo, and Olga Sorkine-Hornung. 2017. Scalable Locally Injective Mappings. ACM Trans. Graph. 36, 4, Article 37a (April 2017).Google ScholarDigital Library
- Ryan Schmidt, Cindy Grimm, and Brian Wyvill. 2006. Interactive Decal Compositing with Discrete Exponential Maps. ACM Trans. Graph. 25, 3 (July 2006), 605--613.Google ScholarDigital Library
- Stanford. 2020. The Stanford 3D Scanning Repository. http://www-graphics.stanford.edu/data/3Dscanrep/. Accessed: 2020-03-13.Google Scholar
- Textures.com. 2020. Textures for 3D, graphic design and Photoshop. https://www.textures.com/. Accessed: 2019-12--12.Google Scholar
- Thingiverse. 2011a. Ghost Model by navalguijo on Thingiverse. https://www.thingiverse.com/thing:12585 Accessed March 17, 2020.Google Scholar
- Thingiverse. 2011b. Part of Sesame Street Sign Model by cptnAWESOME on Thingiverse. https://www.thingiverse.com/thing:14974 Accessed March 17, 2020.Google Scholar
- Thingiverse. 2012. Anvil Model by WorksBySolo on Thingiverse. https://www.thingiverse.com/thing:31397 Accessed March 17, 2020.Google Scholar
- Thingiverse. 2015. Metatron/Entangled Model by bathsheba on Thingiverse. https://www.thingiverse.com/thing:1146870 Accessed March 17, 2020.Google Scholar
- Xin Tong, Jingdan Zhang, Ligang Liu, Xi Wang, Baining Guo, and Heung-Yeung Shum. 2002. Synthesis of Bidirectional Texture Functions on Arbitrary Surfaces. ACM Trans. Graph. 21, 3 (July 2002), 665--672.Google ScholarDigital Library
- Greg Turk. 2001. Texture Synthesis on Surfaces. In Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '01). ACM, New York, NY, USA, 347--354.Google ScholarDigital Library
- Dmitry Ulyanov, Vadim Lebedev, Andrea Vedaldi, and Victor S Lempitsky. 2016. Texture Networks: Feed-forward Synthesis of Textures and Stylized Images.. In ICML, Vol. 1. 4.Google Scholar
- Li-Yi Wei, Sylvain Lefebvre, Vivek Kwatra, and Greg Turk. 2009. State of the art in example-based texture synthesis.Google Scholar
- Li-Yi Wei and Marc Levoy. 2000. Fast Texture Synthesis Using Tree-structured Vector Quantization. In Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '00). ACM Press/Addison-Wesley Publishing Co., New York, NY, USA, 479--488.Google ScholarDigital Library
- Li-Yi Wei and Marc Levoy. 2001. Texture Synthesis over Arbitrary Manifold Surfaces. In Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '01). ACM, New York, NY, USA, 355--360.Google ScholarDigital Library
- Jingdan Zhang, Kun Zhou, Luiz Velho, Baining Guo, Heung-Yeung Shum, Heung-Yeung Shum, and Heung-Yeung Shum. 2003. Synthesis of Progressively-variant Textures on Arbitrary Surfaces. ACM Trans. Graph. 22, 3 (July 2003), 295--302.Google ScholarDigital Library
Index Terms
- A Three-Level Approach to Texture Mapping and Synthesis on 3D Surfaces
Recommendations
Texture synthesis on surfaces
SIGGRAPH '01: Proceedings of the 28th annual conference on Computer graphics and interactive techniquesMany natural and man-made surface patterns are created by interactions between texture elements and surface geometry. We believe that the best way to create such patterns is to synthesize a texture directly on the surface of the model. Given a texture ...
Synthesis of progressively-variant textures on arbitrary surfaces
SIGGRAPH '03: ACM SIGGRAPH 2003 PapersWe present an approach for decorating surfaces with progressively-variant textures. Unlike a homogeneous texture, a progressively-variant texture can model local texture variations, including the scale, orientation, color, and shape variations of ...
Synthesis of progressively-variant textures on arbitrary surfaces
We present an approach for decorating surfaces with progressively-variant textures. Unlike a homogeneous texture, a progressively-variant texture can model local texture variations, including the scale, orientation, color, and shape variations of ...
Comments