skip to main content
research-article

Style-learning with feature-based texture synthesis

Published:01 July 2008Publication History
Skip Abstract Section

Abstract

The objective of artistic style learning is to synthesize a new image from a source image with the style learnt from example images. Existing example-based texture synthesis (EBTS) techniques model style with low-level statistical properties. These methods work well with some artistic styles such as oil painting, but have difficulties in preserving image details and features for other styles, such as pencil hatching. In this article, an improved artistic style-learning algorithm with feature-based texture synthesis (FBTS) is introduced. Compared with existing EBTS methods, in our FBTS algorithm, image details and features are better defined with a feature field generated from the source image. Also, an improved L2 neighborhood distance metric which provides better measures of perceptual similarity is proposed. Results and comparisons are given to demonstrate the effectiveness of the FBTS algorithm with applications in the areas of stylized shading and artistic style transfer.

References

  1. Borgefors, G. 1988. Hierarchical chamfer matching: A parametric edge matching algorithm. IEEE Trans. Pattern Analysis and Machine Intelligence 10, 849--865. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. De Bonet, J. S. 1997. Multiresolution sampling procedure for analysis and synthesis of texture images. In SIGGRAPH Conference Proceedings 1997, 361--368. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Efros, A. and Leung, T. 1999. Texture synthesis by non-parametric sampling. In Proceedings of ICCV, 1033--1038. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Efros, A. and Freeman, W. T. 2001. Image quilting for texture synthesis and transfer. In SIGGRAPH Conference Proceedings 2001, 341--346. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Essa, I., Turk, G., Kwatra, V., Schodl, A., and Bobick, A. 2003. Graphcut textures: Image and video synthesis using graph cuts. In SIGGRAPH Conference Proceedings 2003, 277--286. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Freeman, W. T., Jones, T. R., and Pasztor., E. 2002. Example-based super-resolution. In IEEE Computer Graphics and Applications, 56--65. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Hertzmann, A., Jacobs, C. E., Oliver, N., Curless, B., and Salesin, D. H. 2001. Image analogies. In SIGGRAPH Conference Proceedings 2001, 327--340. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Liang, L., Liu, C., Xu, Y. Q., Guo, B., and Shum, H. Y. 2001. Real-time texture synthesis by patch-based sampling. In ACM Trans. Graphics, 127--150. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Mignotte, M. 2002. Bayesian rendering with non-parametric multiscale prior model. In Proceedings of ICPR02 Conference. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Powell, J. D. 1990. The theory of radial basis function approximation. In Cambridge University Numerical Analysis Report.Google ScholarGoogle Scholar
  11. Soler, C., Cani, M. P., and Angelidis, A. 2002. Hierarchical pattern mapping. In SIGGRAPH Conference Proceedings 2002, 673--680. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Tenenbaum, J. B. and Freeman, W. T. 2000. Separating style and content with bilinear models. Neural Computation 12, 6, 1247--1283. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Wei, L. and Levoy, M. 2000. Fast texture synthesis using tree-structured vector quantization. In SIGGRAPH Conference Proceedings 2000, 479--488. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Wu, Q. and Yu, Y. 2004. Feature matching and deformation for texture synthesis. In SIGGRAPH Conference Proceedings 2004. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Xie, X., He, Y., Tian, F., Seah, H. S., Gu, X., and Qin, H. 2007. An effective illustrative visualization framework based on Photic Extremum Lines (PELs). IEEE Trans. Visualization and Computer Graphics 13, 6, 1328--1335. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Style-learning with feature-based texture synthesis

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in

      Full Access

      • Published in

        cover image Computers in Entertainment
        Computers in Entertainment   Volume 6, Issue 2
        Theoretical and Practical Computer Applications in Entertainment
        April/June 2008
        225 pages
        EISSN:1544-3574
        DOI:10.1145/1371216
        Issue’s Table of Contents

        Copyright © 2008 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 1 July 2008
        • Accepted: 1 April 2008
        • Received: 1 January 2008

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article
        • Popular
        • Editor picked
      • Article Metrics

        • Downloads (Last 12 months)3
        • Downloads (Last 6 weeks)1

        Other Metrics

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      HTML Format

      View this article in HTML Format .

      View HTML Format