Skip to main content
Springer Nature Link
Log in

An iterated randomized search algorithm for large-scale texture synthesis and manipulations

  • Original Article
  • Published:
The Visual Computer Aims and scope Submit manuscript

    We’re sorry, something doesn't seem to be working properly.

    Please try refreshing the page. If that doesn't work, please contact support so we can address the problem.

Abstract

In this paper, we introduce a novel iterated random search method for large-scale texture synthesis and manipulations. Previous researches on texture synthesis and manipulation have reached a great achievement both on quality and performance. However, the cost of the popular exhaustive search-based methods is still high especially for large-scale and complex synthesis scenes. Our algorithm contributes great improvements on performances about 2–50 times over the typical patch-based synthesis methods. Texture patterns have been well-known formalized as a Markov Random Field (MRF) whose two hypotheses, stationarity and locality, drive our bold guess that a random sampling may just catch a good match and allows us to propagate the natural coherence in the neighborhood. Meanwhile, the iteration constantly updates the bad guesses to make our algorithm converge fast with the results in the state of the art. We also provide a simple theoretical analysis to compare our iterated randomized search model and the classical synthesis algorithms. Besides, this simple method turns out to work well in various applications as well, such as texture transfer, image completion and video synthesis.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

References

  1. Agarwala, A., Dontcheva, M., Agrawala, M., Drucker, S., Colburn, A., Curless, B., Salesin, D., Cohen, M.: Interactive digital photomontage. ACM Trans. Graph. 23(3), 294–302 (2004)

    Article  Google Scholar 

  2. Ashikhmin, M.: Synthesizing natural textures. In: Proceedings of the 2001 symposium on Interactive 3D graphics. I3D ’01, pp. 217–226. ACM, New York (2001)

  3. Barnes, C., Shechtman, E., Finkelstein, A., Goldman, D.B.: Patchmatch: a randomized correspondence algorithm for structural image editing. ACM Trans. Graph. 28(3), 24:1–24:11 (2009)

    Article  Google Scholar 

  4. Barnes, C., Shechtman, E., Goldman, D.B., Finkelstein, A.: The generalized patchmatch correspondence algorithm. In: Proceedings of the 11th European conference on computer vision conference on computer vision: Part III. ECCV’10, pp. 29–43. Springer, Berlin, Heidelberg (2010)

  5. Cohen, M.F., Shade, J., Hiller, S., Deussen, O.: Wang tiles for image and texture generation. ACM Trans. Graph. 22(3), 287–294 (2003)

    Article  Google Scholar 

  6. Criminisi, A., Perez, P., Toyama, K.: Region filling and object removal by exemplar-based image inpainting. Trans. Image Process. 13(9), 1200–1212 (2004)

    Article  Google Scholar 

  7. Darabi, S., Shechtman, E., Barnes, C., Goldman, D.B., Sen, P.: Image melding: combining inconsistent images using patch-based synthesis. ACM Trans. Graph. 31(4), 82:1–82:10 (2012)

    Article  Google Scholar 

  8. De Bonet, J.S.: Multiresolution sampling procedure for analysis and synthesis of texture images. In: Proceedings of the 24th annual conference on Computer graphics and interactive techniques. SIGGRAPH ’97, pp. 361–368. ACM Press/Addison-Wesley Publishing Co., New York (1997)

  9. Drori, I., Cohen-Or, D., Yeshurun, H.: Fragment-based image completion. ACM Trans. Graph. 22(3), 303–312 (2003)

    Article  Google Scholar 

  10. Efros, A.A., Freeman, W.T.: Image quilting for texture synthesis and transfer. In: Proceedings of the 28th annual conference on computer graphics and interactive techniques. SIGGRAPH ’01, pp. 341–346. ACM, New York (2001)

  11. Efros, A.A., Leung, T.K.: Texture synthesis by non-parametric sampling. In: Proceedings of the International Conference on Computer Vision, ICCV ’99, vol. 2, pp. 1033–1038. IEEE Computer Society, Washington, DC (1999)

  12. Enrique, S., Koudelka, M., Belhumeur, P., Dorsey, J., Nayar, S., Ramamoorthi, R.: Time-varying textures: definition, acquisition, and synthesis. In: ACM SIGGRAPH 2005 Sketches, SIGGRAPH ’05. ACM, New York (2005). doi:10.1145/1187112.1187269. http://doi.acm.org/10.1145/1187112.1187269

  13. Heeger, D.J., Bergen, J.R.: Pyramid-based texture analysis/synthesis. In: Proceedings of the 22nd annual conference on computer graphics and interactive techniques. SIGGRAPH ’95, pp. 229–238. ACM, New York (1995)

  14. Jianwei, H., Qing, W., Kun, Z.: Wang tiles based geometric texture synthesis. J. Softw. 20(12), 3254–3264 (2009). (in Chinese)

    Article  Google Scholar 

  15. Kwatra, V., Essa, I., Bobick, A., Kwatra, N.: Texture optimization for example-based synthesis. ACM Trans. Graph. 24(3), 795–802 (2005)

    Article  Google Scholar 

  16. Kwatra, V., Schödl, A., Essa, I., Turk, G., Bobick, A.: Graphcut textures: image and video synthesis using graph cuts. ACM Trans. Graph. 22(3), 277–286 (2003)

    Article  Google Scholar 

  17. Lefebvre, S., Hoppe, H.: Parallel controllable texture synthesis. ACM Trans. Graph. 24(3), 777–786 (2005). doi:10.1145/1073204.1073261

  18. Liang, L., Liu, C., Xu, Y.Q., Guo, B., Shum, H.Y.: Real-time texture synthesis by patch-based sampling. ACM Trans. Graph. 20(3), 127–150 (2001)

    Article  Google Scholar 

  19. Pérez, P., Gangnet, M., Blake, A.: Poisson image editing. ACM SIGGRAPH 2003 Papers. SIGGRAPH ’03, pp. 313–318. ACM, New York (2003)

  20. Portilla, J., Simoncelli, E.P.: A parametric texture model based on joint statistics of complex wavelet coefficients. Int. J. Comput. Vision 40(1), 49–70 (2000)

    Article  MATH  Google Scholar 

  21. Schödl, A., Szeliski, R., Salesin, D.H., Essa, I.: Video textures. In: Proceedings of the 27th annual conference on Computer graphics and interactive techniques. SIGGRAPH ’00, pp. 489–498. ACM Press/Addison-Wesley Publishing Co., New York (2000)

  22. Szummer, M., Picard, R.W.: Temporal texture modeling. IEEE Int. Conf. Image Process. 3, 823–826 (1996)

    Article  Google Scholar 

  23. Wei, L.Y., Levoy, M.: Fast texture synthesis using tree-structured vector quantization. In: Proceedings of the 27th annual conference on Computer graphics and interactive techniques. SIGGRAPH ’00, pp. 479–488. ACM Press/Addison-Wesley Publishing Co., New York (2000)

Download references

Acknowledgments

Thanks are given to my friends, Mr.Yuanzhang Chang, Mr.Gang Sun and Mr. Xiaosheng Li for their helps and discussions. Thanks also to Professor Li-Yi Wei and Dr.Vivek Kwatra for sharing their texture datasets via their respective web sites. The research has been supported by NSFC Grant (61202154) and the research grant of University of Macau. And last but not the least, thanks are given to my families.

Author information

Authors and Affiliations

  1. FST, University of Macau, Macao, China

    Chuanyan Hao, Yadang Chen, Wen Wu & Enhua Wu

  2. State Key Lab of CS, Institute of Software, Chinese Academy of Sciences, Beijing, China

    Enhua Wu

Authors
  1. Chuanyan Hao
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Yadang Chen
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. Wen Wu
    View author publications

    You can also search for this author inPubMed Google Scholar

  4. Enhua Wu
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Chuanyan Hao.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hao, C., Chen, Y., Wu, W. et al. An iterated randomized search algorithm for large-scale texture synthesis and manipulations. Vis Comput 31, 1447–1458 (2015). https://doi.org/10.1007/s00371-014-1025-3

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00371-014-1025-3

Keywords