Skip to main content
SpringerLink
Log in

Multi-exemplar-guided image weathering via texture synthesis

  • Original article
  • Published:
The Visual Computer Aims and scope Submit manuscript

Abstract

We propose a novel method for generating gradually varying weathering effects from a single image. Time-variant weathering effects tend to appear simultaneously on one object. Compared to previous methods, our method is able to obtain gradually changing weathering effects through simple interactions while keeping texture variations and shading details. We first classify the weathering regions into several stages based on a weathering degree map extracted from the image. For each weathering stage, we automatically extract the corresponding weathering sample, from which a texture image is synthesized subsequently. Then, we generate weathering effects by fusing different textures according to the weathering degree of the image pixels. Finally, in order to maintain the intrinsic shape details of the object during the fusing process, we utilize a new shading-preserving method taking account of the weathering degrees. Experiments show that our method is able to produce visually realistic and time-variant weathering effects interactively.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

Data availability statement

The datasets generated during and/or analyzed during the current study are available from the corresponding author on reasonable request.

References

  1. Desbenoit, B., Galin, E., Akkouche, S.: Simulating and modeling lichen growth. Comput. Graph. Forum. 23(3), 341–350 (2004). https://doi.org/10.1111/j.1467-8659.2004.00765.x

  2. Bosch, C., Patow, G.: Controllable image-based transfer of flow phenomena. Comput. Graph. Forum. 38(1), 274–285 (2019). https://doi.org/10.1111/cgf.13530

  3. Santos, R.L., Baranoski, G.V.: Observation-driven generation of texture maps depicting dust accumulation over time. Vis. Comput. 39, 1943–1957 (2022)

    Article  Google Scholar 

  4. Wang, J., Tong, X., Lin, S., Pan, M., Wang, C., Bao, H., Guo, B., Shum, H.Y.: Appearance manifolds for modeling time-variant appearance of materials. ACM Trans. Graph. (TOG) 25(3), 754–761 (2006)

    Article  Google Scholar 

  5. Xuey, S., Wang, J., Tong, X., Dai, Q., Guo, B.: Image-based material weathering. Comput.Graph. Forum. 27(2), 617–626 (2008). https://doi.org/10.1111/j.1467-8659.2008.01159.x

  6. Bandeira, D., Walter, M.: Synthesis and transfer of time-variant material appearance on images. In: 2009 XXII Brazilian Symposium on Computer Graphics and Image Processing, pp. 32–39. IEEE (2009)

  7. Iizuka, S., Endo, Y., Kanamori, Y., Mitani, J.: Single image weathering via exemplar propagation. Comput. Graph. Forum. 35(2), 501–509 (2016). https://doi.org/10.1111/cgf.12850

  8. Dorsey, J., Edelman, A., Jensen, H.W., Legakis, J., Pedersen, H.K.: Modeling and rendering of weathered stone. In: Proceedings of the 26th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH ’99, pp. 225–234. ACM Press/Addison-Wesley Publishing Co., USA (1999). https://doi.org/10.1145/311535.311560

  9. Dorsey, J., Hanrahan, P.: Modeling and rendering of metallic patinas. In: Proceedings of the 23rd Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH ’96, pp. 387–396. Association for Computing Machinery, New York, NY, USA (1996). https://doi.org/10.1145/237170.237278

  10. Kider Jr, J.T., Raja, S., Badler, N.I.: Fruit senescence and decay simulation. In: Computer Graphics Forum, vol. 30, pp. 257–266. Wiley (2011)

  11. Ishitobi, A., Nakayama, M., Fujishiro, I.: Visual simulation of weathering coated metallic objects. Vis. Comput. 36(10), 2383–2393 (2020)

    Article  Google Scholar 

  12. Munoz-Pandiella, I., Bosch, C., Merillou, N., Patow, G., Merillou, S., Pueyo, X.: Urban weathering: interactive rendering of polluted cities. IEEE Trans. Vis. Comput. Graph. 24(12), 3239–3252 (2018)

    Article  Google Scholar 

  13. Bosch, C., Laffont, P.Y., Rushmeier, H., Dorsey, J., Drettakis, G.: Image-guided weathering: a new approach applied to flow phenomena. ACM Trans. Graph. 30(3), 20 (2011). https://doi.org/10.1145/1966394.1966399

  14. Chen, Y., Xia, L., Wong, T.T., Tong, X., Bao, H., Guo, B., Shum, H.Y.: Visual simulation of weathering by \(\gamma \)-ton tracing. In: ACM SIGGRAPH 2005 Papers, pp. 1127–1133 (2005)

  15. Taka, E., Papachristou, K., Drosou, A., Dimitriou, N., Tzovaras, D.: Physical forces aware aging simulation on cultural heritage artifacts. In: 2017 3DTV Conference: The True Vision-Capture, Transmission and Display of 3D Video (3DTV-CON), pp. 1–4. IEEE (2017)

  16. Bellini, R., Kleiman, Y., Cohen-Or, D.: Time-varying weathering in texture space. ACM Trans. Graph. (TOG) 35(4), 1–11 (2016)

    Article  Google Scholar 

  17. Chen, L.Y., Shen, I.C., Chen, B.Y.: Guided image weathering using image-to-image translation. In: SIGGRAPH Asia 2021 Technical Communications, pp. 1–4 (2021)

  18. Jain, N., Kalra, P., Ranjan, R., Kumar, S.: User guided generation of corroded objects. In: Proceedings of the Tenth Indian Conference on Computer Vision, Graphics and Image Processing, pp. 1–8 (2016)

  19. Zhou, Y., Shi, H., Lischinski, D., Gong, M., Kopf, J., Huang, H.: Analysis and controlled synthesis of inhomogeneous textures. In: Computer Graphics Forum, vol. 36, pp. 199–212. Wiley (2017)

  20. Liang, L., Liu, C., Xu, Y.Q., Guo, B., Shum, H.Y.: Real-time texture synthesis by patch-based sampling. ACM Trans. Graph. (ToG) 20(3), 127–150 (2001)

    Article  Google Scholar 

  21. Efros, A.A., Freeman, W.T.: Image quilting for texture synthesis and transfer. In: Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques, pp. 341–346 (2001)

  22. Criminisi, A., Pérez, P., Toyama, K.: Region filling and object removal by exemplar-based image inpainting. IEEE Trans. Image Process. 13(9), 1200–1212 (2004)

    Article  Google Scholar 

  23. Endo, Y., Kanamori, Y., Mitani, J., Fukui, Y.: An interactive design system for water flow stains on outdoor images. In: International Symposium on Smart Graphics, pp. 160–171. Springer (2010)

  24. Dorsey, J., Pedersen, H.K., Hanrahan, P.: Flow and changes in appearance. In: Proceedings of the 23rd Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH ’96, pp. 411–420. Association for Computing Machinery, New York, NY, USA (1996). https://doi.org/10.1145/237170.237280

  25. Xue, S., Dorsey, J., Rushmeier, H.: Stone weathering in a photograph. Comput. Graph. Forum. 30(4), 1189–1196 (2011). https://doi.org/10.1111/j.1467-8659.2011.01977.x

  26. Endo, Y., Kanamori, Y., Mitani, J., Fukui, Y.: Image editing for weathering effects with geometric details. Proc. Comput. Graph. Int. Ottawa:[sn] (2011). http://cgi2011.site.uottawa.ca/CGI2011_proceedings/_files/proceedings.html#paper_table

  27. Boykov, Y.Y., Jolly, M.P.: Interactive graph cuts for optimal boundary & region segmentation of objects in nd images. In: Proceedings eighth IEEE International Conference on Computer Vision. ICCV 2001, vol. 1, pp. 105–112. IEEE (2001)

  28. Lasram, A., Lefebvre, S.: Parallel patch-based texture synthesis. In: Proceedings of the Fourth ACM SIGGRAPH/Eurographics Conference on High-Performance Graphics, pp. 115–124 (2012)

  29. Kaspar, A., Neubert, B., Lischinski, D., Pauly, M., Kopf, J.: Self tuning texture optimization. In: Computer Graphics Forum, vol. 34, pp. 349–359. Wiley (2015)

  30. Houdard, A., Leclaire, A., Papadakis, N., Rabin, J.: Wasserstein generative models for patch-based texture synthesis. In: International Conference on Scale Space and Variational Methods in Computer Vision, pp. 269–280. Springer (2021)

Download references

Author information

Authors and Affiliations

  1. School of Computer Science and Technology, Zhejiang Sci-Tech University, Hangzhou, 310000, China

    Shiyin Du & Ying Song

Authors
  1. Shiyin Du
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ying Song
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ying Song.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Research grants

This work has been supported by Key R &D Plan of Zhejiang Province Nos. 2023C01047 and 2023C01041.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Du, S., Song, Y. Multi-exemplar-guided image weathering via texture synthesis. Vis Comput 39, 3691–3699 (2023). https://doi.org/10.1007/s00371-023-02944-5

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00371-023-02944-5

Keywords

Search

Navigation