Skip to main content
SpringerLink
Log in

An efficient texture-structure conserving patch matching algorithm for inpainting mural images

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Preserving heritage paintings across the globe has nowadays gained momentum to let know artistic values of our ancestors in terms of their art techniques and natural material used in creating variety of magnificent paintings so that remains as witness and evidences of ancient historical and cultural heritage. Also, reconstruction of degraded medical images for proper diagnosis is crucial concern for the medical industry. An efficient texture-structure conserving patch matching algorithm (TSCPMA) has been proposed to inpaint the degraded region of an image. The novel feature of Criminisi algorithm to generate large missing areas and reconstruct small gaps is enhanced by improving quality of inpainting and removing existing drawbacks. The priority dependency on confidence and data had been removed by selecting patch to reconstruct with least number of unknown elements. The criteria for minimum similarity distance to select the best patch match had been refined for better patch match thus improving inpainting quality. The target pixel is assigned final value after all unknown pixels from the degraded region have been estimated. The look up table is updated at each iteration so that neighbourhood information can better relate adjacent pixels rather than approximating them with values from other distant known regions of the image. The proposed TSCPMA is able to preserve the color, textural and structural quality of the reconstructed patches as indicated by inpainted results and performance parameters when compared with state of art methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Algorithm 1:
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18

Similar content being viewed by others

Data availability

Data sharing not applicable to this article as no datasets were generated or analyzed during the current study.

References

  1. Abdulla AA, Ahmed MW (2021) An improved image quality algorithm for exemplar-based image inpainting. Multimed Tools Appl 80:13143–13156

    Article  Google Scholar 

  2. Ahmed MW, Abdulla AA (2020) Quality improvement for exemplar-based image inpainting using a modified searching mechanism. UHD J Sci Technol Index 4(1):1–8

    Article  Google Scholar 

  3. Bertalmio M, Sapiro G, Caselles V, Ballester C (2000) Image inpainting. In: Proceedings of the 27th annual conference on computer graphics and interactive techniques, pp 417–424

  4. Borole R, Bonde S (2013) Patch-based inpainting for object removal and region filling in images. J Intell Syst 22(3):335–350

    Google Scholar 

  5. Cheng W-H, Hsieh C-W, Lin S-K, Wang C-W, Wu J-L (2005) Robust algorithm for exemplar-based image inpainting. The International Conference on Computer Graphics, Imaging and Vision (CGIV 2005), Beijing, China, pp 64–69

  6. Cheng Y, Liu W, Xing W (2019) A novel algorithm for exemplar-based image inpainting(S). In: Perkusich A (ed) The 31st international conference on software engineering and knowledge engineering, SEKE 2019, Hotel Tivoli, Lisbon, Portugal, July 10–12, pp 630–777

  7. Cho D, Bui TD (2008) Image inpainting using wavelet-based inter- and intra-scale dependency. In: 2008 19th International conference on pattern recognition, Tampa, FL, pp 1–4

  8. Criminisi A, Perez P, Toyama K (2004) Region filling and object removal by exemplar-based image inpainting. IEEE Trans Image Process 13(9):1200–1212

    Article  Google Scholar 

  9. Darabi S, Shechtman E, Barnes C, Goldman DB, Sen P (2012) Image melding: combining inconsistent images using patch-based synthesis. ACM Trans Graph 31(4):1–10

    Article  Google Scholar 

  10. Deng LJ, Huang TZ, Zhao XL (2022) Exemplar-based image inpainting using a modified priority definition. PLoS ONE 10(10):e0141199

    Article  Google Scholar 

  11. Desai M (2012) Modified fast and enhanced exemplar based inpainting algorithm for solving unknown row filling problem. Int J Comput Appl 56(9):20–24. https://doi.org/10.5120/8919-2977

    Article  Google Scholar 

  12. Ding D, Ram S, Rodriguez JJ (2018) Perceptually aware image inpainting. Pattern Recogn 83:174–184

    Article  Google Scholar 

  13. Efros AA, Leung TK (1999) Texture synthesis by non-parametric sampling. In: Proceedings of the Seventh IEEE International Conference on Computer Vision, Kerkyra, Greece, vol 2, pp 1033–1038

  14. Fan Y (2019) Damaged region filling by improved criminisi image inpainting algorithm for thangka. Clust Comput 22:13683–13691

    Article  Google Scholar 

  15. Fan Q, Zhang L (2018) A novel patch matching algorithm for exemplar-based image inpainting. Multimed Tools Appl 77:10807

    Article  Google Scholar 

  16. Gouasnouane O, Moussaid N, Boujena S, Kabli K (2022) A nonlinear fractional partial differentiation equation for image inpainting. Math Model Comput 9(3):536–546

    Article  Google Scholar 

  17. Hou Z (2016) Criminisi image concealment algorithm based on priority function and blocking matching principle. Revista Tecnica De La Facultad De Ingenieria Universidad Del Zulia (Technical Magazine of the Faculty of Engineering of the University of Zulia), vol 39, no 9, pp 203– 209.https://doi.org/10.21311/001.39.9.27

  18. Ishi MS, Singh L, Agrawal M (2014) Reconstruction of images with exemplar based image inpainting and patch propagation. In: International conference on information communication and embedded systems (ICICES2014), Chennai, pp 1–5

  19. JanardhanaRao B, Chakrapani Y, Srinivas Kumar S (2018) Image inpainting method with improved patch priority and patch selection. IETE J Educ 59(1):26–34

    Article  Google Scholar 

  20. Kim B-S, Kim J, Park J (2015) Exemplar based inpainting in a multi-scaled space. Optik 126(23):3978–3981

    Article  Google Scholar 

  21. Kuo T, Kuan Y, Wan K, Wang Y and Cheng Y (2017) An improved exemplar-based image repairing algorithm. In: 2017 IEEE international conference on multimedia and expo (ICME), Hong Kong, pp 1315–1319

  22. Lee J, Lee D, Park R (2012) Robust exemplar-based inpainting algorithm using region segmentation. IEEE Trans Consum Electron 58(2):553–561

    Article  Google Scholar 

  23. Li C et al (2022) An improved criminisi method for image inpainting. J Phys: Conf Ser 2253:012023

    Google Scholar 

  24. Liu Y, Wang F, Xi X (2013) Enhanced algorithm for exemplar based image inpainting. In: 2013 ninth international conference on computational intelligence and security (CIS), Emeishan 614201, China, pp 209–213

  25. Masnou S, Morel J-M (1998) Level lines based disocclusion. In: Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269), Chicago, IL, USA, 1998, vol 3, pp 259–263

  26. Nan A, Xi X (2014) An improved Criminisi algorithm based on a new priority function and updating confidence. In: 2014 7th International Conference on Biomedical Engineering and Informatics, Dalian, China, pp 885–889

  27. Prajapati A et al (2018) Modified region filling and object removal by exemplar-based image inpainting. Int J Comput Appl 182(84):27–31. https://doi.org/10.5120/ijca2018918042

    Article  Google Scholar 

  28. Shen J, Chan TF (2002) Mathematical models for local nontexture inpaintings. SIAM J Appl Math 62(3):1019–1043

    Article  MathSciNet  MATH  Google Scholar 

  29. TschumperlÉ D (2006) Fast anisotropic smoothing of multi-valued images using curvature-preserving PDE’s. Int J Comput Vis 68(1):65–82

    Article  MATH  Google Scholar 

  30. Wang W, Jia Y (2017) Damaged region filling and evaluation by symmetrical exemplar-based image inpainting for Thangka. J Image Video Process 38

  31. Wang J, Ke L, Pan D, He N, Bao B (2014) Robust object removal with an exemplar-based image inpainting approach. Neurocomputing 123:150–155

    Article  Google Scholar 

  32. Wang X, Chen Y, Yamasaki T (2022) Spatially adaptive multi-scale contextual attention for image inpainting. Multimed Tools Appl 81:31831–31846

    Article  Google Scholar 

  33. Yamauchi H, Haber J and Seidel H (2003) Image restoration using multiresolution texture synthesis and image inpainting. In: Proceedings computer graphics international 2003, Tokyo, Japan, pp 120–125

  34. Yin L, Chang C (2012) An effective exemplar-based image inpainting method. 2012 IEEE 14th International Conference on Communication Technology, pp 739–743

  35. Ying H, Kai L, Ming Y (2017) An improved image inpainting algorithm based on image segmentation. Procedia Comput Sci 107:796–801

    Article  Google Scholar 

  36. Yuan P, Gong X, Cao S, Guo JY, Wang CY, Zou HM (2010) A modified exemplar based inpainting algorithm. CRSSC-CWI-CGrC

  37. Yuheng S, Hao Y (2018) Image inpainting based on a novel Criminisi algorithm. CoRR. http://arxiv.org/abs/1808.0412

  38. Zhang N (2020) Research on improved exemplar-based image inpainting algorithm. Master’s thesis Shandong Normal University

  39. Zhang J, Zhao D, Gao W (2014) Group-based sparse representation for image restoration. IEEE Trans Image Process 23:3336–3351

    Article  MathSciNet  MATH  Google Scholar 

  40. Zhao J, Tan J, Huang Y, Chaunlong Lu (2002) Improved image inpainting exemplar-based algorithms by boundary priori-knowledge. MATEC Web Conf 355:03004. https://doi.org/10.1051/matecconf/202235503004

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Electronics Engineering, Priyadarshini College of Engineering, Digdoh Hills, Hingna, Nagpur, Maharashtra, India

    Sujata Bhele & Shashank Shriramwar

  2. Department of Electronics and Telecommunication Engineering, Yeshwantrao Chavan College of Engineering, Hingna Road, Wanadongri, Nagpur, Maharashtra, India

    Poonam Agarkar

Authors
  1. Sujata Bhele
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Shashank Shriramwar
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Poonam Agarkar
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Poonam Agarkar.

Ethics declarations

Conflict of interest

The authors declare that we have no conflict of interest.

Additional information

Publisher's note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Bhele, S., Shriramwar, S. & Agarkar, P. An efficient texture-structure conserving patch matching algorithm for inpainting mural images. Multimed Tools Appl 82, 46741–46762 (2023). https://doi.org/10.1007/s11042-023-15370-5

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-023-15370-5

Keywords

Search

Navigation