Skip to main content
SpringerLink
Log in

Simultaneous inpainting for image structure and texture using anisotropic heat transfer model

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

We propose a PDE-based image inpainting method using anisotropic heat transfer model, which can simultaneously propagate the structure and texture information. In structure inpainting, the propagating direction and intensity are related to image contents, and the strength of propagation along gradient direction is made inversely proportional to the magnitude of gradient. In texture inpainting, the added texture term reflects periodicity along the texture and its perpendicular direction. For numerical implementation, the step size of finite difference is adaptively chosen according to the curvature, leading to fewer iteration steps and satisfactory inpainting quality. Compared with other high order PDE methods and layered methods, the proposed approach is more concise and doesn’t need image decomposition. Experiments are carried out to show effectiveness of the method.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Ballester C, Bertalmío M, Caselles V, Garrido L, Marques A, Ranchin F (2007) An inpainting-based deinterlacing method. IEEE Trans Image Process 16(10):2476–2491

    Article  MathSciNet  Google Scholar 

  2. Bertalmio M, Bertozzi AL, Sapiro G (2001) Navier-stokes, fluid dynamics, and image and video inpainting, in Proc. IEEE Int. Conf. Comput. Vision and Pattern Recognit., Dec., Kauai, HI I:355–362

  3. Bertalmio M, Sapiro G, Caselles V, Ballester C (2000) Image inpainting, in Proc. ACM SIGGRAPH Conf. Comput. Graphics 417–424

  4. Bertalmio M, Vese L, Sapiro G, Osher S (2003) Simultaneous structure and texture image inpainting. IEEE Trans Image Process 12(8):882–889

    Article  Google Scholar 

  5. Chan TF, Shen J (2001) Nontexture inpainting by curvature-driven diffusions. J Vis Commun Image Represent 12(4):436–449

    Article  Google Scholar 

  6. Chan TF, Shen J (2001) Mathematical models for local non-texture inpaintings. SIAM J Appl Math 62(3):1019–1043

    MathSciNet  Google Scholar 

  7. Criminisi A, Pérez P, Toyama K (2004) Region filling and object removal by exemplar-based image inpainting. IEEE Trans Image Process 13(9):1200–1212

    Article  Google Scholar 

  8. Efros AA, Leung TK (1999) Texture synthesis by non-parametric sampling. in Proc. IEEE Int. Conf. Comput. Vision 2:1033–1038

    Article  Google Scholar 

  9. Hsu HJ, Wang JF, Liao SC (2007) A hybrid algorithm with artifact detection mechanism for region filling after object removal from a digital photograph. IEEE Trans Image Process 16(6):1611–1622

    Article  MathSciNet  Google Scholar 

  10. Liu D, Sun X, Wu F, Li S, Zhang YQ (2007) Image compression with edge-based inpainting. IEEE Trans Circuits Syst Video Technol 17(10):1273–1287

    Article  Google Scholar 

  11. Mairal J, Elad M, Sapiro G (2008) Sparse representation for color image restoration. IEEE Trans Image Process 17(1):53–69

    Article  MathSciNet  Google Scholar 

  12. Perona P, Malik J (1990) Scale-space and edge detection using anisotropic diffusion. IEEE Trans Pattern Anal Mach Intell 12(7):629–639

    Article  Google Scholar 

  13. Rane SD, Sapiro G, Bertalmio M (2003) Structure and texture filling-in of missing image blocks in wireless transmission and compression applications. IEEE Trans Image Process 12(3):296–303

    Article  MathSciNet  Google Scholar 

  14. Robles-Kelly A, Hancock ER (2004) Vector field smoothing via heat flow. in Proc. Int. Conf. Pattern Recognit 2:94–97

    Google Scholar 

  15. Shih TK (2004) Adaptive digital image inpainting. in Proc. Int. Conf. Advanced Inform. Networking and Applications 1:71–76

    Google Scholar 

  16. Tschumperlé D, Deriche R (2005) Vector-valued image regularization with PDEs: a common framework for different applications. IEEE Trans. Pattern Anal. Mach. Intell 27(4):506–517

    Article  Google Scholar 

  17. Witkin A, Kass M (1991) Reaction-diffusion textures. ACM SIGGRAPH Comput. Graphics 25(4):299–308

    Article  Google Scholar 

  18. Xu Z, Sun J (2010) Image inpainting by patch propagation using patch sparsity. IEEE Trans. Image Process 19(5):1153–1165

    Article  MathSciNet  Google Scholar 

  19. Zhu ZJ, Li ZG, Rahardja S, Franti P (2009) Recovering real-world scene: high-quality image inpainting using multi-exposed references. Electron Lett 45(25):1310–1312

    Article  Google Scholar 

Download references

Acknowledgments

This work was supported by the Natural Science Foundation of China (60872116, 60832010, and 60773079), the Shanghai Rising-Star Program (10QH14011), the Key Scientific Research Project of Shanghai Education Committee (10ZZ59), the Shanghai Specialized Research Foundation for Excellent Young Teacher in University (slg09005), and the OECE Innovation Foundation of USST (GDCX-Y-103).

Author information

Authors and Affiliations

  1. School of Optical-Electrical and Computer Engineering, University of Shanghai for Science and Technology, Shanghai, 200093, China

    Chuan Qin

  2. School of Communication and Information Engineering, Shanghai University, Shanghai, 200072, China

    Shuozhong Wang & Xinpeng Zhang

Authors
  1. Chuan Qin
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Shuozhong Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Xinpeng Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Chuan Qin.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Qin, C., Wang, S. & Zhang, X. Simultaneous inpainting for image structure and texture using anisotropic heat transfer model. Multimed Tools Appl 56, 469–483 (2012). https://doi.org/10.1007/s11042-010-0601-4

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-010-0601-4

Keywords

Search

Navigation