Skip to main content
SpringerLink
Log in

Effective inpainting method for natural textures with gradually changed illumination

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

Natural textures with gradually changed illumination bring great troubles to the field of image inpainting. Using the improved dynamical modeling approach, an energy function model gradually changed from the center to the boundary of data missing region of image is established. On this basis, a gradually changed directional priority function is proposed to ensure the gradual propagation of texture synthesis. In addition, to achieve the feasible propagation of the boundary between different textural regions, the relative test point selection, as well as energy function modeling approach, is also discussed for different cases. Besides, the established energy function models are theoretically evaluated to demonstrate their accuracy in images. Experimental results show the effectiveness of the proposed approach in the natural images with gradually changed illumination.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  1. Criminisi, A., Perez, P., Toyama, K.: Object removal by exemplar-based inpainting. In: Proc. IEEE Computer Soc. Conf. Computer Vision and Pattern Recognition, Madison, WI (2003). https://doi.org/10.1109/cvpr.2003.1211538

  2. Lee, J., Lee, D.K., Park, R.H.: Robust exemplar-based inpainting algorithm using region segmentation. IEEE Trans. Consum. Electron. (2012). https://doi.org/10.1109/TCE.2012.6227460

    Google Scholar 

  3. Xi, X.Y., Wang, F.L., Liu, Y.F.: Improved Criminisi algorithm based on a new Priority Function with the gray entropy. In: 9th International Conference on Computational Intelligence and Security (CIS). IEEE (2013). https://doi.org/10.1109/cis.2013.52

  4. Casaca, W., Boaventura, M., Almeida, M.P.D., Nonato, L.G.: Combining anisotropic diffusion, transport equation and texture synthesis for inpainting textured images. Pattern Recognit. Lett. 36, 36–45 (2014)

    Article  Google Scholar 

  5. Nan, A.J., Xi, X.Q.: An improved Criminisi algorithm based on a new priority function and updating confidence. In: 7th International Conference on Biomedical Engineering and Informatics (2014). https://doi.org/10.1109/bmei.2014.7002897

  6. Xu, Z.B., Sun, J.: Image inpainting by patch propagation using patch sparsity. IEEE Trans. Image Process. (2010). https://doi.org/10.1109/TIP.2010.2042098

    MathSciNet  MATH  Google Scholar 

  7. Li, Z.D., He, H.J., Tai, H.M., Yin, Z.K., Chen, F.: Color-direction patch-sparsity-based image inpainting using multi direction features. IEEE Trans. Image Process. 24(3), 1138–1152 (2015)

    Article  MathSciNet  Google Scholar 

  8. Liu, Y., Caselles, V.: Exemplar-based image inpainting using multiscale graph cuts. J. IEEE Trans. Image Process. (2013). https://doi.org/10.1109/TIP.2012.2218828

    MathSciNet  MATH  Google Scholar 

  9. Chen, X.W., Zhou, B., Guo, Y., Xu, F., Zhao, Q.: Structure guided texture inpainting through multi-scale patches and global optimization for image completion. Sci. China Inf. Sci. 57, 1–16 (2014)

    Google Scholar 

  10. Kumar, V., Mukherjee, J., Mandal, S.K.D.: Image inpainting through metric labeling via guided patch mixing. IEEE Trans. Image Process. 25(11), 5212–5226 (2016)

    Article  MathSciNet  Google Scholar 

  11. Ružić, T., Pižurica, A.: Context-aware patch-based image inpainting using Markov random field modeling. IEEE Trans. Image Process. 24(1), 444–456 (2015)

    Article  MathSciNet  Google Scholar 

  12. Jin, K.H., Ye, J.C.: Annihilating filter-based low-rank Hankel matrix approach for image inpainting. IEEE Trans. Image Process. 24(11), 3498–3510 (2015)

    Article  MathSciNet  Google Scholar 

  13. Kawai, N., Sato, T., Yokoya, N.: Diminished reality based on image inpainting considering background geometry. IEEE Trans. Vis. Comput. Graph. 22(3), 1236–1247 (2016)

    Article  Google Scholar 

  14. Fedorov, V., Facciolo, G., Arias, P.: Variational framework for non-local inpainting. Image Process. On Line (2015). https://doi.org/10.5201/ipol.2015.136

    Google Scholar 

  15. Fedorov, V., Arias, P., Facciolo, G., Ballester, C.: Affine invariant self-similarity for exemplar-based inpainting. In: Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (2016)

  16. Pérez, P., Gangnet, M., Blake, A.: Poisson image editing. Proc. ACM SIGGRAPH 22(3), 313–318 (2003)

    Article  Google Scholar 

  17. Xue, S., Dai, Q.H.: Nonlinear Poisson image completion using color manifold. In: Int. Conf. on Image Processing, San Antonio, Texas, USA (2007). https://doi.org/10.1109/icip.2007.4379998

  18. Duan, Y., Tang, P.F., Huang, T.Z., Lai, S.J.: Coupling projection domain decomposition method and Kansa’s method in electrostatic problems. Comput. Phys. Commun. 180, 209–214 (2009)

    Article  MATH  Google Scholar 

  19. Fawzi, A., Samulowitz, H., Turaga, D., Frossard, P.: Image inpainting through neural networks hallucinations. In: IEEE Image, Video, and Multidimensional Signal Processing Workshop (2016)

Download references

Acknowledgements

We would like to thank Mr. Ping-fan Tang for sharing the code of Kansa algorithm. This work was supported in part by the National Natural Science Foundation of China under Grant No. 61271326.

Author information

Authors and Affiliations

  1. School of Electrical and Information Engineering, Tianjin University, Tianjin, 300072, China

    Kai He, Cheng-nan Shen, Jun-hui Niu & Wan-rong Huang

Authors
  1. Kai He
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Cheng-nan Shen
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jun-hui Niu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Wan-rong Huang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Kai He.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

He, K., Shen, Cn., Niu, Jh. et al. Effective inpainting method for natural textures with gradually changed illumination. SIViP 13, 69–77 (2019). https://doi.org/10.1007/s11760-018-1329-2

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11760-018-1329-2

Keywords

Search

Navigation