Abstract
Although image inpainting has been extensively studied in recent years, some problems in this area are still open. In particular, the structure restoration is one of the difficulties due to the incompleteness of the reconstructed structural information. The less reasonable filling order and the ignorance of local consistency of the image would also easily lead to undesired repairing results. To remedy the above problems, this paper proposed a new domain-based structural-aware image inpainting method. We specially designed a new iterative structure searching algorithm which can restore more complete and reliable structural information. The adjacent patches were connected to form a repairing domain which serves as the minimal repair unit. The introduction of the domain ensures the coherency and searching accuracy of the repairing results. Moreover, we introduced a novel repair order calculation method which can greatly reduce the influence of the error propagation in conventional methods. Various experiment results demonstrated the effectiveness of our method.










Similar content being viewed by others
References
Bertalmio, M., Vese, L., Sapiro, G., Osher, S.: Simultaneous structure and texture image inpainting. IEEE Trans. Image Process. 12(8), 882–889 (2003)
Criminisi, A., Pérez, P., Toyama, K.: Region filling and object removal by exemplar-based image inpainting. IEEE Trans. Image Process. 13(9), 1200–1212 (2004)
Sun, J., Yuan, L., Jia, J., Shum, H.: Image completion with structure propagation. In: ACM SIGGRAPH, pp. 861–868 (2005)
Komodakis, N.: Image completion using global optimization. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 442–452 (2006)
Wong, A., Orchard, J.: A nonlocal-means approach to exemplar-based inpainting. In: The International Conference on Image Processing (ICIP), pp. 2600–2603 (2008)
Xu, Z.B., Sun, J.: Image inpainting by patch propagation using patch sparsity. IEEE Trans. Image Process. 19(5), 1153–1165 (2010)
Martınez-Noriega, R., Roumy, A.: Exemplar-based image inpainting: fast priority and coherent nearest neighbor search. In: IEEE International Workshop on Machine Learning for Signal Processing (MLSP), pp. 1–6 (2012)
Ndjiki-Nya, P., Köppel, M., Doshkov, D., Wiegand, T.: Automatic structure-aware inpainting for complex image content. In: ISVC, pp. 1144–1156 (2008)
Li, S., Zhao, M.: Image inpainting with salient structure completion and texture propagation. Pattern Recogn. Lett. 32(9), 1256–1266 (2011)
Cao, F., Gousseau, Y., Masnou, S., Pérez, P.: Geometrically guided exemplar-based inpainting. SIAM J. Imaging Sci. 4(4), 1143–1179 (2011)
Wu, J.L., Chou, Y.Y.: An effective content-aware image inpainting method. J. Inf. Sci. Eng. 28(4), 755–770 (2012)
Lee, J., Lee, O.K., Park, R.H.: Robust exemplar-based inpainting algorithm using region segmentation. IEEE Trans. Consum. Electron. 58(2), 553–561 (2012)
Martinez-Noriega, R., Roumy, A.: Prior and macro-filling order for image completion. In: The 20th IEEE International Conference on Image Processing (ICIP), pp. 719–723 (2013)
Bugeau, A., Bertalmío, M., Caselles, V., Sapiro, G.: A comprehensive framework for image inpainting. IEEE Trans. Image Process. 19(10), 2634–2645 (2010)
He, K., Sun, J.: Statistics of patch offsets for image completion. In: European Conference on Computer Vision (ECCV), pp. 16–29 (2012)
Le Meur, O., Ebdelli, M., Guillemot, C.: Hierarchical super-resolution based inpainting. IEEE Trans. Image Process. 22(10), 3779–3790 (2013)
Guillemot, C., Turkan, M., Le Meur, M., Ebdelli, M.: Object removal and loss concealment using neighbor embedding methods. Signal Process. Image Commun. 28(10), 1405–1419 (2013)
Acknowledgments
The authors would like to thank the anonymous reviewers for their helpful and insightful comments. This work was partly supported by the Natural Science Foundation of China (No. 61170118), and the Application Foundation Research Plan Project of Tianjin (No. 14JCQNJC00100).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Wei, Y., Liu, S. Domain-based structure-aware image inpainting. SIViP 10, 911–919 (2016). https://doi.org/10.1007/s11760-015-0840-y
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11760-015-0840-y