Abstract
Exemplar-based inpainting techniques demonstrate some advantages in filling both textural and structural images, based upon the simple process of patch sampling and copying. An implicit assumption of such methods is that an exemplar patch could be found for copying. But the assumption might be false for images with complex structures, resulting in inpainting artefact. To inpaint structure and texture more efficiently, this paper adopts a weak assumption that affine transformed patches could be found for filling unknown regions. The algorithm based on this assumption firstly establishes the affine relation between the unknown region and a source patch, then transform the source pixels to fill the unknowns. This algorithm generates more satisfying inpainting results, as illustrated by the provided experiments.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Bertalmio, M., Sapiro, G., Caselles, V., Ballester, C.: Image inpainting. In: Proc. of SIGGRAPH 2000, New Orleans, USA, pp. 417–424 (2000)
Ballester, C., Bertalmio, M., Caselles, V., Sapiro, G., Verdera, J.: Filling-in by joint interpolation of vector fields and gray levels. IEEE Trans. Image Processing 10(8), 1200–1211 (2001)
Bertalmio, M., Bertozzi, A., Sapiro, G.: Navier-stokes, fluid dynamics, and image and video inpainting. In: IEEE Conference on Computer Vision and Pattern Recognition, vol. I, pp. 355–362 (2001)
Tschumperle, D., Deriche, R.: Vector-valued image regularization with PDE’s: A common framework for different applications. IEEE Trans. Pattern Analysis and Machine Intelligence 27(4), 506–517 (2005)
Efros, A.A., Leung, T.K.: Texture synthesis by non-parametric sampling. In: International Conference on Computer Vision, pp. 1033–1038 (1999)
Liang, L., Liu, C., Xu, Y., Guo, B., Shum, H.: Real-time texture synthesis by patch-based sampling. ACM Transactions on Graphics 20(3), 127–150 (2001)
Telea, A.: An image inpainting technique based on the fast marching method. Journal of Graphics Tools 9(1), 23–34 (2004)
Wang, Z., Zhou, F., Qi, F.: Inpainting thick image regions using isophote propagation. In: International Conference on Image Processing, pp. 689–692 (2006)
Bertalmio, M., Vese, L., Sapiro, G., Osher, S.: Simultaneous structure and texture image inpainting. IEEE Trans. Image Processing 12(8), 882–889 (2003)
Drori, I., Cohen-Or, D., Yeshurun, H.: Fragment-based image completion. ACM Transactions on Graphics (SIGGRAPH) 22(3), 303–312 (2003)
Criminisi, A., Perez, P., Toyama, K.: Region filling and object removal by exemplar-based image inpainting. IEEE Trans. Image Processing 13(9), 1200–1212 (2004)
Hsu, H., Wang, J., Liao, S.: A hybrid algorithm with artifact detection mechanism for region filling after object removal from a digital photograph. IEEE Trans. Image Processing 16(6), 1611–1622 (2007)
Komodakis, N., Tziritas, G.: Image completion using efficient belief propagation via priority scheduling and dynamic pruning. IEEE Trans. Image Processing 16(11), 2649–2661 (2007)
Patwardhan, K., Sapiro, G., Bertalmio, M.: Video inpainting under constrained camera motion. IEEE Trans. Image Processing 16(2), 545–553 (2007)
Yang, Z., Cohen, F.: Cross-weighted moments and affine invariants for image registration and matching. IEEE Trans. Pattern Analysis and Machine Intelligence 21, 804–814 (1999)
Rahtu, E., Salo, M., Heikkila, J.: Affine invariant pattern recognition using multiscale autoconvolution. IEEE Trans. Pattern Analysis and Machine Intelligence 27(6), 908–918 (2005)
Lowe, D.: Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision 60(2), 91–110 (2004)
Mikolajczyk, K., Schmid, C.: Scale and affine invariant interest point detectors. International Journal of Computer Vision 60(1), 63–86 (2004)
Mikolajczyk, K., Schmid, C.: A performance evaluation of local descriptors. IEEE Trans. Pattern Analysis and Machine Intelligence 27(10), 1615–1630 (2005)
Rosten, E., Drummond, T.: Fusing points and lines for high performance tracking. In: International Conference on Computer Vision, vol. II, pp. 1508–1515 (2005)
Torr, P.H.S., Murray, D.W.: The development and comparison of robust methods for estimating the fundamental matrix. International Journal of Computer Vision 24(3), 271–300 (1997)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Wang, Z. (2008). Image Affine Inpainting. In: Campilho, A., Kamel, M. (eds) Image Analysis and Recognition. ICIAR 2008. Lecture Notes in Computer Science, vol 5112. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-69812-8_106
Download citation
DOI: https://doi.org/10.1007/978-3-540-69812-8_106
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-69811-1
Online ISBN: 978-3-540-69812-8
eBook Packages: Computer ScienceComputer Science (R0)