Skip to main content
SpringerLink
Log in

Constrained PatchMatch for Image Completion

  • Conference paper
Advances in Visual Computing (ISVC 2014)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 8887))

Included in the following conference series:

  • 3718 Accesses

Abstract

We propose a quick and automatic patch-based image completion method, which uses the PatchMatch framework. We show that PatchMatch can be improved by constraining its random search step, in order to propagate the geometric structures of the image better. Instead of randomly initializing the algorithm and randomly searching, we guide the search by constraining it among only the most likely offsets. Moreover we modify the PatchMatch cost function to ensure a coherence of offset directions. The method is tested with real data, and is compared with state-of-the-art methods.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Kawai, N., Sato, T., Yokoya, N.: Diminished reality considering background structures. In: International Symposium on Mixed and Augmented Reality (ISMAR), pp. 259–260 (2013)

    Google Scholar 

  2. Chen, T., Zhu, Z., Shamir, A., Hu, S.M., Cohen-Or, D.: 3-sweep: extracting editable objects from a single photo. ACM Transactions on Graphics (TOG) 32, 195 (2013)

    Google Scholar 

  3. Kholgade, N., Simon, T., Efros, A., Sheikh, Y.: 3d object manipulation in a single photograph using stock 3d models. ACM Transactions on Computer Graphics 33 (2014)

    Google Scholar 

  4. Criminisi, A., Perez, P., Toyama, K.: Object removal by exemplar-based inpainting. In: Conference on Computer Vision and Pattern Recognition (CVPR), vol. 2, p. II–721 (2003)

    Google Scholar 

  5. Barnes, C., Shechtman, E., Finkelstein, A., Goldman, D.: Patchmatch: A randomized correspondence algorithm for structural image editing. ACM Transactions on Graphics-TOG 28, 24 (2009)

    Google Scholar 

  6. Herling, J., Broll, W.: Pixmix: A real-time approach to high-quality diminished reality. In: International Symposium on Mixed and Augmented Reality (ISMAR), pp. 141–150 (2012)

    Google Scholar 

  7. Kawai, N., Yokoya, N.: Image inpainting considering symmetric patterns. In: International Conference on Pattern Recognition (ICPR), pp. 2744–2747 (2012)

    Google Scholar 

  8. Bertalmio, M., Bertozzi, A.L., Sapiro, G.: Navier-stokes, fluid dynamics, and image and video inpainting. In: Conference on Computer Vision and Pattern Recognition, CVPR, vol. 1, p. I–355 (2001)

    Google Scholar 

  9. Chan, T.F., Shen, J.: Nontexture inpainting by curvature-driven diffusions. Journal of Visual Communication and Image Representation 12, 436–449 (2001)

    Article  Google Scholar 

  10. Telea, A.: An image inpainting technique based on the fast marching method. Journal of Graphics Tools 9, 23–34 (2004)

    Article  Google Scholar 

  11. Bertalmio, M., Vese, L., Sapiro, G., Osher, S.: Simultaneous structure and texture image inpainting. IEEE Transactions on Image Processing 12, 882–889 (2003)

    Article  Google Scholar 

  12. Sun, J., Yuan, L., Jia, J., Shum, H.Y.: Image completion with structure propagation. ACM Transactions on Graphics (ToG) 24, 861–868 (2005)

    Article  Google Scholar 

  13. Komodakis, N., Tziritas, G.: Image completion using efficient belief propagation via priority scheduling and dynamic pruning. IEEE Transactions on Image Processing 16, 2649–2661 (2007)

    Article  MathSciNet  Google Scholar 

  14. Le Meur, O., Ebdelli, M., Guillemot, C.: Hierarchical super-resolution-based inpainting. IEEE Transactions on Image Processing 22, 3779–3790 (2013)

    Article  MathSciNet  Google Scholar 

  15. Ashikhmin, M.: Synthesizing natural textures. In: Proceedings of the Symposium on Interactive 3D graphics, pp. 217–226 (2001)

    Google Scholar 

  16. Efros, A.A., Leung, T.K.: Texture synthesis by non-parametric sampling. In: Computer Vision, vol. 2, pp. 1033–1038 (1999)

    Google Scholar 

  17. Fischler, M.A., Bolles, R.C.: Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Communications of the ACM 24, 381–395 (1981)

    Article  MathSciNet  Google Scholar 

  18. Herling, J., Broll, W.: High-quality real-time video inpainting with pixmix. IEEE Transactions on Visualization and Computer Graphics 1 (2014)

    Google Scholar 

  19. He, K., Sun, J.: Statistics of patch offsets for image completion. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012, Part II. LNCS, vol. 7573, pp. 16–29. Springer, Heidelberg (2012)

    Chapter  Google Scholar 

  20. He, K., Sun, J.: Computing nearest-neighbor fields via propagation-assisted kd-trees. In: Computer Vision and Pattern Recognition (CVPR), pp. 111–118 (2012)

    Google Scholar 

  21. Canny, J.: A computational approach to edge detection. In: IEEE Transactions on Pattern Analysis and Machine Intelligence, pp. 679–698 (1986)

    Google Scholar 

  22. Huang, J.-B., Kang, S.B., Ahuja, N., Kopf, J.: Image completion using planar structure guidance. ACM Transactions on Graphics (Proceedings of SIGGRAPH) 33 (2014)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Vision and Content Engineering Laboratory, CEA LIST, Gif-sur-Yvette, F-91191, France

    Guillaume Chican & Mohamed Tamaazousti

Authors
  1. Guillaume Chican
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mohamed Tamaazousti
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Department of Computer Science and Engineering, University of Nevada at Reno, USA

    George Bebis

  2. NASA Ames Research Center, Moffett Field, CA, USA

    Richard Boyle

  3. Lawrence Berkeley National Laboratory, Berkeley, CA, USA

    Bahram Parvin

  4. Desert Research Institute, Reno, NV, USA

    Darko Koracin

  5. The University of Texas at Dallas, 75080, Richardson, TX, USA

    Ryan McMahan

  6. NextGen Interactions, 27604, Raleigh, NC, USA

    Jason Jerald

  7. Indiana University, 46202, Indianapolis, IN, USA

    Hui Zhang

  8. Microsoft Research, 1 Microsoft Way, 98052, Redmond, WA, USA

    Steven M. Drucker

  9. University of Delaware, 19716-2712, Newark, DE, USA

    Chandra Kambhamettu

  10. Intel Corp., 95054, Santa Clara, CA, USA

    Maha El Choubassi

  11. Computer Graphics and Interactive Media Lab, Department of Computer Science, University of Houston, 77004, Houston, TX, USA

    Zhigang Deng

  12. NVIDIA, 34788, Leesburg, FL, USA

    Mark Carlson

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer International Publishing Switzerland

About this paper

Cite this paper

Chican, G., Tamaazousti, M. (2014). Constrained PatchMatch for Image Completion. In: Bebis, G., et al. Advances in Visual Computing. ISVC 2014. Lecture Notes in Computer Science, vol 8887. Springer, Cham. https://doi.org/10.1007/978-3-319-14249-4_53

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-14249-4_53

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-14248-7

  • Online ISBN: 978-3-319-14249-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation