Skip to main content
Springer Nature Link
Log in

Content-aware copying and pasting in images

  • Original Article
  • Published:
The Visual Computer Aims and scope Submit manuscript

Abstract

We present a content-aware image copy-and-paste technique which combines ideas from both matting and gradient-based methods. We modify the diffusion process used in the gradient-based approach to use the alpha matte for the cloned area as a weight function to control intensity interpolation. This ensures that the color style of the significant parts of the selected region is preserved when pasting. We use a framework based on mean-value coordinates to implement our approach, allowing us to provide a parallel implementation suitable for use on a GPU. Experimental results show the advantages of our method.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

References

  1. Adobe. PhotoShop 7.0 User Guide (2003)

  2. Boykov, Y.Y., Jolly, M.P.: Interactive graph cuts for optimal boundary and region segmentation of objects in n-d images. In: ICCV, vol. 1, pp. 105–112 (2001)

  3. Chen, T., Cheng, M.-M., Tan, P., Shamir, A., Hu, S.-M.: Sketch2photo: Internet image montage. In: ACM Trans. Graph. 28(5) (2009)

  4. Chuang, Y.-Y., Curless, B., Salesin, D.H., Szeliski, R.: A bayesian approach to digital matting. In: Proceedings of IEEE CVPR 2001, vol. 2, pp. 264–271. IEEE Comput. Soc., Los Alamitos (2001)

    Google Scholar 

  5. Farbman, Z., Hoffer, G., Lipman, Y., Cohen-Or, D., Lischinski, D.: Coordinates for instant image cloning. In: SIGGRAPH ’09: ACM SIGGRAPH 2009 papers, pp. 1–9. ACM, New York (2009)

    Google Scholar 

  6. Floater, M.S.: Mean value coordinates. Comput. Aided Geom. Des. 20, 2003 (2003)

    Article  MathSciNet  Google Scholar 

  7. Georgiev, T.: Photoshop healing brush: a tool for seamless cloning. In: Workshop on Applications of Computer Vision (ECCV 2004), pp. 1–8 (2004)

  8. Jia, J., Sun, J., Tang, C.-K., Shum, H.-Y.: Drag-and-drop pasting. ACM Trans. Graph. 25(3), 631–637 (2006)

    Article  Google Scholar 

  9. Lalonde, J.-F., Hoiem, D., Efros, A.A., Rother, C., Winn, J., Criminisi, A.: Photo clip art. ACM Trans. Graph. 26(3), 3 (2007)

    Article  Google Scholar 

  10. Land, E.H., McCann, J.J.: Lightness and retinex theory. J. Opt. Soc. Am. 61, 1 (1971)

    Article  Google Scholar 

  11. Levin, A., Lischinski, D., Weiss, Y.: A closed form solution to natural image matting. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition. IEEE Comput. Soc., Los Alamitos (2006)

    Google Scholar 

  12. Levin, A., Lischinski, D., Weiss, Y.: A closed-form solution to natural image matting. IEEE Trans. Pattern Anal. Mach. Intell. 30(2), 228–242 (2008)

    Article  Google Scholar 

  13. Li, Y., Sun, J., Tang, C.-K., Shum, H.-Y.: Lazy snapping. In: SIGGRAPH ’04: ACM SIGGRAPH 2004 Papers, pp. 303–308. ACM, New York (2004)

    Chapter  Google Scholar 

  14. Liu, J., Sun, J., Shum, H.-Y.: Paint selection. ACM Trans. Graph. 28(3), 1–7 (2009)

    Google Scholar 

  15. Pérez, P., Gangnet, M., Blake, A.: Poisson image editing. ACM Trans. Graph. 22(3), 313–318 (2003)

    Article  Google Scholar 

  16. Rother, C., Kolmogorov, V., Blake, A.: “grabcut”: interactive foreground extraction using iterated graph cuts. In: SIGGRAPH ’04: ACM SIGGRAPH 2004 Papers, pp. 309–314. ACM, New York (2004)

    Chapter  Google Scholar 

  17. Ruzon, M.A., Tomasi, C.: Alpha estimation in natural images. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 2000, vol. 1, pp. 18–25 (2000)

  18. Sun, J., Jia, J., Tang, C.-K., Shum, H.-Y.: Poisson matting. In: SIGGRAPH ’04: ACM SIGGRAPH 2004 Papers, pp. 315–321. ACM, New York (2004)

    Chapter  Google Scholar 

  19. Wang, J., Cohen, M.F.: Optimized color sampling for robust matting. In: IEEE Conference on Computer Vision and Pattern Recognition, 2007. CVPR ’07, pp. 1–8 (2007)

  20. Wang, J., Cohen, M.F.: Image and video matting: a survey. Found. Trends. Comput. Graph. Vis. 3(2), 97–175 (2007)

    Article  Google Scholar 

  21. Wang, J., Agrawala, M., Cohen, M.F.: Soft scissors: an interactive tool for realtime high quality matting. In: SIGGRAPH ’07: ACM SIGGRAPH 2007 papers, p. 9. ACM, New York (2007)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science and Engineering, Zhejiang University, Hangzhou, 310027, China

    Meng Ding & Ruo-Feng Tong

Authors
  1. Meng Ding
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Ruo-Feng Tong
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Meng Ding.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Ding, M., Tong, RF. Content-aware copying and pasting in images. Vis Comput 26, 721–729 (2010). https://doi.org/10.1007/s00371-010-0448-8

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00371-010-0448-8

Keywords