Skip to main content
SpringerLink
Log in

Environment-Sensitive cloning in images

  • Original Article
  • Published:
The Visual Computer Aims and scope Submit manuscript

Abstract

We present an Environment-Sensitive image cloning technique which improves the previous gradient-based methods by taking into account the content of target scene. We create a reference image to represent the global feature of target image which could be further diffused into the cloned patch, and modify the diffusion process to ensure that the cloning result is seamless and natural. Specifically, we figure out an efficient solution based on Mean-Value Coordinates (MVC) to deal with the hybrid boundary, and construct a general model based on MVC to implement our image cloning, which is further applied to video cloning. Experimental results demonstrate the effectiveness of our Environment-Sensitive cloning.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Armstrong, C.J., Price, B.L., Barrett, W.A.: Interactive segmentation of image volumes with live surface. Comput. Graph. 31(2), 212–229 (2007)

    Article  Google Scholar 

  2. Bai, X., Wang, J., Simons, D., Sapiro, G.: Video snapcut: robust video object cutout using localized classifiers. ACM Trans. Graph. 28(3), 70 (2009)

    Article  Google Scholar 

  3. Chen, T., Cheng, M.M., Tan, P., Shamir, A., Hu, S.M.: Sketch2photo: Internet image montage. ACM Trans. Graph. 28(5), 124 (2009)

    Google Scholar 

  4. Cheng, M.M., Zhang, F.L., Mitra, N.J., Huang, X., Hu, S.M.: Repfinder: finding approximately repeated scene elements for image editing. ACM Trans. Graph. 29(4), 83 (2010)

    Article  Google Scholar 

  5. Chuang, Y.Y., Curless, B., Salesin, D.H., Szeliski, R.: A Bayesian approach to digital matting. In: Proceedings of IEEE CVPR 2001, vol. 2, pp. 264–271. IEEE Computer Society, Los Alamitos (2001)

    Google Scholar 

  6. Chuang, Y.Y., Agarwala, A., Curless, B., Salesin, D.H., Szeliski, R.: Video matting of complex scenes. ACM Trans. Graph. 21(3), 243–248 (2002). Special Issue of the SIGGRAPH 2002 Proceedings

    Article  Google Scholar 

  7. Ding, M., Tong, R.F.: Content-aware copying and pasting in images. Vis. Comput. 26(6–8), 721–729 (2010)

    Article  Google Scholar 

  8. Farbman, Z., Hoffer, G., Lipman, Y., Cohen-Or, D., Lischinski, D.: Coordinates for instant image cloning. ACM Trans. Graph. 28(3), 67 (2009)

    Article  Google Scholar 

  9. Gastal, E.S.L., Oliveira, M.M.: Shared sampling for real-time alpha matting. Comput. Graph. Forum 29(2), 575–584 (2010). Proceedings of Eurographics

    Article  Google Scholar 

  10. Jia, J., Sun, J., Tang, C.K., Shum, H.Y.: Drag-and-drop pasting. ACM Trans. Graph. 25(3), 631–637 (2006)

    Article  Google Scholar 

  11. Lalonde, J.F., Efros, A.A., Narasimhan, S.G.: Estimating natural illumination from a single outdoor image. In: IEEE International Conference on Computer Vision (2009)

    Google Scholar 

  12. Lalonde, J.F., Hoiem, D., Efros, A.A., Rother, C., Winn, J.M., Criminisi, A.: Photo clip art. ACM Trans. Graph. 26(3), 3 (2007)

    Article  Google Scholar 

  13. Land, E.H., Mccann, J.: Lightness and retinex theory. J. Opt. Soc. Am. 61, 1–11 (1971)

    Article  Google Scholar 

  14. Levin, A., Lischinski, D., Weiss, Y.: A closed-form solution to natural image matting. IEEE Trans. Pattern Anal. Mach. Intell. 30(2), 228–242 (2008)

    Article  Google Scholar 

  15. Li, Y., Ju, T., Hu, S.M.: Instant propagation of sparse edits on images and videos. Comput. Graph. Forum 29(7), 2049–2054 (2010)

    Article  Google Scholar 

  16. Pérez, P., Gangnet, M., Blake, A.: Poisson image editing. ACM Trans. Graph. 22(3), 313–318 (2003)

    Article  Google Scholar 

  17. Ruzon, M.A., Tomasi, C.: Alpha estimation in natural images. In: CVPR, pp. 1018–1025 (2000)

    Google Scholar 

  18. Wang, J., Cohen, M.F.: An iterative optimization approach for unified image segmentation and matting. In: ICCV, pp. 936–943 (2005)

    Google Scholar 

  19. Wang, H., Raskar, R., Ahuja, N.: Seamless video editing. In: ICPR (3), pp. 858–861 (2004)

    Google Scholar 

  20. Wang, J., Agrawala, M., Cohen, M.F.: Soft scissors: an interactive tool for realtime high quality matting. ACM Trans. Graph. 26(3), 9 (2007)

    Article  MATH  Google Scholar 

  21. Wang, J., Cohen, M.F.: Image and video matting: a survey. Found. Trends Comput. Graph. Vis. 3(2), 97–175 (2007)

    Article  Google Scholar 

  22. Xie, Z.F., Shen, Y., Ma, L., Chen, Z.: Seamless video composition using optimized mean-value cloning. Vis. Comput. 26(6–8), 1123–1134 (2010)

    Article  Google Scholar 

  23. Xu, K., Li, Y., Ju, T., Hu, S.M., Liu, T.Q.: Efficient affinity-based edit propagation using k-d tree. ACM Trans. Graph. 28(5), 118 (2009)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science and Technology, Zhejiang University, Hangzhou, 310027, China

    Yun Zhang & Ruofeng Tong

Authors
  1. Yun Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ruofeng Tong
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ruofeng Tong.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Zhang, Y., Tong, R. Environment-Sensitive cloning in images. Vis Comput 27, 739–748 (2011). https://doi.org/10.1007/s00371-011-0583-x

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00371-011-0583-x

Keywords

Search

Navigation