Skip to main content
Log in

Harmonic coordinates for real-time image cloning

  • Published:
Journal of Zhejiang University SCIENCE C Aims and scope Submit manuscript

Abstract

Traditional gradient domain seamless image cloning is a time consuming task, requiring the solving of Poisson’s equations whenever the shape or position of the cloned region changes. Recently, a more efficient alternative, the mean-value coordinates (MVCs) based approach, was proposed to interpolate interior pixels by a weighted combination of values along the boundary. However, this approach cannot faithfully preserve the gradient in the cloning region. In this paper, we introduce harmonic cloning, which uses harmonic coordinates (HCs) instead of MVCs in image cloning. Benefiting from the non-negativity and interior locality of HCs, our interpolation generates a more accurate harmonic field across the cloned region, to preserve the results with as high a quality as with Poisson cloning. Furthermore, with optimizations and implementation on a graphic processing unit (GPU), we demonstrate that, compared with the method using MVCs, our harmonic cloning gains better quality while retaining real-time performance.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Agarwala, A., 2007. Efficient gradient-domain compositing using quadtrees. ACM Trans. Graph., 26(3), Article No. 94, p.1–5. [doi:10.1145/1276377.1276495]

    Article  Google Scholar 

  • DeRose, T., Meyer, M., 2006. Harmonic Coordinates. Pixar Technical Memo 06-02. Pixar Animation Studios. Available from http://graphics.pixar.com/HarmonicCoordinates/

  • Farbman, Z., Hoffer, G., Lipman, Y., Cohen-Or, D., Lischinski, D., 2009. Coordinates for instant image cloning. ACM Trans. Graph., 28(3), Article No. 67, p.1–9. [doi:10.1145/1531326.1531373]

    Article  Google Scholar 

  • Floater, M.S., 2003. Mean value coordinates. Comput. Aided Geom. Des., 20(1):19–27. [doi:10.1016/S0167-8396(03)00002-5]

    Article  MATH  MathSciNet  Google Scholar 

  • Georgiev, T., 2004. Photoshop Healing Brush: a Tool for Seamless Cloning. Workshop on Applications of Computer Vision, p.1–8.

  • Iserles, A., 1996. A First Course in Numerical Analysis of Differential Equations. Cambridge University Press, New York, USA.

    Google Scholar 

  • Jeschke, S., Cline, D., Wonka, P., 2009. A GPU Laplacian solver for diffusion curves and Poisson image editing. ACM Trans. Graph., 28(5), Article No. 116, p.1–8. [doi:10.1145/1618452.1618462]

    Google Scholar 

  • Jia, J., Sun, J., Tang, C.K., Shum, H.Y., 2006. Dragand-drop pasting. ACM Trans. Graph., 25(3):631–637. [doi: 10.1145/1141911.1141934]

    Article  Google Scholar 

  • Joshi, P., Meyer, M., DeRose, T., Green, B., Sanocki, T., 2007. Harmonic coordinates for character articulation. ACM Trans. Graph., 26(3), Article No. 71, p.1–9. [doi:10.1145/1276377.1276466]

    Article  Google Scholar 

  • Kazhdan, M., Hoppe, H., 2008. Streaming multigrid for gradient-domain operations on large images. ACM Trans. Graph., 27(3), Article No. 21, p.1–10. [doi:10.1145/1360612.1360620]

    Article  Google Scholar 

  • Levin, A., Zomet, A., Peleg, S., Weiss, Y., 2004. Seamless Image Stitching in the Gradient Domain. 8th European Conf. on Computer Vision, p.377–389. [doi:10.1145/1276377.1276495]

  • McCann, J., Pollard, N.S., 2008. Real-time gradientdomain painting. ACM Trans. Graph., 27(3), Article No. 93, p.1–7. [doi:10.1145/1360612.1360692]

    Article  Google Scholar 

  • Orzan, A., Bousseau, A., Winnemöler, H., Barla, P., Thollot, J., Salesin, D., 2008. Diffusion curves: a vector representation for smooth-shaded images. ACM Trans. Graph., 27(3), Article No. 92, p.1–8. [doi:10.1145/1360612.1360691]

    Article  Google Scholar 

  • Pérez, P., Gangnet, M., Blake, A., 2003. Poisson image editing. ACM Trans. Graph., 22(3):313–318. [doi:10.1145/882262.882269]

    Article  Google Scholar 

  • Shewchuk, J.R., 2005. A Two-Dimensional Quality Mesh Generator and Delaunay Triangulator. Available from http://www.cs.cmu.edu/~quake/triangle.html [Accessed on Mar. 22, 2010].

  • Szeliski, R., 2006. Locally adapted hierarchical basis preconditioning. ACM Trans. Graph., 25:1135–1143. [doi:10.1145/1141911.1142005]

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Wei-feng Chen.

Additional information

Project supported in part by the National Natural Science Foundation of China (No. 60903037) and the National Basic Research Program (973) of China (No. 2009CB320803)

Rights and permissions

Reprints and permissions

About this article

Cite this article

Wang, R., Chen, Wf., Pan, Mh. et al. Harmonic coordinates for real-time image cloning. J. Zhejiang Univ. - Sci. C 11, 690–698 (2010). https://doi.org/10.1631/jzus.C1000067

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1631/jzus.C1000067

Key words

CLC number

Navigation