Abstract
Traditional gradient domain seamless image cloning is a time consuming task, requiring the solving of Poisson’s equations whenever the shape or position of the cloned region changes. Recently, a more efficient alternative, the mean-value coordinates (MVCs) based approach, was proposed to interpolate interior pixels by a weighted combination of values along the boundary. However, this approach cannot faithfully preserve the gradient in the cloning region. In this paper, we introduce harmonic cloning, which uses harmonic coordinates (HCs) instead of MVCs in image cloning. Benefiting from the non-negativity and interior locality of HCs, our interpolation generates a more accurate harmonic field across the cloned region, to preserve the results with as high a quality as with Poisson cloning. Furthermore, with optimizations and implementation on a graphic processing unit (GPU), we demonstrate that, compared with the method using MVCs, our harmonic cloning gains better quality while retaining real-time performance.
Similar content being viewed by others
References
Agarwala, A., 2007. Efficient gradient-domain compositing using quadtrees. ACM Trans. Graph., 26(3), Article No. 94, p.1–5. [doi:10.1145/1276377.1276495]
DeRose, T., Meyer, M., 2006. Harmonic Coordinates. Pixar Technical Memo 06-02. Pixar Animation Studios. Available from http://graphics.pixar.com/HarmonicCoordinates/
Farbman, Z., Hoffer, G., Lipman, Y., Cohen-Or, D., Lischinski, D., 2009. Coordinates for instant image cloning. ACM Trans. Graph., 28(3), Article No. 67, p.1–9. [doi:10.1145/1531326.1531373]
Floater, M.S., 2003. Mean value coordinates. Comput. Aided Geom. Des., 20(1):19–27. [doi:10.1016/S0167-8396(03)00002-5]
Georgiev, T., 2004. Photoshop Healing Brush: a Tool for Seamless Cloning. Workshop on Applications of Computer Vision, p.1–8.
Iserles, A., 1996. A First Course in Numerical Analysis of Differential Equations. Cambridge University Press, New York, USA.
Jeschke, S., Cline, D., Wonka, P., 2009. A GPU Laplacian solver for diffusion curves and Poisson image editing. ACM Trans. Graph., 28(5), Article No. 116, p.1–8. [doi:10.1145/1618452.1618462]
Jia, J., Sun, J., Tang, C.K., Shum, H.Y., 2006. Dragand-drop pasting. ACM Trans. Graph., 25(3):631–637. [doi: 10.1145/1141911.1141934]
Joshi, P., Meyer, M., DeRose, T., Green, B., Sanocki, T., 2007. Harmonic coordinates for character articulation. ACM Trans. Graph., 26(3), Article No. 71, p.1–9. [doi:10.1145/1276377.1276466]
Kazhdan, M., Hoppe, H., 2008. Streaming multigrid for gradient-domain operations on large images. ACM Trans. Graph., 27(3), Article No. 21, p.1–10. [doi:10.1145/1360612.1360620]
Levin, A., Zomet, A., Peleg, S., Weiss, Y., 2004. Seamless Image Stitching in the Gradient Domain. 8th European Conf. on Computer Vision, p.377–389. [doi:10.1145/1276377.1276495]
McCann, J., Pollard, N.S., 2008. Real-time gradientdomain painting. ACM Trans. Graph., 27(3), Article No. 93, p.1–7. [doi:10.1145/1360612.1360692]
Orzan, A., Bousseau, A., Winnemöler, H., Barla, P., Thollot, J., Salesin, D., 2008. Diffusion curves: a vector representation for smooth-shaded images. ACM Trans. Graph., 27(3), Article No. 92, p.1–8. [doi:10.1145/1360612.1360691]
Pérez, P., Gangnet, M., Blake, A., 2003. Poisson image editing. ACM Trans. Graph., 22(3):313–318. [doi:10.1145/882262.882269]
Shewchuk, J.R., 2005. A Two-Dimensional Quality Mesh Generator and Delaunay Triangulator. Available from http://www.cs.cmu.edu/~quake/triangle.html [Accessed on Mar. 22, 2010].
Szeliski, R., 2006. Locally adapted hierarchical basis preconditioning. ACM Trans. Graph., 25:1135–1143. [doi:10.1145/1141911.1142005]
Author information
Authors and Affiliations
Corresponding author
Additional information
Project supported in part by the National Natural Science Foundation of China (No. 60903037) and the National Basic Research Program (973) of China (No. 2009CB320803)
Rights and permissions
About this article
Cite this article
Wang, R., Chen, Wf., Pan, Mh. et al. Harmonic coordinates for real-time image cloning. J. Zhejiang Univ. - Sci. C 11, 690–698 (2010). https://doi.org/10.1631/jzus.C1000067
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1631/jzus.C1000067
Key words
- Seamless cloning
- Poisson’s equation
- Harmonic coordinates (HCs)
- Mean-value coordinates (MVCs)
- GPU acceleration