Abstract
In this paper, we present a unified approach for the problem of computing color transforms, applications of which include shadow removal and object recoloring. We propose two algorithms for transforming colors. In the first algorithm, the detection of source and target regions is performed using a Bayesian classifier. Given these regions, the computed transform alters the color properties of the target region so as to closely resemble those of the source region. The proposed probabilistic formulation leads to a linear program (similar to the classic Transportation Problem), which computes the desired transformation between the target and source distributions. In the second algorithm, the detection and transformation steps are united into a single unified approach; furthermore, the continuity of the transformation arises more intrinsically within this algorithm. Both formulations allow the target region to acquire the properties of the source region, while at the same time retaining its own look and feel. Promising results are shown for a variety of applications.
Similar content being viewed by others
References
Weiss, Y.: Deriving intrinsic images from image sequences. In: Eighth IEEE International Conference on Computer Vision, 2001. ICCV 2001. Proceedings, vol. 2 (2001)
Tappen, M.F., Freeman, W.T., Adelson, E.H.: Recovering intrinsic images from a single image. IEEE Trans. Pattern Anal. Mach. Intell. 27(9), 1459–1472 (2005)
Land, E.H., McCann, J.J.: Lightness and retinex theory. J. Opt. Soc. Am. 61(1), 1–11 (1971)
Oh, B.M., Durand, F., Chen, M.: Image-based modeling and photo editing. In: Proc. SIGGRAPH 2001, pp. 433–442. ACM, New York (2001)
Finlayson, G.D., Hordley, S.D., Drew, M.S.: Removing Shadows from Images. Lecture Notes in Computer Science, pp. 823–836 (2002)
Finlayson, G.D., Hordley, S.D., Lu, C., Drew, M.S.: On the removal of shadows from images. IEEE Trans. Pattern Anal. Mach. Intell. 28(1), 59–68 (2006)
Chuang, Y.Y., Goldman, D.B., Curless, B., Salesin, D.H., Szeliski, R.: Shadow matting and compositing. ACM Trans. Graph. 22(3), 494–500 (2003)
Shor, Y., Lischinski, D.: The shadow meets the mask: pyramid-based shadow removal. In: Computer Graphics Forum, vol. 27, pp. 577–586. Blackwell, Oxford (2008)
Welsh, T., Ashikhmin, M., Mueller, K.: Transferring color to greyscale images. In: Proceedings of the 29th Annual Conference on Computer Graphics and Interactive Techniques, pp. 277–280. ACM, New York (2002)
Xiao, X., Ma, L., Kunze, M.: Object-Based Image Recoloring Using Alpha Matte and Color Histogram Specification. Lecture Notes in Computer Science, vol. 4270, p. 194 (2006)
Levin, A., Lischinski, D., Weiss, Y.: Colorization using optimization. ACM Trans. Graph. (TOG) 23(3), 689–694 (2004)
Greenfield, G.R., House, D.H.: Image recoloring induced by palette color associations. J. WSCG 11(1), 189–196 (2003)
Reinhard, E., Ashikhmin, M., Gooch, B., Shirley, P.: Color transfer between images. IEEE Comput. Graph. Appl., 34–41 (2001)
Tai, Y.W., Jia, J., Tang, C.K.: Local color transfer via probabilistic segmentation by expectation-maximization. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2005. CVPR 2005, vol. 1 (2005)
Pitie, F., Kokaram, A.C., Dahyot, R.: N-dimensional probability density function transfer and its application to colour transfer. In: ICCV, pp. 1434–1439 (2005)
Pérez, P., Gangnet, M., Blake, A.: Poisson image editing. ACM Trans. Graph. 22(3), 313–318 (2003)
Kisilev, P., Freedman, D.: Color transforms for creative image editing. In: Color Imaging Conference. CIC 09 (2009)
Hitchcock, F.L.: The distribution of a product from several sources to numerous localities. J. Math. Phys. Mass. Inst. Tech. 20, 224–230 (1941)
Rachev, S.T.: The Monge–Kantorovich mass transference problem and its stochastic applications. Theory Probab. Appl. 29, 647 (1985)
Rubner, Y., Tomasi, C., Guibas, L.J.: The earth mover’s distance as a metric for image retrieval. Int. J. Comput. Vis. 40(2), 99–121 (2000)
Haker, S., Zhu, L., Tannenbaum, A., Angenent, S.: Optimal mass transport for registration and warping. Int. J. Comput. Vis. 60(3), 225–240 (2004)
Wu, Y., Huang, T.S.: Color tracking by transductive learning. In: IEEE Conference on Computer Vision and Pattern Recognition, 2000. Proceedings, vol. 1 (2000)
Girolami, M., He, C.: Probability density estimation from optimally condensed data samples. IEEE Trans. Pattern Anal. Mach. Intell. 1253–1264 (2003)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Freedman, D., Kisilev, P. Computing Color Transforms with Applications to Image Editing. J Math Imaging Vis 37, 220–231 (2010). https://doi.org/10.1007/s10851-010-0204-8
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10851-010-0204-8