Abstract
We propose a color-aware regularization for use with gradient domain image manipulation to avoid color shift artifacts. Our work is motivated by the observation that colors of objects in natural images typically follow distinct distributions in the color space. Conventional regularization methods ignore these distributions which can lead to undesirable colors appearing in the final output. Our approach uses an anisotropic Mahalanobis distance to control output colors to better fit original distributions. Our color-aware regularization is simple, easy to implement, and does not introduce significant computational overhead. To demonstrate the effectiveness of our method, we show the results with and without our color-aware regularization on three gradient domain tasks: gradient transfer, gradient boosting, and saliency sharpening.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Bhat, P., Zitnick, C., Cohen, M., Curless, B.: Gradientshop: a gradient-domain optimization framework for image and video filtering. ACM Transactions on Graphics 29, 1–14 (2010)
Fattal, R., Lischinski, D., Werman, M.: Gradient domain high dynamic range compression. ACM Transactions on Graphics 21, 249–256 (2002)
Jia, J., Sun, J., Tang, C., Shum, H.: Drag-and-drop pasting. ACM Transactions on Graphics 25, 631–637 (2006)
Raskar, R., Ilie, A., Yu, J.: Image fusion for context enhancement and video surrealism. ACM SIGGRAPH Courses (2005)
McCann, J., Pollard, N.: Real-time gradient-domain painting. ACM Transactions on Graphics 27, 1–7 (2008)
Pérez, P., Gangnet, M., Blake, A.: Poisson image editing. ACM Transactions on Graphics 22, 313–318 (2003)
Zeng, Y., Chen, W., Peng, Q.: A novel variational image model: Towards a unified approach to image editing. Journal of Computer Science and Technology 21 (2006)
Krishnan, D., Fergus, R.: Dark flash photography. ACM Transactions on Graphics 28 (2009)
Yang, W., Zheng, J., Cai, J., Rahardja, S., Chen, C.: Natural and seamless image composition with color control. IEEE Transactions on Image Processing 18 (2009)
Xiao, X., Ma, L.: Gradient-preserving color transfer. Computer Graphics Forum 28, 1879–1886 (2009)
Shibata, T., Iketani, A., Senda, S.: Image Inpainting Based on Probabilistic Structure Estimation. In: Kimmel, R., Klette, R., Sugimoto, A. (eds.) ACCV 2010, Part III. LNCS, vol. 6494, pp. 109–120. Springer, Heidelberg (2011)
Omer, I., Werman, M.: Color lines: Image specific color representation. IEEE Computer Vision and Pattern Recognition (2004)
Duda, R., Hart, P., Stork, D.: Pattern classification, vol. 2. Wiley, New York (2001)
Ren, X., Malik, J.: Learning a classification model for segmentation. In: IEEE International Conference on Computer Vision (2003)
Avriel, M.: Nonlinear programming: Analysis and methods. Dover Publishing (2003)
Levin, A., Fergus, R., Durand, F., Freeman, W.: Image and depth from a conventional camera with a coded aperture. ACM Transactions on Graphics 26 (2007)
Krishnan, D., Fergus, R.: Fast image deconvolution using hyper-laplacian priors. In: Advances in Neural Information Processing Systems, vol. 22, pp. 1–9 (2009)
Zhang, X., Sim, T., Miao, X.: Enhancing photographs with near infra-red images. In: IEEE Computer Vision and Pattern Recognition (2008)
Vincent, L., Soille, P.: Watersheds in digital spaces: an efficient algorithm based on immersion simulations. IEEE Transactions on Pattern Analysis and Machine Intelligence 13, 583–598 (1991)
Vazquez, E., Baldrich, R., van de Weijer, J., Vanrell, M.: Describing reflectances for color segmentation robust to shadows, highlights, and textures. IEEE Transactions on Pattern Analysis and Machine Intelligence (2010)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Deng, F., Kim, S.J., Tai, YW., Brown, M.S. (2013). Color-Aware Regularization for Gradient Domain Image Manipulation. In: Lee, K.M., Matsushita, Y., Rehg, J.M., Hu, Z. (eds) Computer Vision – ACCV 2012. ACCV 2012. Lecture Notes in Computer Science, vol 7727. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-37447-0_30
Download citation
DOI: https://doi.org/10.1007/978-3-642-37447-0_30
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-37446-3
Online ISBN: 978-3-642-37447-0
eBook Packages: Computer ScienceComputer Science (R0)