research-article

User Interaction for Image Recolouring using £2

Authors:

Mairéad Grogan,

Aljosa SmolicAuthors Info & Claims

CVMP '17: Proceedings of the 14th European Conference on Visual Media Production (CVMP 2017)

Article No.: 6, Pages 1 - 10

https://doi.org/10.1145/3150165.3150171

Published: 11 December 2017 Publication History

Abstract

Recently, an example based colour transfer approach proposed modelling the colour distributions of a palette and target image using Gaussian Mixture Models, and registers them by minimising the robust £2 distance between the mixtures. In this paper we propose to extend this approach to allow for user interaction. We present two interactive recolouring applications, the first allowing the user to select colour correspondences between a target and palette image, while the second palette based application allows the user to edit a palette of colours to determine the image recolouring. We modify the £2 based cost function to improve results when an interactive interface is used, and take measures to ensure that even when minimal input is given by the user, good colour transfer results are created. Both applications are available through a web interface and qualitatively assessed against recent recolouring techniques.

References

[1]

Y. Aksoy, T. O. Aydın, A. Smolić, and M. Pollefeys. 2017. Unmixing-Based Soft Color Segmentation for Image Manipulation. ACM Trans. Graph. 36, 2 (2017), 19:1--19:19.

Digital Library

[2]

Xiaobo An and Fabio Pellacini. 2008. AppProp: All-pairs Appearance-space Edit Propagation. In ACM SIGGRAPH 2008 Papers (SIGGRAPH '08). ACM, New York, NY, USA, Article 40, 9 pages.

Digital Library

[3]

Benoit Arbelot, Romain Vergne, Thomas Hurtut, and JoÃńlle Thollot. 2016. Automatic Texture Guided Color Transfer and Colorization. In Non-Photorealistic Animation and Rendering. The Eurographics Association.

[4]

Nicolas Bonneel, Julien Rabin, Gabriel PeyrÃl', and Hanspeter Pfister. 2015. Sliced and Radon Wasserstein Barycenters of Measures. Journal of Mathematical Imaging and Vision 51, 1 (2015), 22--45.

Digital Library

[5]

H. Chang, O. Fried, Y. Liu, S. DiVerdi, and A. Finkelstein. 2015. Palette-based Photo Recoloring. ACM Transactions on Graphics (SIGGRAPH) 34, 4 (July 2015).

Digital Library

[6]

X. Chen, D. Zou, J. Li, X. Cao, Q. Zhao, and H. Zhang. 2014. Sparse Dictionary Learning for Edit Propagation of High-Resolution Images. In 2014 IEEE Conference on Computer Vision and Pattern Recognition. 2854--2861.

Digital Library

[7]

S. Croci, T. O. Aydin, N. Stefanoski, M. Gross, and A. Smolic. 2017. Advanced tools and framework for historical film restoration. Journal of Electronic Imaging 26, 1 (2017), 011021.

[8]

S. Ferradans, N. Papadakis, J. Rabin, G. Peyré, and J.-F. Aujol. 2013. Regularized Discrete Optimal Transport. In Scale Space and Variational Methods in Computer Vision, A. Kuijper, K. Bredies, T. Pock, and H. Bischof (Eds.). Lecture Notes in Computer Science, Vol. 7893. Springer Berlin Heidelberg, 428--439.

[9]

Mairead Grogan and Rozenn Dahyot. 2015. L2 Registration for Colour Transfer in Videos. In Proceedings of the 12th European Conference on Visual Media Production (CVMP '15). ACM, New York, NY, USA, Article 16, 1 pages.

Digital Library

[10]

M. Grogan and R. Dahyot. 2017. Robust Registration of Gaussian Mixtures for Colour Transfer. ArXiv e-prints (May 2017). arXiv:cs.CV/1705.06091

[11]

M. Grogan, M. Prasad, and R. Dahyot. 2015. L2 Registration for Colour Transfer. In European Signal Processing Conference (Eusipco). Nice France.

[12]

Y. HaCohen, E. Shechtman, D. B. Goldman, and D. Lischinski. 2011. Non-rigid Dense Correspondence with Applications for Image Enhancement. ACM Trans. Graph. 30, 4, Article 70 (July 2011), 70:1--70:10 pages.

Digital Library

[13]

Y. Hwang, J.-Y. Lee, I. S. Kweon, and S. J. Kim. 2014. Color Transfer Using Probabilistic Moving Least Squares. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 3342--3349.

Digital Library

[14]

M. Oliveira, A. D. Sappa, and V. Santos. 2011. Unsupervised Local Color Correction for Coarsely Registered Images. In Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR '11). IEEE Computer Society, Washington, DC, USA, 201--208.

Digital Library

[15]

T. Oskam, A. Hornung, R. W. Sumner, and M. Gross. 2012. Fast and Stable Color Balancing for Images and Augmented Reality. In 2012 Second International Conference on 3D Imaging, Modeling, Processing, Visualization Transmission. 49--56.

Digital Library

[16]

N. Papadakis, E. Provenzi, and V. Caselles. 2011. A Variational Model for Histogram Transfer of Color Images. Image Processing, IEEE Transactions on 20, 6 (June 2011), 1682--1695.

Digital Library

[17]

F. Pitié, A. C. Kokaram, and R. Dahyot. 2007. Automated Colour Grading Using Colour Distribution Transfer. Comput. Vis. Image Underst. 107, 1-2 (July 2007), 123--137.

Digital Library

[18]

E. Reinhard, M. Adhikhmin, B. Gooch, and P. Shirley. 2001. Color transfer between images. Computer Graphics and Applications, IEEE 21, 5 (Sep 2001), 34--41.

Digital Library

[19]

Yu-Wing Tai, Jiaya Jia, and Chi-Keung Tang. 2005. Local color transfer via probabilistic segmentation by expectation-maximization. In 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05), Vol. 1. 747--754 vol. 1.

Digital Library

[20]

Baoyuan Wang, Yizhou Yu, Tien-Tsin Wong, Chun Chen, and Ying-Qing Xu. 2010. Data-driven Image Color Theme Enhancement. ACM Trans. Graph. 29, 6, Article 146 (Dec. 2010), 10 pages.

Digital Library

[21]

R. Webster and M.A. Oliver. 2001. Geostatistics for Environmental Scientists. John Wiley and Sons.

[22]

Shuchang Xu, Yin Zhang, Sanyuan Zhang, and Xiuzi Ye. 2005. Uniform color transfer. In IEEE International Conference on Image Processing 2005, Vol. 3. III--940--3.

[23]

Q. Zhang, C. Xiao, H. Sun, and F. Tang. 2017. Palette-Based Image Recoloring Using Color Decomposition Optimization. IEEE Transactions on Image Processing 26, 4 (April 2017), 1952--1964.

Digital Library

Cited By

Grogan MDahyot R(2022) L 2 Divergence for robust colour transferComputer Vision and Image Understanding10.1016/j.cviu.2019.02.002181:C(39-49)Online publication date: 19-Apr-2022
https://dl.acm.org/doi/10.1016/j.cviu.2019.02.002
Alghamdi HDahyot R(2020)Iterative Nadaraya-Watson Distribution Transfer for Colour Grading2020 IEEE 22nd International Workshop on Multimedia Signal Processing (MMSP)10.1109/MMSP48831.2020.9287097(1-6)Online publication date: 21-Sep-2020
https://doi.org/10.1109/MMSP48831.2020.9287097
Thanh OCanham TVazquez-Corral JRodriguez RBertalmio M(2020)Color Stabilization for Multi-Camera Light-Field ImagingICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)10.1109/ICASSP40776.2020.9053088(2148-2152)Online publication date: May-2020
https://doi.org/10.1109/ICASSP40776.2020.9053088
Show More Cited By

Index Terms

User Interaction for Image Recolouring using £2
1. Computing methodologies
  1. Computer graphics
    1. Image manipulation
      1. Image processing

Recommendations

Naturalness preserving image recoloring method for people with redgreen deficiency

People with redgreen color vision deficiency may experience difficulties in discriminating colors. To enhance the visual details and improve their color perception, several recoloring methods have been considered. However, most of the recoloring methods ...
Image recoloring using linear template mapping

We propose an artistic recoloring method that enhances the perception of complex scenes, while preserving the visual quality of the original image. Our algorithm employs the template which contains the information of color theme. The colors of template ...
Palette-Based Image Recoloring Using Color Decomposition Optimization

Previous works on palette-based color manipulation typically fail to produce visually pleasing results with vivid color and natural appearance. In this paper, we present an approach to edit colors of an image by adjusting a compact color palette. ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

CVMP '17: Proceedings of the 14th European Conference on Visual Media Production (CVMP 2017)

December 2017

93 pages

ISBN:9781450353298

DOI:10.1145/3150165

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

In-Cooperation

The Foundry: The Foundry Visionmongers Ltd.
University of Bath: University of Bath

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 December 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

CVMP 2017

CVMP 2017: 14th European Conference on Visual Media Production

December 11 - 13, 2017

London, United Kingdom

Acceptance Rates

CVMP '17 Paper Acceptance Rate 10 of 16 submissions, 63%;

Overall Acceptance Rate 40 of 67 submissions, 60%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
139
Total Downloads

Downloads (Last 12 months)3
Downloads (Last 6 weeks)0

Reflects downloads up to 01 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Grogan MDahyot R(2022) L 2 Divergence for robust colour transferComputer Vision and Image Understanding10.1016/j.cviu.2019.02.002181:C(39-49)Online publication date: 19-Apr-2022
https://dl.acm.org/doi/10.1016/j.cviu.2019.02.002
Alghamdi HDahyot R(2020)Iterative Nadaraya-Watson Distribution Transfer for Colour Grading2020 IEEE 22nd International Workshop on Multimedia Signal Processing (MMSP)10.1109/MMSP48831.2020.9287097(1-6)Online publication date: 21-Sep-2020
https://doi.org/10.1109/MMSP48831.2020.9287097
Thanh OCanham TVazquez-Corral JRodriguez RBertalmio M(2020)Color Stabilization for Multi-Camera Light-Field ImagingICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)10.1109/ICASSP40776.2020.9053088(2148-2152)Online publication date: May-2020
https://doi.org/10.1109/ICASSP40776.2020.9053088
Barbero-Alvarez MMenendez JRodrigo J(2020)An Adaptive Colour Calibration for Crowdsourced Images in Heritage Preservation ScienceIEEE Access10.1109/ACCESS.2020.30173908(185093-185111)Online publication date: 2020
https://doi.org/10.1109/ACCESS.2020.3017390
Wu ZXue R(2020)Color Transfer With Salient Features Mapping via Attention Maps Between ImagesIEEE Access10.1109/ACCESS.2020.30000658(104884-104892)Online publication date: 2020
https://doi.org/10.1109/ACCESS.2020.3000065
Pitié F(2020)Advances in colour transferIET Computer Vision10.1049/iet-cvi.2019.092014:6(304-322)Online publication date: 25-Sep-2020
https://doi.org/10.1049/iet-cvi.2019.0920
Li ZTan ZCao LChen HJiao LZhong Y(2019)Directive local color transfer based on dynamic look-up tableImage Communication10.1016/j.image.2019.06.01079:C(1-12)Online publication date: 1-Nov-2019
https://dl.acm.org/doi/10.1016/j.image.2019.06.010
Dudek RCroci SSmolic AKnorr S(2019)Robust global and local color matching in stereoscopic omnidirectional contentImage Communication10.1016/j.image.2019.02.01374:C(231-241)Online publication date: 1-May-2019
https://dl.acm.org/doi/10.1016/j.image.2019.02.013

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten