skip to main content
article

Colorization using optimization

Published: 01 August 2004 Publication History

Abstract

Colorization is a computer-assisted process of adding color to a monochrome image or movie. The process typically involves segmenting images into regions and tracking these regions across image sequences. Neither of these tasks can be performed reliably in practice; consequently, colorization requires considerable user intervention and remains a tedious, time-consuming, and expensive task.In this paper we present a simple colorization method that requires neither precise image segmentation, nor accurate region tracking. Our method is based on a simple premise; neighboring pixels in space-time that have similar intensities should have similar colors. We formalize this premise using a quadratic cost function and obtain an optimization problem that can be solved efficiently using standard techniques. In our approach an artist only needs to annotate the image with a few color scribbles, and the indicated colors are automatically propagated in both space and time to produce a fully colorized image or sequence. We demonstrate that high quality colorizations of stills and movie clips may be obtained from a relatively modest amount of user input.

References

[1]
BURNS, G. Colorization. Museum of Broadcast Communications: Encyclopedia of Television, http://www.museum.tv/archives/etv/index.html.
[2]
COOPER, R. 1991. Colorization and moral rights: Should the United States adopt unified protection for artists? Journalism Quarterly (Urbana, Illinois), Autumn.
[3]
JACK, K. 2001. Video Demystified, 3rd edition ed. Elsevier Science & Technology.
[4]
LUCAS, B., AND KANADE, T. 1981. An iterative image registration technique with an application to stereo vision. In Proc. Int. Joint Conf. AI 674--679.
[5]
MARKLE, W., AND HUNT, B., 1987. Coloring a black and white signal using motion detection. Canadian patent no. 1291260, Dec.
[6]
NEURALTEK, 2003. BlackMagic photo colorization software, version 2.8 http://www.timebrush.com/blackmagic.
[7]
PERONA, P., AND MALIK, J. 1989. Scale-space and edge detection using anisotropic diffusion. IEEE Transactions on PAMI 8, 5, 565--593.
[8]
PRESS, W., TEUKOLSKY, S., VETTERLING, W., AND FLANNERY, B. 1992. Numerical Recipes in C: The art of scientific computing. Cambridge University Press.
[9]
SHI, J., AND MALIK, J. 1997. Normalized cuts and image segmentation. In Proc. IEEE Conf. Computer Vision and Pattern Recognition, 731--737.
[10]
SILBERG, J., 1998. The Pleasantville post production team that focussed on the absence of color. Cinesite Press Article, http://www.cinesite.com/core/press/articles/1998/10_00_98-team.html.
[11]
TANG, B., SAPIRO, G., AND CASSELES, V. 2001. Color image enhancement via chromaticity diffusion. IEEE Transactions on Image Processing 10, 5, 701--708.
[12]
TORRALBA, A., AND FREEMAN, W. T. 2003. Properties and applications of shape recipes. In IEEE Computer Vision and Pattern Recognition (CVPR).
[13]
WEISS, Y. 1999. Segmentation using eigenvectors: A unifying view. In Proceedings ICCV, 975--982.
[14]
WELSH, T., ASHIKHMIN, M., AND MUELLER, K. 2002. Transferring color to greyscale images. ACM Transactions on Graphics 21, 3 (July), 277--280.
[15]
ZOMET, A., AND PELEG, S. 2002. Multi-sensor super resolution. In Proceedings of the IEEE Workshop on Applications of Computer Vision.

Cited By

View all

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics
ACM Transactions on Graphics  Volume 23, Issue 3
August 2004
684 pages
ISSN:0730-0301
EISSN:1557-7368
DOI:10.1145/1015706
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 August 2004
Published in TOG Volume 23, Issue 3

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. colorization
  2. recoloring
  3. segmentation

Qualifiers

  • Article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)163
  • Downloads (Last 6 weeks)23
Reflects downloads up to 17 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2025)Image colorization: A survey and datasetInformation Fusion10.1016/j.inffus.2024.102720114(102720)Online publication date: Feb-2025
  • (2024)Transforming Color: A Novel Image Colorization MethodElectronics10.3390/electronics1313251113:13(2511)Online publication date: 26-Jun-2024
  • (2024)Video Colorization Based on Variational AutoencoderElectronics10.3390/electronics1312241213:12(2412)Online publication date: 20-Jun-2024
  • (2024)HyperColorization: propagating spatially sparse noisy spectral clues for reconstructing hyperspectral imagesOptics Express10.1364/OE.50801732:7(10761)Online publication date: 11-Mar-2024
  • (2024)Efficient Real-Time Video Colorization on Low-End CPUs via Pruning and QuantizationProceedings of the 11th International Conference on Networking, Systems, and Security10.1145/3704522.3704536(146-153)Online publication date: 19-Dec-2024
  • (2024)Winding Number Features for Vector Sketch ColorizationComputer Graphics Forum10.1111/cgf.1514143:5Online publication date: 31-Jul-2024
  • (2024)Building Coarse to Fine Convex Hulls With Auxiliary Vertices for Palette-Based Image RecoloringIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.329638630:8(5581-5595)Online publication date: 1-Aug-2024
  • (2024)BiSTNet: Semantic Image Prior Guided Bidirectional Temporal Feature Fusion for Deep Exemplar-Based Video ColorizationIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2024.337092046:8(5612-5624)Online publication date: 1-Aug-2024
  • (2024)Evaluation of 3D CG Image Colorization Quality Using Visible Digital Watermarking after Noise Removal Based on Sparse Dictionary Learning2024 International Technical Conference on Circuits/Systems, Computers, and Communications (ITC-CSCC)10.1109/ITC-CSCC62988.2024.10628206(1-6)Online publication date: 2-Jul-2024
  • (2024)Retinex-based enhancement of fundus images2024 IEEE 6th Advanced Information Management, Communicates, Electronic and Automation Control Conference (IMCEC)10.1109/IMCEC59810.2024.10575370(966-971)Online publication date: 24-May-2024
  • Show More Cited By

View Options

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media