research-article

RealPigment: paint compositing by example

Authors:

Stephen DiVerdi,

Connelly Barnes,

Adam FinkelsteinAuthors Info & Claims

NPAR '14: Proceedings of the Workshop on Non-Photorealistic Animation and Rendering

Pages 21 - 30

https://doi.org/10.1145/2630397.2630401

Published: 08 August 2014 Publication History

Abstract

The color of composited pigments in digital painting is generally computed one of two ways: either alpha blending in RGB, or the Kubelka-Munk equation (KM). The former fails to reproduce paint like appearances, while the latter is difficult to use. We present a data-driven pigment model that reproduces arbitrary compositing behavior by interpolating sparse samples in a high dimensional space. The input is an of a color chart, which provides the composition samples. We propose two different prediction algorithms, one doing simple interpolation using radial basis functions (RBF), and another that trains a parametric model based on the KM equation to compute novel values. We show that RBF is able to reproduce arbitrary compositing behaviors, even non-paint-like such as additive blending, while KM compositing is more robust to acquisition noise and can generalize results over a broader range of values.

References

[1]

Barber, C. B., Dobkin, D. P., and Huhdanpaa, H. 1996. The quickhull algorithm for convex hulls. ACM Trans. Math. Softw.

Digital Library

[2]

Baxter, W., Liu, Y., and Lin, M. C. 2004. A viscous paint model for interactive applications. Computer Animation and Virtual Worlds 15, 3--4, 433--441.

Digital Library

[3]

Baxter, W., Wendt, J., and Lin, M. C. 2004. IMPaSTo: a realistic, interactive model for paint. In Non-photorealistic animation and rendering, 45--148.

Digital Library

[4]

Berns, R. S., and De la Rie, E. R. 2003. The effect of the refractive index of a varnish on the appearance of oil paintings. Studies in Conservation 48, 4, 251--262.

[5]

Curtis, C. J., Anderson, S. E., Seims, J. E., Fleischer, K. W., and Salesin, D. H. 1997. Computer-generated watercolor. In SIGGRAPH.

Digital Library

[6]

Edström, P. 2007. Examination of the revised Kubelka-Munk theory: considerations of modeling strategies. Journal of the Optical Society of America A 24, 2, 548--556.

[7]

Edström, P. 2007. Mathematical Modeling and Numerical Tools for Simulation and Design of Light Scattering in Paper and Print. PhD thesis, Mid Sweden University.

[8]

Edström, P. 2008. Next generation simulation tools for optical properties in paper and print. In Modeling and Simulation in the Pulp and Paper Industry, 156--169.

[9]

Giovanelli, R. G. 1995. Reflection by semi-infinite diffusers. Optica Acta: International Journal of Optics 2, 4.

[10]

Glassner, A. S. 1994. Principles of Digital Image Synthesis. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA.

Digital Library

[11]

Gossett, N., and Chen, B. 2004. Paint inspired color mixing and compositing for visualization. In Information Visualization, 113--118.

Digital Library

[12]

Granberg, H., and Edström, P. 2003. Quantification of the intrinsic error of the Kubelka-Munk model caused by strong light absorption. Journal of Pulp and Paper Science 29, 11, 386--390.

[13]

Hecht, H. G. 1983. A comparison of the Kubelka-Munk, Rozenberg, and Pitts-Giovanelli methods of analysis of diffuse reflectance for several model systems. Applied Spectroscopy 37, 4, 315--403.

[14]

Kokla, V., Psarrou, A., and Konstantinou, V. 2006. Ink recognition based on statistical classification methods. In Document Image Analysis for Libraries, 254--264.

Digital Library

[15]

Kubelka, P., and Munk, F. 1931. An article on optics of paint layers. Z. Tech. Phys 12, 593--601.

[16]

Lu, J., 2014. RealPigment project page. http://gfx.cs.princeton.edu/pubs/Lu_2014_RPC/. {Online; accessed 4-June-2014}.

[17]

Mohammadi, M., and Berns, R. S. 2006. Testing instrumental-based color matching for artist acrylic paints. Tech. rep., Rochester Institute of Technology, College of Science, Munsell Color Science Laboratory.

[18]

Ohta, N., and Robertson, A. R. 2006. Chapter 3. CIE standard colorimetric system. In Colorimetry: Fundamentals and Applications. John Wiley & Sons, Ltd, Chichester, UK.

[19]

Okumura, Y. 2005. Developing a spectral and colorimetric database of artist paint materials. PhD thesis, Rochester Institute of Technology.

[20]

Powell, M. J. 1987. Radial basis functions for multivariable interpolation: a review. In Algorithms for approximation, 143--167.

Digital Library

[21]

Robertson, A. R. 1990. Historical development of CIE recommended color difference equations. Color Research & Application 15, 3, 167--170.

[22]

Rudolf, D., Mould, D., and Neufeld, E. 2005. A bidirectional deposition model of wax crayons. Computer Graphics Forum 24.

[23]

Sandoval, C., and Kim, A. D. 2014. Deriving Kubelka-Munk theory from radiative transport. Journal of the Optical Society of America A 31, 628--636.

[24]

Saunderson, J. L. 1942. Calculation of the color of pigmented plastics. Journal of the Optical Society of America 32, 727--736.

[25]

Shakespeare, T., and Shakespeare, J. 2003. A fluorescent extension to the KubelkaMunk model. Color Research & Application 28, 1, 4--14.

[26]

Shearer, J. M., and Wolfe, M. A. 1985. ALGLIB, a simple symbol-manipulation package. Commun. ACM.

Digital Library

[27]

Vargas, W. E., and Niklasson, G. A. 1997. Applicability conditions of the Kubelka-Munk theory. Applied Optics 36, 22, 5580--5586.

[28]

Wang, C.-M., and Wang, R.-J. 2007. Image-based color ink diffusion rendering. Visualization and Computer Graphics, IEEE Transactions on 13, 2, 235--246.

Digital Library

[29]

Westland, S., Iovine, L., and Bishop, J. M. 2002. Kubelka-Munk or neural networks for computer colorant formulation? In Congress of the International Colour Association, 745--748.

[30]

Wright, G. 2003. Radial basis function interpolation: numerical and analytical developments. PhD thesis, University of Colorado.

Digital Library

[31]

Xu, S., Tan, H., Jiao, X., Lau, F. C., and Pan, Y. 2007. A generic pigment model for digital painting. Computer Graphics Forum 26, 3.

[32]

Yang, L., and Kruse, B. 2004. Revised Kubelka-Munk theory. I. theory and application. Journal of the Optical Society of America A 21, 10, 1933--1941.

[33]

Yang, L., Kruse, B., and Miklavcic, S. J. 2004. Revised Kubelka-Munk theory. II. unified framework for homogeneous and inhomogeneous optical media. Journal of the Optical Society of America A 21, 10, 1942--1952.

Cited By

Karimov AKopets ELeonov SScalera LButusov D(2023)A Robot for Artistic Painting in Authentic ColorsJournal of Intelligent and Robotic Systems10.1007/s10846-023-01831-4107:3Online publication date: 4-Mar-2023
https://dl.acm.org/doi/10.1007/s10846-023-01831-4
Sochorová ŠJamriška O(2021)Practical pigment mixing for digital paintingACM Transactions on Graphics10.1145/3478513.348054940:6(1-11)Online publication date: 10-Dec-2021
https://dl.acm.org/doi/10.1145/3478513.3480549
Shugrina MZhang WChevalier FFidler SSingh KBrewster SFitzpatrick GCox AKostakos V(2019)Color BuilderProceedings of the 2019 CHI Conference on Human Factors in Computing Systems10.1145/3290605.3300686(1-12)Online publication date: 2-May-2019
https://dl.acm.org/doi/10.1145/3290605.3300686
Show More Cited By

Index Terms

RealPigment: paint compositing by example
1. Computing methodologies
  1. Computer graphics
    1. Graphics systems and interfaces

Recommendations

ACEScg: a common color encoding for visual effects applications
DigiPro '15: Proceedings of the 2015 Symposium on Digital Production

The Academy Color Encoding System 1.0 (ACES) was launched in December 2014 by the Academy of Motion Picture Arts and Sciences. The result of over 10 years of industry-driven development and testing, ACES provides a standardized color management ...
A retrospective on the adoption of the ACES technology at Framestore
DigiPro '16: Proceedings of the 2016 Symposium on Digital Production

This talk will give an overview of Framestore's VFX pipeline, focusing on the colour transformation steps; it will then cover the migration to using the Academy Color encoding System (ACES) over the last few years.

Showing how the changing state of ACES ...
ColorfulCurves: Palette-Aware Lightness Control and Color Editing via Sparse Optimization

Color editing in images often consists of two main tasks: changing hue and saturation, and editing lightness or tone curves. State-of-the-art palette-based recoloring approaches entangle these two tasks. A user's only lightness control is changing the ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

NPAR '14: Proceedings of the Workshop on Non-Photorealistic Animation and Rendering

August 2014

79 pages

ISBN:9781450330206

DOI:10.1145/2630397

General Chair:
David Mould
Carleton University

Copyright © 2014 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques
EUROGRAPHICS: The European Association for Computer Graphics

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 August 2014

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

Expressive '14

Sponsor:

SIGGRAPH
EUROGRAPHICS

Expressive '14: The joint symposium on Computational Aesthetics and Sketch Based Interfaces and Modeling and Non-Photorealistic Animation and Rendering

August 8 - 10, 2014

British Columbia, Vancouver, Canada

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

12
Total Citations
View Citations
318
Total Downloads

Downloads (Last 12 months)24
Downloads (Last 6 weeks)3

Reflects downloads up to 07 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Karimov AKopets ELeonov SScalera LButusov D(2023)A Robot for Artistic Painting in Authentic ColorsJournal of Intelligent and Robotic Systems10.1007/s10846-023-01831-4107:3Online publication date: 4-Mar-2023
https://dl.acm.org/doi/10.1007/s10846-023-01831-4
Sochorová ŠJamriška O(2021)Practical pigment mixing for digital paintingACM Transactions on Graphics10.1145/3478513.348054940:6(1-11)Online publication date: 10-Dec-2021
https://dl.acm.org/doi/10.1145/3478513.3480549
Shugrina MZhang WChevalier FFidler SSingh KBrewster SFitzpatrick GCox AKostakos V(2019)Color BuilderProceedings of the 2019 CHI Conference on Human Factors in Computing Systems10.1145/3290605.3300686(1-12)Online publication date: 2-May-2019
https://dl.acm.org/doi/10.1145/3290605.3300686
Tan JDiVerdi SLu JGingold Y(2019)Pigmento: Pigment-Based Image Analysis and EditingIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2018.285823825:9(2791-2803)Online publication date: 1-Sep-2019
https://doi.org/10.1109/TVCG.2018.2858238
Wu RChen ZWang ZYang JMarschner SWyvill BFu H(2018)Brush stroke synthesis with a generative adversarial network driven by physically based simulationProceedings of the Joint Symposium on Computational Aesthetics and Sketch-Based Interfaces and Modeling and Non-Photorealistic Animation and Rendering10.1145/3229147.3229150(1-10)Online publication date: 17-Aug-2018
https://dl.acm.org/doi/10.1145/3229147.3229150
Kim YKim BKim Y(2018)Dynamic Deep Octree for High‐resolution Volumetric Painting in Virtual RealityComputer Graphics Forum10.1111/cgf.1355837:7(179-190)Online publication date: 24-Oct-2018
https://doi.org/10.1111/cgf.13558
Zheng MMilliez AGross MSumner RWinnemoeller HBartram LGooch BGingold Y(2017)Example-based brushes for coherent stylized renderingsProceedings of the Symposium on Non-Photorealistic Animation and Rendering10.1145/3092919.3092929(1-10)Online publication date: 29-Jul-2017
https://dl.acm.org/doi/10.1145/3092919.3092929
Shugrina MLu JDiverdi S(2017)Playful paletteACM Transactions on Graphics10.1145/3072959.307369036:4(1-10)Online publication date: 20-Jul-2017
https://dl.acm.org/doi/10.1145/3072959.3073690
Tan JLien JGingold Y(2017)Decomposing Images into Layers via RGB-Space GeometryACM Transactions on Graphics10.1145/3072959.298822936:4(1)Online publication date: 16-Jul-2017
https://dl.acm.org/doi/10.1145/3072959.2988229
Tan JLien JGingold Y(2016)Decomposing Images into Layers via RGB-Space GeometryACM Transactions on Graphics10.1145/298822936:1(1-14)Online publication date: 15-Nov-2016
https://dl.acm.org/doi/10.1145/2988229
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten