research-article

RealBrush: painting with examples of physical media

Authors:

Connelly Barnes,

Stephen DiVerdi,

Adam FinkelsteinAuthors Info & Claims

ACM Transactions on Graphics (TOG), Volume 32, Issue 4

Article No.: 117, Pages 1 - 12

https://doi.org/10.1145/2461912.2461998

Published: 21 July 2013 Publication History

Abstract

Conventional digital painting systems rely on procedural rules and physical simulation to render paint strokes. We present an interactive, data-driven painting system that uses scanned images of real natural media to synthesize both new strokes and complex stroke interactions, obviating the need for physical simulation. First, users capture images of real media, including examples of isolated strokes, pairs of overlapping strokes, and smudged strokes. Online, the user inputs a new stroke path, and our system synthesizes its 2D texture appearance with optional smearing or smudging when strokes overlap. We demonstrate high-fidelity paintings that closely resemble the captured media style, and also quantitatively evaluate our synthesis quality via user studies.

Supplementary Material

ZIP File (a117-lu.zip)

Supplemental material.

Download
34.91 MB

MP4 File (tp040.mp4)

Download
22.68 MB

References

[1]

Ando, R., and Tsuruno, R. 2010. Segmental brush synthesis with stroke images. In Proceedings of Eurographics -- Short papers, 89--92.

[2]

Baxter, W., and Govindaraju, N. 2010. Simple data-driven modeling of brushes. In Proceedings of I3D, 135--142.

Digital Library

[3]

Baxter, W. V., Wendt, J., and Lin, M. C. 2004. IMPaSTo: A realistic, interactive model for paint. In Proceedings of NPAR, 45--56.

Digital Library

[4]

Chu, N., and Tai, C.-L. 2005. MoXi: Real-time ink dispersion in absorbent paper. In Proceedings of SIGGRAPH, 504--511.

Digital Library

[5]

Chu, N., Baxter, W., Wei, L.-Y., and Govindaraju, N. 2010. Detail-preserving paint modeling for 3d brushes. In Proceedings of NPAR, 27--34.

Digital Library

[6]

Darabi, S., Shechtman, E., Barnes, C., Goldman, D., and Sen, P. 2012. Image melding: combining inconsistent images using patch-based synthesis. ACM Transactions on Graphics 31, 4, 82:1--82:10.

Digital Library

[7]

DiVerdi, S., Krishnaswamy, A., and Hadap, S. 2010. Industrial-strength painting with a virtual bristle brush. In Proceedings of Virtual Reality Science and Technology, 119--126.

Digital Library

[8]

DiVerdi, S., Krishnaswamy, A., Měch, R., and Ito, D. 2012. A lightweight, procedural, vector watercolor painting engine. In Proceedings of I3D, 63--70.

Digital Library

[9]

Hjelle, Ø. 2001. Approximation of scattered data with multilevel b-splines. Tech. rep., SINTEF.

[10]

Hsu, S. C., and Lee, I. H. H. 1994. Drawing and animation using skeletal strokes. In Proceedings of SIGGRAPH, 109--118.

Digital Library

[11]

Kim, M., and Shin, H. J. 2010. An example-based approach to synthesize artistic strokes using graphs. Computer Graphics Forum 29, 7, 2145--2152.

[12]

Kwatra, V., Schodl, A., Essa, I., Turk, G., and Bobick, A. 2003. Graphcut textures: Image and video synthesis using graph cuts. ACM Transactions on Graphics 22, 3, 277--286.

Digital Library

[13]

Lu, J., Yu, F., Finkelstein, A., and DiVerdi, S. 2012. Helpinghand: Example-based stroke stylization. In Proceedings of SIGGRAPH, 46:1--46:10.

Digital Library

[14]

Pitié, F., Kokaram, A., and Dahyot, R. 2007. Automated colour grading using colour distribution transfer. Computer Vision and Image Understanding 107, 1, 123--137.

Digital Library

[15]

Ritter, L., Li, W., Curless, B., Agrawala, M., and Salesin, D. 2006. Painting with texture. In Proceedings of the Eurographics conference on Rendering Techniques, 371--376.

Digital Library

[16]

Schretter, C. 2005. A brush tool for interactive texture synthesis. ICGST International Journal on Graphics, Vision and Image Processing 6, 5, 55--60.

[17]

Van Haevre, W., Van Laerhoven, T., Di Fiore, F., and Van Reeth, F. 2007. From dust till drawn: A real-time bidirectional pastel simulation. The Visual Computer, 925--934.

Digital Library

[18]

Wang, B., Wang, W., Yang, H., and Sun, J. 2004. Efficient example-based painting and synthesis of 2D directional texture. IEEE Trans. Visualization and Computer Graphics, 3, 266--277.

Digital Library

[19]

Xie, N., Laga, H., Saito, S., and Nakajima, M. 2011. Contour-driven sumi-e rendering of real photos. Computers & Graphics 35, 1, 122--134.

Digital Library

[20]

Xie, N., Hachiya, H., and Sugiyama, M. 2012. Artist agent: A reinforcement learning approach to automatic stroke generation in oriental ink painting. In Proceedings of the International Conference on Machine Learning, 153--160.

[21]

Xu, M., and Dong, J. 2006. Generating new styles of chinese stroke based on statistical model. In Proc. International Multiconference on Computer Science and I. T., 215--222.

[22]

Xu, S., Tang, M., Lau, F. C. M., and Pan, Y. 2004. Virtual hairy brush for painterly rendering. Graphical Models 66, 5.

Digital Library

[23]

Xu, S., Xu, Y., Kang, S. B., Salesin, D. H., Pan, Y., and Shum, H.-Y. 2006. Animating chinese paintings through stroke-based decomposition. ACM Transactions on Graphics 25, 2, 239--267.

Digital Library

[24]

Xu, S., Tan, H., Jiao, X., Lau, F., and Pan, Y. 2007. A generic pigment model for digital painting. Computer Graphics Forum 26, 609--618.

[25]

Yan, C.-R., Chi, M.-T., Lee, T.-Y., and Lin, W.-C. 2008. Stylized rendering using samples of a painted image. IEEE Trans. Visualization and Computer Graphics 14, 2, 468--480.

Digital Library

[26]

Zeng, K., Zhao, M., Xiong, C., and Zhu, S.-C. 2009. From image parsing to painterly rendering. ACM Transactions on Graphics 29, 1.

Digital Library

[27]

Zhou, S., Lasram, A., and Lefebvre, S. 2013. By-example synthesis of curvilinear structured patterns. Computer Graphics Forum 32, 2.

Cited By

Liu Y(2025)Real-time generation of digital Chinese calligraphy based on geometric continuitySixteenth International Conference on Graphics and Image Processing (ICGIP 2024)10.1117/12.3057691(15)Online publication date: 13-Feb-2025
https://doi.org/10.1117/12.3057691
Jiang YXu PZhang CFu HLau HWang W(2025)Region-Aware Color SmudgingIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.337421031:4(1999-2011)Online publication date: Apr-2025
https://doi.org/10.1109/TVCG.2024.3374210
Zhang ZLu SGuo QGao NYang Y(2025)CaVIT: An integrated method for image style transfer using parallel CNN and vision transformerApplied Intelligence10.1007/s10489-024-06114-555:5Online publication date: 13-Jan-2025
https://dl.acm.org/doi/10.1007/s10489-024-06114-5
Show More Cited By

Index Terms

RealBrush: painting with examples of physical media
1. Computing methodologies
  1. Computer graphics
    1. Graphics systems and interfaces

Recommendations

HelpingHand: example-based stroke stylization

Digital painters commonly use a tablet and stylus to drive software like Adobe Photoshop. A high quality stylus with 6 degrees of freedom (DOFs: 2D position, pressure, 2D tilt, and 1D rotation) coupled to a virtual brush simulation engine allows skilled ...
Stroke-Based Few-Shot Chinese Character Style Transfer
Advanced Intelligent Computing Technology and Applications
Abstract
Few-shot Chinese character style transfer aims to learn the style of Chinese characters with limited references and then generate a complete set of Chinese character fonts. This not only solves the repetitive and cumbersome manual effort in ...
DecoBrush: drawing structured decorative patterns by example

Structured decorative patterns are common ornamentations in a variety of media like books, web pages, greeting cards and interior design. Creating such art from scratch using conventional software is time consuming for experts and daunting for novices. ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics

ACM Transactions on Graphics Volume 32, Issue 4

July 2013

1215 pages

ISSN:0730-0301

EISSN:1557-7368

DOI:10.1145/2461912

Issue’s Table of Contents

Copyright © 2013 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 July 2013

Published in TOG Volume 32, Issue 4

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Adobe Systems

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

82
Total Citations
View Citations
1,194
Total Downloads

Downloads (Last 12 months)55
Downloads (Last 6 weeks)3

Reflects downloads up to 07 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Liu Y(2025)Real-time generation of digital Chinese calligraphy based on geometric continuitySixteenth International Conference on Graphics and Image Processing (ICGIP 2024)10.1117/12.3057691(15)Online publication date: 13-Feb-2025
https://doi.org/10.1117/12.3057691
Jiang YXu PZhang CFu HLau HWang W(2025)Region-Aware Color SmudgingIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.337421031:4(1999-2011)Online publication date: Apr-2025
https://doi.org/10.1109/TVCG.2024.3374210
Zhang ZLu SGuo QGao NYang Y(2025)CaVIT: An integrated method for image style transfer using parallel CNN and vision transformerApplied Intelligence10.1007/s10489-024-06114-555:5Online publication date: 13-Jan-2025
https://dl.acm.org/doi/10.1007/s10489-024-06114-5
Hu ADesai NAbu Alhaija HKim SShugrina M(2024)Diffusion Texture PaintingACM SIGGRAPH 2024 Conference Papers10.1145/3641519.3657458(1-12)Online publication date: 13-Jul-2024
https://dl.acm.org/doi/10.1145/3641519.3657458
Li HWang LLiu J(2024)A review of deep learning-based image style transfer researchThe Imaging Science Journal10.1080/13682199.2024.2418216(1-23)Online publication date: 23-Oct-2024
https://doi.org/10.1080/13682199.2024.2418216
Karimov AKopets EShpilevaya TKatser ELeonov SButusov D(2023)Comparing Neural Style Transfer and Gradient-Based Algorithms in Brushstroke Rendering TasksMathematics10.3390/math1110225511:10(2255)Online publication date: 11-May-2023
https://doi.org/10.3390/math11102255
Madono KSimo‐Serra E(2023)Data‐Driven Ink Painting Brushstroke RenderingComputer Graphics Forum10.1111/cgf.1496542:7Online publication date: 30-Oct-2023
https://doi.org/10.1111/cgf.14965
Karimov AKopets ELeonov SScalera LButusov D(2023)A Robot for Artistic Painting in Authentic ColorsJournal of Intelligent and Robotic Systems10.1007/s10846-023-01831-4107:3Online publication date: 4-Mar-2023
https://dl.acm.org/doi/10.1007/s10846-023-01831-4
Sharafutdinov DGriguletskii MKopanev PKurenkov MFerrer GBurkov AGonnochenko ATsetserukou D(2023)Comparison of modern open-source Visual SLAM approachesJournal of Intelligent and Robotic Systems10.1007/s10846-023-01812-7107:3Online publication date: 18-Mar-2023
https://dl.acm.org/doi/10.1007/s10846-023-01812-7
Lee TKim BSeo SYoon K(2022)Stroke Based Painterly Rendering with Mass Data through Auto Warping GenerationComputer Modeling in Engineering & Sciences10.32604/cmes.2022.018010130:3(1441-1457)Online publication date: 2022
https://doi.org/10.32604/cmes.2022.018010
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Issue’s Table of Contents