skip to main content
research-article

Augmented Airbrush for Computer Aided Painting (CAP)

Published: 02 March 2015 Publication History

Abstract

We present an augmented airbrush that allows novices to experience the art of spray painting. Inspired by the thriving field of smart tools, our handheld device uses 6DOF tracking, augmentation of the airbrush trigger, and a specialized algorithm to restrict the application of paint to a preselected reference image. Our device acts both as a physical spraying device and as an intelligent assistive tool, providing simultaneous manual and computerized control. Unlike prior art, here the virtual simulation guides the physical rendering (inverse rendering), allowing for a new spray painting experience with singular physical results. We present our novel hardware design, control software, and a user study that verifies our research objectives.

References

[1]
W. V. Baxter, J. Wendt, and M. C. Lin. 2004. IMPaSTo: A realistic, interactive model for paint. In Proceedings of the International Symposium on Non-Photorealistic Animation and Rendering (NPAR'04). S. N. Spencer, Ed., ACM Press, New York, 45--56.
[2]
I. Berger, A. Shamir, M. Mahler, E. Carter, and J. Hodgins. 2013. Style and abstraction in portrait sketching. ACM Trans. Graph. 32, 4, 55:1--55:12.
[3]
N. S.-H. Chu and C.-L. Tai. 2005. MoXi: Real-time ink dispersion in absorbent paper. In Proceedings of the 32nd International Conference on Computer Graphics and Interactive Techniques (SIGGRAPH'05). ACM Press, New York, 504--511.
[4]
C. J. Curtis, S. E. Anderson, J. E. Seims, K. W. Fleischer, and D. H. Salesin. 1997. Computer-generated watercolor. In Proceedings of the 24th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH'97). 421--430.
[5]
O. Deussen, T. Lindemeier, S. Pirk, and M. Tautzenberger. 2012. Feedback-guided stroke placement for a painting machine. In Proceedings of the 8th Annual Symposium on Computational Aesthetics in Graphics, Visualization, and Imaging (CAe'12). Eurographics Association, 25--33.
[6]
M. Eitz, J. Hays, and M. Alexa. 2012. How do humans sketch objects? ACM Trans. Graph. 31, 4, 44:1--44:10.
[7]
J. Fernquist, T. Grossman, and G. Fitzmaurice. 2011. Sketchsketch revolution: An engaging tutorial system for guided sketching and application learning. In Proceedings of the Annual ACM Symposium on User Interface Software and Technology (UIST'11). ACM Press, New York, 373--382.
[8]
M. Flagg and J. M. Rehg. 2006. Projector-guided painting. In Proceedings of the Annual ACM Symposium on User Interface Software and Technology (UIST'06). ACM Press, New York, 235--244.
[9]
C. S. Haase and G. W. Meyer. 1992. Modeling pigmented materials for realistic image synthesis. ACM Trans. Graph. 11, 4, 305--335.
[10]
A. Hertzmann, C. E. Jacobs, N. Oliver, B. Curless, and D. H. Salesin. 2001. Image analogies. In Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH'01). ACM Press, New York, 327--340.
[11]
E. Iarussi, A. Bousseau, and T. Tsandilas. 2013. The drawing assistant: Automated drawing guidance and feedback from photographs. In Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology (UIST'13). ACM Press, New York, 183--192.
[12]
D. Kim, Y. Yoon, S. Hwang, G. Lee, and J. Park. 2007. Visualizing spray paint deposition in VR training. In Proceedings of the IEEE Virtual Reality Conference (VR'07). 307--308.
[13]
J. Konieczny and G. Meyer. 2009. Airbrush simulation for artwork and computer modeling. In Proceedings of the 7th International Symposium on Non-Photorealistic Animation and Rendering (NPAR'09). ACM Press, New York, 61--69.
[14]
J. Laviole and M. Hachet. 2012. PapARt: Interactive 3D graphics and multi-touch augmented paper for artistic creation. In Proceedings of the IEEE Symposium on 3D User Interfaces (3DUI'12). 3--6.
[15]
Y. J. Lee, C. L. Zitnick, and M. F. Cohen. 2011. ShadowDraw: Real-time user guidance for freehand drawing. ACM Trans. Graph. 30, 4, 27:1--27:10.
[16]
R. Levinson, P. Berdahl, and H. Akbari. 2014. Lawrence Berkeley National Laboratory pigment database. http://coolcolors.lbl.gov/LBNL-Pigment-Database/database.html.
[17]
A. Limpaecher, N. Feltman, A. Treuille, and M. Cohen. 2013. Real-time drawing assistance through crowdsourcing. ACM Trans. Graph. 32, 4, 54:1--54:8.
[18]
J. Lu, C. Barnes, S. Diverdi, and A. Finkelstein. 2013. RealBrush: Painting with examples of physical media. ACM Trans. Graph. 32, 4, 117:1--117:12.
[19]
J. Lu, F. Yu, A. Finkelstein, and S. Diverdi. 2012. HelpingHand: Example-based stroke stylization. ACM Trans. Graph. 31, 4, 46:1--46:10.
[20]
J. Luk. 2004. Computer-controlled airbrush with motion tracking. Tech. rep., University of British Colombia, Vancouver, B.C. https://courses.ece. ubc.ca/518/previous/hit2004/papers/Luk.pdf.
[21]
A. Rivers, A. Adams, and F. Durand. 2012. Sculpting by numbers. ACM Trans. Graph. 31, 6, 157:1--157:7.
[22]
C. Skeels and J. M. Rehg. 2007. ShapeShift: A projector-guided sculpture system. In Proceedings of the Annual ACM Symposium on User Interface Software and Technology (UIST'07).
[23]
S. Strassmann. 1986. Hairy brushes. In Proceedings of the 13th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH'86). ACM Press, New York, 225--232.
[24]
Toy Story Wallpapers. 2014. http://www.toystorywallpapers.com/wp-content/uploads/wallpapers/woody_headshot_toy_story_3_wallpaper_-_1600x1200.jpg.
[25]
S. Xu, M. Tang, F. Lau, and Y. Pan. 2002. A solid model based virtual hairy brush. Comput. Graph. Forum 21, 299--308.
[26]
J. Yamaoka and Y. Kakehi. 2013. dePEDd: Augmented handwriting system using ferromagnetism of a ballpoint pen. In Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology (UIST'13). ACM Press, New York, 203--210.
[27]
U. Yang, G. Lee, S. Shin, S. Hwang, and W. Son. 2007. Virtual reality based paint spray training system. In Proceedings of the IEEE Virtual Reality Conference (VR'07). 289--290.
[28]
Yoda's Datapad. 2014. http://www.yodasdatapad.com/livingroom/fanworks/art/landon/yoda.html.
[29]
C. L. Zitnick. 2013. Handwriting beautification using token means. ACM Trans. Graph. 32, 4, 53:1--53:8.
[30]
A. Zoran and J. A. Paradiso. 2013. Freed: A freehand digital sculpting tool. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI'13). ACM Press, New York, 2613--2616.
[31]
A. Zoran, R. Shilkrot, P. Goyal, P. Maes, and J. Paradiso. 2014. The wise chisel: The rise of the smart handheld tool. IEEE Pervas. Comput. 13, 3, 48--57.

Cited By

View all
  • (2024)A theoretical framework on embodiment in digital designJournal of Design for Resilience in Architecture and Planning10.47818/DRArch.2024.v5si1525:(Special Issue)(90-100)Online publication date: 31-Dec-2024
  • (2024)Synthesis, Properties, and Environmental Impact of Hybrid PigmentsThe Scientific World Journal10.1155/tswj/27739502024:1Online publication date: 19-Nov-2024
  • (2024)Millipath: Bridging Materialist Theory and System Development for Surface Texture FabricationProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661599(50-68)Online publication date: 1-Jul-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics
ACM Transactions on Graphics  Volume 34, Issue 2
February 2015
136 pages
ISSN:0730-0301
EISSN:1557-7368
DOI:10.1145/2742222
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 March 2015
Accepted: 01 October 2014
Revised: 01 September 2014
Received: 01 April 2014
Published in TOG Volume 34, Issue 2

Permissions

Request permissions for this article.

Check for updates

Author Tag

  1. Computer aided painting (CAP)

Qualifiers

  • Research-article
  • Research
  • Refereed

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)46
  • Downloads (Last 6 weeks)2
Reflects downloads up to 20 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)A theoretical framework on embodiment in digital designJournal of Design for Resilience in Architecture and Planning10.47818/DRArch.2024.v5si1525:(Special Issue)(90-100)Online publication date: 31-Dec-2024
  • (2024)Synthesis, Properties, and Environmental Impact of Hybrid PigmentsThe Scientific World Journal10.1155/tswj/27739502024:1Online publication date: 19-Nov-2024
  • (2024)Millipath: Bridging Materialist Theory and System Development for Surface Texture FabricationProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661599(50-68)Online publication date: 1-Jul-2024
  • (2024)Shape Cast: Automating 3D Design for Plaster Molds in Ceramic Slip CastingExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3651020(1-7)Online publication date: 11-May-2024
  • (2024)An Accessible, Three-Axis Plotter for Enhancing Calligraphy Learning through Generated MotionProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642792(1-11)Online publication date: 11-May-2024
  • (2024)WeaveSlicer: Expanding the Range of Printable Geometries in ClayProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642622(1-16)Online publication date: 11-May-2024
  • (2024)Basic study for 2-dimensional film thickness measurement of self-indication marine paint using a visible-light cameraJournal of Marine Science and Technology10.1007/s00773-024-01037-9Online publication date: 16-Dec-2024
  • (2023)Design and Verification of Adaptive Adjustable Output Control on Micro Spray GunMachines10.3390/machines1103035411:3(354)Online publication date: 4-Mar-2023
  • (2023)Fine Motor SkillsProceedings of the ACM on Computer Graphics and Interactive Techniques10.1145/35976276:2(1-9)Online publication date: 16-Aug-2023
  • (2023)An Adaptable Workflow for Manual-Computational Ceramic Surface OrnamentationProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586183.3606726(1-15)Online publication date: 29-Oct-2023
  • Show More Cited By

View Options

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media