skip to main content
10.1145/2501988.2501997acmconferencesArticle/Chapter ViewAbstractPublication PagesuistConference Proceedingsconference-collections
research-article

The drawing assistant: automated drawing guidance and feedback from photographs

Published:08 October 2013Publication History

ABSTRACT

We present an interactive drawing tool that provides automated guidance over model photographs to help people practice traditional drawing-by-observation techniques. The drawing literature describes a number of techniques to %support this task and help people gain consciousness of the shapes in a scene and their relationships. We compile these techniques and derive a set of construction lines that we automatically extract from a model photograph. We then display these lines over the model to guide its manual reproduction by the user on the drawing canvas. Finally, we use shape-matching to register the user's sketch with the model guides. We use this registration to provide corrective feedback to the user. Our user studies show that automatically extracted construction lines can help users draw more accurately. Furthermore, users report that guidance and corrective feedback help them better understand how to draw.

Skip Supplemental Material Section

Supplemental Material

uist142.mp4

mp4

8.7 MB

References

  1. Arbelaez, P., Maire, M., Fowlkes, C., and Malik, J. Contour detection and hierarchical image segmentation. IEEE Trans. on Pattern Analysis and Machine Intelligence, 99 (2011), 1--1. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Bae, S.-H., Balakrishnan, R., and Singh, K. EverybodyLovesSketch: 3d sketching for a broader audience. In ACM Symp. on User Interface Software and Technology (UIST) (2009), 59--68. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Belongie, S., Malik, J., and Puzicha, J. Shape matching and object recognition using shape contexts. IEEE Trans. Pattern Analysis and Machine Intelligence 24, 4 (2002), 509--522. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Blum, H., et al. A transformation for extracting new descriptors of shape. Models for the perception of speech and visual form 19, 5 (1967), 362--380.Google ScholarGoogle Scholar
  5. Bradley, B. Drawing people: how to portray the clothed figure. North Light Books, 2003.Google ScholarGoogle Scholar
  6. Chi, P.-Y., Ahn, S., Ren, A., Dontcheva, M., Li, W., and Hartmann, B. Mixt: automatic generation of step-by-step mixed media tutorials. In ACM Symp. on User Interface Software and Technology (UIST) (2012). Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Cummmings, D., Vides, F., and Hammond, T. I don't believe my eyes!: geometric sketch recognition for a computer art tutorial. In Proc. International Symposium on Sketch-Based Interfaces and Modeling (2012), 97--106. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Denning, J. D., Kerr, W. B., and Pellacini, F. Meshflow: interactive visualization of mesh construction sequences. ACM Trans. on Graphics (Proc. SIGGRAPH) 30, 4 (2011). Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Dixon, D., Prasad, M., and Hammond, T. iCanDraw: Using sketch recognition and corrective feedback to assist a user in drawing human faces. In Proc. of the International Conference on Human Factors in Computing Systems (CHI) , ACM (2010). Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Dodson, B. Keys to drawing. North Light Books, 1985.Google ScholarGoogle Scholar
  11. Douglas, D. H., and Peucker, T. K. Algorithms for the reduction of the number of points required to represent a digitized line or its caricature. Cartographica: The International Journal for Geographic Information and Geovisualization 10, 2 (Oct. 1973), 112--122.Google ScholarGoogle ScholarCross RefCross Ref
  12. Edwards, B. Drawing on the right side of the brain . Tarcher, 1979.Google ScholarGoogle Scholar
  13. Eitz, M., Hays, J., and Alexa, M. How do humans sketch objects? ACM Trans. on Graphics (Proc. SIGGRAPH) 31, 4 (2012), 44. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Fernquist, J., Grossman, T., and Fitzmaurice, G. Sketch-sketch revolution: an engaging tutorial system for guided sketching and application learning. In ACM Symp. on User Interface Software and Technology (UIST) (2011), 373--382. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Flagg, M., and Rehg, J. Projector-guided painting. In ACM Symp. on User Interface Software and Technology (UIST) (2006), 235--244. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Grabler, F., Agrawala, M., Li, W., Dontcheva, M., and Igarashi, T. Generating photo manipulation tutorials by demonstration. ACM Trans. on Graphics (Proc. SIGGRAPH) 28, 3 (2009), 66:1--66:9. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Hoddinott, B. Drawspace, http://www.drawspace.com/.Google ScholarGoogle Scholar
  18. Hoddinott, B., and Combs, J. Drawing for dummies. 2011.Google ScholarGoogle Scholar
  19. Kohr., M. Ctrl+paint, http://www.ctrlpaint.com/.Google ScholarGoogle Scholar
  20. Laviole, J., and Hachet, M. Papart: interactive 3d graphics and multi-touch augmented paper for artistic creaton. In 3DUI - IEEE Virtual Reality Conference (2012).Google ScholarGoogle Scholar
  21. Lee, Y., Zitnick, C., and Cohen, M. Shadowdraw: real-time user guidance for freehand drawing. ACM Trans. on Graphics (Proc. SIGGRAPH) 30, 4 (2011), 27. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Limpaecher, A., Feltman, N., and Cohen, M. Real-time drawing assistance through crowdsourcing. ACM Trans. on Graphics (Proc. SIGGRAPH) (2013). Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Martin, D., Fowlkes, C., Tal, D., and Malik, J. A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics. In IEEE International Conference on Computer Vision (2001), 416--423.Google ScholarGoogle ScholarCross RefCross Ref
  24. Nicolaides, K. The Natural Way to Draw: A Working Plan for Art Study. Houghton Mifflin Co., 1969.Google ScholarGoogle Scholar
  25. Rivers, A., Adams, A., and Durand, F. Sculpting by numbers. ACM Trans. on Graphics (Proc. SIGGRAPH Asia) 31, 6 (2012). Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Rother, C., Kolmogorov, V., and Blake, A. "grabcut": interactive foreground extraction using iterated graph cuts. ACM Trans. on Graphics (Proc. SIGGRAPH) 23, 3 (2004). Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Schmidt, R., Khan, A., Singh, K., and Kurtenbach, G. Analytic drawing of 3d scaffolds. ACM Trans. on Graphics (Proc. SIGGRAPH Asia) 28, 5 (2009). Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Shi, J., and Tomasi, C. Good features to track. In IEEE Conference on Computer Vision and Pattern Recognition (1994).Google ScholarGoogle Scholar
  29. Soga, M., Kuriyama, S., and Taki, H. Sketch learning environment with diagnosis and drawing guidance from rough form to detailed contour form. T. Edutainment 3 (2009), 129--140. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. The drawing assistant: automated drawing guidance and feedback from photographs

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Conferences
        UIST '13: Proceedings of the 26th annual ACM symposium on User interface software and technology
        October 2013
        558 pages
        ISBN:9781450322683
        DOI:10.1145/2501988

        Copyright © 2013 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 8 October 2013

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article

        Acceptance Rates

        UIST '13 Paper Acceptance Rate62of317submissions,20%Overall Acceptance Rate842of3,967submissions,21%

        Upcoming Conference

        UIST '24

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader