skip to main content
research-article

Style and abstraction in portrait sketching

Published: 21 July 2013 Publication History

Abstract

We use a data-driven approach to study both style and abstraction in sketching of a human face. We gather and analyze data from a number of artists as they sketch a human face from a reference photograph. To achieve different levels of abstraction in the sketches, decreasing time limits were imposed -- from four and a half minutes to fifteen seconds. We analyzed the data at two levels: strokes and geometric shape. In each, we create a model that captures both the style of the different artists and the process of abstraction. These models are then used for a portrait sketch synthesis application. Starting from a novel face photograph, we can synthesize a sketch in the various artistic styles and in different levels of abstraction.

Supplementary Material

ZIP File (a55-berger.zip)
Supplemental material.

References

[1]
Belongie, S., Malik, J., and Puzicha, J. 2002. Shape matching and object recognition using shape contexts. IEEE Transactions on Pattern Analysis and Machine Intelligence 24, 4, 509--522.
[2]
Chang, I.-C., and Cheng, R.-M. 2011. Caricaturation for human face pictures. In International Conference on Machine Learning and Cybernetics, 1702--1707.
[3]
Chen, H., Zheng, N., Liang, L., Li, Y., Xu, Y., and Shum, H. 2002. Pictoon: a personalized image-based cartoon system. In Proceedings of the Tenth ACM International Conference on Multimedia, 171--178.
[4]
Chen, H., Liu, Z., Rose, C., Xu, Y., Shum, H., and Salesin, D. 2004. Example-based composite sketching of human portraits. In Proceedings of the 3rd International Symposium on Non-photorealistic Animation and Rendering, NPAR '04, ACM, 95--153.
[5]
Chiang, P., Liao, W., and Li, T. 2004. Automatic caricature generation by analyzing facial features. In Proceedings of the 2004 Asia Conference on Computer Vision.
[6]
Cole, F., Golovinskiy, A., Limpaecher, A., Barros, H. S., Finkelstein, A., Funkhouser, T., and Rusinkiewicz, S. 2008. Where do people draw lines? ACM Transactions on Graphics (Proc. SIGGRAPH) 27, 3 (Aug.).
[7]
Colton, S. 2010. Stroke matching for paint dances. In Proceedings of the Sixth international conference on Computational Aesthetics in Graphics, Visualization and Imaging, Computational Aesthetics'10, 67--74.
[8]
DeCarlo, D., and Santella, A. 2002. Stylization and abstraction of photographs. ACM Transactions on Graphics 21, 3, 769--776.
[9]
Durand, F., and Dorsey, J. 2002. Fast bilateral filtering for the display of high-dynamic-range images. ACM Transactions on Graphics 21, 3, 257--266.
[10]
Eitz, M., Hays, J., and Alexa, M. 2012. How do humans sketch objects? ACM Transactions on Graphics 31, 4, 44.
[11]
Freeman, W. T., Tenenbaum, J. B., and Pasztor, E. C. 2003. Learning style translation for the lines of a drawing. ACM Transactions on Graphics 22, 1, 33--46.
[12]
Gooch, B., Reinhard, E., and Gooch, A. 2004. Human facial illustrations: Creation and psychophysical evaluation. ACM Transactions on Graphics 23, 1, 27--44.
[13]
Hertzmann, A., Oliver, N., Curless, B., and Seitz, S. M. 2002. Curve analogies. In Proceedings of the 13th Eurographics Workshop on Rendering, 233--246.
[14]
Kalogerakis, E., Nowrouzezahrai, D., Breslav, S., and Hertzmann, A. 2012. Learning Hatching for Pen-and-Ink Illustration of Surfaces. ACM Transactions on Graphics 31, 1.
[15]
Kang, H., and Lee, S. 2008. Shape-simplifying image abstraction. Computer Graphics Forum 27, 7, 1773--1780.
[16]
Kang, H., Lee, S., and Chui, C. 2007. Coherent line drawing. In Proceedings of the 5th International Symposium on Non-photorealistic Animation and Rendering, ACM, 43--50.
[17]
Kyprianidis, J., and Kang, H. 2011. Image and video abstraction by coherence-enhancing filtering. Computer Graphics Forum 30, 2, 593--602.
[18]
Kyprianidis, J. E., Collomosse, J., Wang, T., and Isenberg, T. 2013. State of the art: A taxonomy of artistic stylization techniques for images and video. IEEE Transactions on Visualization and Computer Graphics 19, 5, 866--885.
[19]
Le, N. K. H., Why, Y. P., and Ashraf, G. 2011. Shape stylized face caricatures. In Proceedings of the 17th International Conference on Advances in Multimedia Modeling - Volume Part I, MMM'11, 536--547.
[20]
Liang, L., Chen, H., Xu, Y.-Q., and Shum, H.-Y. 2002. Example-based caricature generation with exaggeration. In Proceedings of the 10th IEEE Pacific Conference on Computer Graphics and Applications, PG '02, 386--393.
[21]
Limpaecher, A., Feltman, N., Treuille, A., and Cohen, M. 2013. Real-time drawing assistance through crowdsourcing. ACM Transactions on Graphics 32, 4 (Aug.).
[22]
Liu, Y., Su, Y., Shao, Y., and Jia, D. 2010. A parameterized representation for the cartoon sample space. In Proceedings of the 16th International Conference on Advances in Multimedia Modeling, 767--772.
[23]
Lu, C., Xu, L., and Jia, J. 2012. Combining sketch and tone for pencil drawing production. In Proceedings of the 10th International Symposium on Non-Photorealistic Animation and Rendering, NPAR '12, 65--73.
[24]
Lu, J., Yu, F., Finkelstein, A., and DiVerdi, S. 2012. HelpingHand: Example-based stroke stylization. ACM Transactions on Graphics 31, 4 (Aug.), 46:1--46:10.
[25]
Mehra, R., Zhou, Q., Long, J., Sheffer, A., Gooch, A., and Mitra, N. 2009. Abstraction of man-made shapes. ACM Transactions on Graphics 28, 5, 137.
[26]
Meng, M., Zhao, M., and Zhu, S. 2010. Artistic paper-cut of human portraits. In Proceedings of the ACM International Conference on Multimedia, 931--934.
[27]
Minear, M., and Park, D. 2004. A lifespan database of adult facial stimuli. Behavior Research Methods, Instruments, & Computers 36, 630--633.
[28]
Nan, L., Sharf, A., Xie, K., Wong, T., Deussen, O., Cohen-Or, D., and Chen, B. 2011. Conjoining gestalt rules for abstraction of architectural drawings. ACM Transactions on Graphics 30, 6, 185.
[29]
Noris, G., Hornung, A., Sumner, R. W., Simmons, M., and Gross, M. 2013. Topology-driven vectorization of clean line drawings. ACM Transaction on Graphics 32, 1, 4:1--4:11.
[30]
Sinha, P., Balas, B., Ostrovsky, Y., and Russell, R. 2006. Face recognition by humans: Nineteen results all computer vision researchers should know about. Proceedings of the IEEE 94, 11, 1948--1962.
[31]
Stegmann, M., and Gomez, D. 2002. A brief introduction to statistical shape analysis. Informatics and Mathematical Modelling, Technical University of Denmark, DTU, 15.
[32]
Tresset, P. A., and Leymarie, F. F. 2013. Portrait drawing by Paul the robot. Computers and Graphics 37, in press.
[33]
Truong, V. 2011. Face alignment using active shape model and support vector machine. International Journal of Biometrics and Bioinformatics 4, 6, 224.
[34]
Wang, X., and Tang, X. 2009. Face photo-sketch synthesis and recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence 31, 11, 1955--1967.
[35]
Wang, S., Zhang, L., Liang, Y., and Pan, Q. 2012. Semi-coupled dictionary learning with applications to image super-resolution and photo-sketch synthesis. In IEEE Conference on Computer Vision and Pattern Recognition, 2216--2223.
[36]
Yu, H., and Zhang, J. 2010. Caricature synthesis based on mean value coordinates. In CASA 2010: Proceedings of the 23rd International Conference on Computer Animation and Social Agents.
[37]
Yumer, M., and Kara, L. 2012. Co-abstraction of shape collections. ACM Transactions on Graphics 31, 6, 166.
[38]
Zhang, Y., McCullough, C., Sullins, J., and Ross, C. 2010. Hand-drawn face sketch recognition by humans and a pca-based algorithm for forensic applications. IEEE Transactions on Systems, Man and Cybernetics, Part A: Systems and Humans 40, 3, 475--485.
[39]
Zhao, M., and Zhu, S. 2011. Portrait painting using active templates. In Proceedings of the 11th International Symposium on Non-Photorealistic Animation and Rendering, NPAR '11, 117--124.

Cited By

View all
  • (2025)Ipdm: identity preserving diffusion model for face sketch and photo synthesisMachine Vision and Applications10.1007/s00138-024-01658-536:2Online publication date: 1-Mar-2025
  • (2024)3Doodle: Compact Abstraction of Objects with 3D StrokesACM Transactions on Graphics10.1145/365815643:4(1-13)Online publication date: 19-Jul-2024
  • (2024)Stylized Face Sketch Extraction via Generative Prior with Limited DataComputer Graphics Forum10.1111/cgf.1504543:2Online publication date: 30-Apr-2024
  • Show More Cited By

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics
ACM Transactions on Graphics  Volume 32, Issue 4
July 2013
1215 pages
ISSN:0730-0301
EISSN:1557-7368
DOI:10.1145/2461912
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 July 2013
Published in TOG Volume 32, Issue 4

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. NPR
  2. abstraction
  3. portrait sketching
  4. style

Qualifiers

  • Research-article

Funding Sources

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)96
  • Downloads (Last 6 weeks)13
Reflects downloads up to 15 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2025)Ipdm: identity preserving diffusion model for face sketch and photo synthesisMachine Vision and Applications10.1007/s00138-024-01658-536:2Online publication date: 1-Mar-2025
  • (2024)3Doodle: Compact Abstraction of Objects with 3D StrokesACM Transactions on Graphics10.1145/365815643:4(1-13)Online publication date: 19-Jul-2024
  • (2024)Stylized Face Sketch Extraction via Generative Prior with Limited DataComputer Graphics Forum10.1111/cgf.1504543:2Online publication date: 30-Apr-2024
  • (2024)Sketch Video SynthesisComputer Graphics Forum10.1111/cgf.1504443:2Online publication date: 30-Apr-2024
  • (2024)Region‐Aware Simplification and Stylization of 3D Line DrawingsComputer Graphics Forum10.1111/cgf.1504243:2Online publication date: 24-Apr-2024
  • (2024)CreativeSeg: Semantic Segmentation of Creative SketchesIEEE Transactions on Image Processing10.1109/TIP.2024.337419633(2266-2278)Online publication date: 1-Jan-2024
  • (2024)How to Handle Sketch-Abstraction in Sketch-Based Image Retrieval?2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52733.2024.01595(16859-16869)Online publication date: 16-Jun-2024
  • (2024)Breathing Life Into Sketches Using Text-to-Video Priors2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52733.2024.00414(4325-4336)Online publication date: 16-Jun-2024
  • (2024)Graph-based geometric structure line parsingNeurocomputing10.1016/j.neucom.2024.127481580:COnline publication date: 1-May-2024
  • (2024)Cogeneration of Innovative Audio-visual Content: A New Challenge for Computing ArtMachine Intelligence Research10.1007/s11633-023-1453-521:1(4-28)Online publication date: 15-Jan-2024
  • Show More Cited By

View Options

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media