Itamar Berger
Skip Abstract Section
Skip Supplemental Material SectionAbstract
We use a data-driven approach to study both style and abstraction in sketching of a human face. We gather and analyze data from a number of artists as they sketch a human face from a reference photograph. To achieve different levels of abstraction in the sketches, decreasing time limits were imposed -- from four and a half minutes to fifteen seconds. We analyzed the data at two levels: strokes and geometric shape. In each, we create a model that captures both the style of the different artists and the process of abstraction. These models are then used for a portrait sketch synthesis application. Starting from a novel face photograph, we can synthesize a sketch in the various artistic styles and in different levels of abstraction.
Supplemental Material
Available for Download
zip
a55-berger.zip (34.1 MB)
Supplemental material.
- Belongie, S., Malik, J., and Puzicha, J. 2002. Shape matching and object recognition using shape contexts. IEEE Transactions on Pattern Analysis and Machine Intelligence 24, 4, 509--522. Google Scholar
Digital Library
- Chang, I.-C., and Cheng, R.-M. 2011. Caricaturation for human face pictures. In International Conference on Machine Learning and Cybernetics, 1702--1707.Google Scholar
- Chen, H., Zheng, N., Liang, L., Li, Y., Xu, Y., and Shum, H. 2002. Pictoon: a personalized image-based cartoon system. In Proceedings of the Tenth ACM International Conference on Multimedia, 171--178. Google ScholarDigital Library
- Chen, H., Liu, Z., Rose, C., Xu, Y., Shum, H., and Salesin, D. 2004. Example-based composite sketching of human portraits. In Proceedings of the 3rd International Symposium on Non-photorealistic Animation and Rendering, NPAR '04, ACM, 95--153. Google ScholarDigital Library
- Chiang, P., Liao, W., and Li, T. 2004. Automatic caricature generation by analyzing facial features. In Proceedings of the 2004 Asia Conference on Computer Vision.Google Scholar
- Cole, F., Golovinskiy, A., Limpaecher, A., Barros, H. S., Finkelstein, A., Funkhouser, T., and Rusinkiewicz, S. 2008. Where do people draw lines? ACM Transactions on Graphics (Proc. SIGGRAPH) 27, 3 (Aug.). Google ScholarDigital Library
- Colton, S. 2010. Stroke matching for paint dances. In Proceedings of the Sixth international conference on Computational Aesthetics in Graphics, Visualization and Imaging, Computational Aesthetics'10, 67--74. Google ScholarDigital Library
- DeCarlo, D., and Santella, A. 2002. Stylization and abstraction of photographs. ACM Transactions on Graphics 21, 3, 769--776. Google ScholarDigital Library
- Durand, F., and Dorsey, J. 2002. Fast bilateral filtering for the display of high-dynamic-range images. ACM Transactions on Graphics 21, 3, 257--266. Google ScholarDigital Library
- Eitz, M., Hays, J., and Alexa, M. 2012. How do humans sketch objects? ACM Transactions on Graphics 31, 4, 44. Google ScholarDigital Library
- Freeman, W. T., Tenenbaum, J. B., and Pasztor, E. C. 2003. Learning style translation for the lines of a drawing. ACM Transactions on Graphics 22, 1, 33--46. Google ScholarDigital Library
- Gooch, B., Reinhard, E., and Gooch, A. 2004. Human facial illustrations: Creation and psychophysical evaluation. ACM Transactions on Graphics 23, 1, 27--44. Google ScholarDigital Library
- Hertzmann, A., Oliver, N., Curless, B., and Seitz, S. M. 2002. Curve analogies. In Proceedings of the 13th Eurographics Workshop on Rendering, 233--246. Google ScholarDigital Library
- Kalogerakis, E., Nowrouzezahrai, D., Breslav, S., and Hertzmann, A. 2012. Learning Hatching for Pen-and-Ink Illustration of Surfaces. ACM Transactions on Graphics 31, 1. Google ScholarDigital Library
- Kang, H., and Lee, S. 2008. Shape-simplifying image abstraction. Computer Graphics Forum 27, 7, 1773--1780.Google ScholarCross Ref
- Kang, H., Lee, S., and Chui, C. 2007. Coherent line drawing. In Proceedings of the 5th International Symposium on Non-photorealistic Animation and Rendering, ACM, 43--50. Google ScholarDigital Library
- Kyprianidis, J., and Kang, H. 2011. Image and video abstraction by coherence-enhancing filtering. Computer Graphics Forum 30, 2, 593--602.Google ScholarCross Ref
- Kyprianidis, J. E., Collomosse, J., Wang, T., and Isenberg, T. 2013. State of the art: A taxonomy of artistic stylization techniques for images and video. IEEE Transactions on Visualization and Computer Graphics 19, 5, 866--885. Google ScholarDigital Library
- Le, N. K. H., Why, Y. P., and Ashraf, G. 2011. Shape stylized face caricatures. In Proceedings of the 17th International Conference on Advances in Multimedia Modeling - Volume Part I, MMM'11, 536--547. Google ScholarDigital Library
- Liang, L., Chen, H., Xu, Y.-Q., and Shum, H.-Y. 2002. Example-based caricature generation with exaggeration. In Proceedings of the 10th IEEE Pacific Conference on Computer Graphics and Applications, PG '02, 386--393. Google ScholarDigital Library
- Limpaecher, A., Feltman, N., Treuille, A., and Cohen, M. 2013. Real-time drawing assistance through crowdsourcing. ACM Transactions on Graphics 32, 4 (Aug.). Google ScholarDigital Library
- Liu, Y., Su, Y., Shao, Y., and Jia, D. 2010. A parameterized representation for the cartoon sample space. In Proceedings of the 16th International Conference on Advances in Multimedia Modeling, 767--772. Google ScholarDigital Library
- Lu, C., Xu, L., and Jia, J. 2012. Combining sketch and tone for pencil drawing production. In Proceedings of the 10th International Symposium on Non-Photorealistic Animation and Rendering, NPAR '12, 65--73. Google ScholarDigital Library
- Lu, J., Yu, F., Finkelstein, A., and DiVerdi, S. 2012. HelpingHand: Example-based stroke stylization. ACM Transactions on Graphics 31, 4 (Aug.), 46:1--46:10. Google ScholarDigital Library
- Mehra, R., Zhou, Q., Long, J., Sheffer, A., Gooch, A., and Mitra, N. 2009. Abstraction of man-made shapes. ACM Transactions on Graphics 28, 5, 137. Google ScholarDigital Library
- Meng, M., Zhao, M., and Zhu, S. 2010. Artistic paper-cut of human portraits. In Proceedings of the ACM International Conference on Multimedia, 931--934. Google ScholarDigital Library
- Minear, M., and Park, D. 2004. A lifespan database of adult facial stimuli. Behavior Research Methods, Instruments, & Computers 36, 630--633.Google ScholarCross Ref
- Nan, L., Sharf, A., Xie, K., Wong, T., Deussen, O., Cohen-Or, D., and Chen, B. 2011. Conjoining gestalt rules for abstraction of architectural drawings. ACM Transactions on Graphics 30, 6, 185. Google ScholarDigital Library
- Noris, G., Hornung, A., Sumner, R. W., Simmons, M., and Gross, M. 2013. Topology-driven vectorization of clean line drawings. ACM Transaction on Graphics 32, 1, 4:1--4:11. Google ScholarDigital Library
- Sinha, P., Balas, B., Ostrovsky, Y., and Russell, R. 2006. Face recognition by humans: Nineteen results all computer vision researchers should know about. Proceedings of the IEEE 94, 11, 1948--1962.Google ScholarCross Ref
- Stegmann, M., and Gomez, D. 2002. A brief introduction to statistical shape analysis. Informatics and Mathematical Modelling, Technical University of Denmark, DTU, 15.Google Scholar
- Tresset, P. A., and Leymarie, F. F. 2013. Portrait drawing by Paul the robot. Computers and Graphics 37, in press. Google ScholarDigital Library
- Truong, V. 2011. Face alignment using active shape model and support vector machine. International Journal of Biometrics and Bioinformatics 4, 6, 224.Google Scholar
- Wang, X., and Tang, X. 2009. Face photo-sketch synthesis and recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence 31, 11, 1955--1967. Google ScholarDigital Library
- Wang, S., Zhang, L., Liang, Y., and Pan, Q. 2012. Semi-coupled dictionary learning with applications to image super-resolution and photo-sketch synthesis. In IEEE Conference on Computer Vision and Pattern Recognition, 2216--2223. Google ScholarDigital Library
- Yu, H., and Zhang, J. 2010. Caricature synthesis based on mean value coordinates. In CASA 2010: Proceedings of the 23rd International Conference on Computer Animation and Social Agents.Google Scholar
- Yumer, M., and Kara, L. 2012. Co-abstraction of shape collections. ACM Transactions on Graphics 31, 6, 166. Google ScholarDigital Library
- Zhang, Y., McCullough, C., Sullins, J., and Ross, C. 2010. Hand-drawn face sketch recognition by humans and a pca-based algorithm for forensic applications. IEEE Transactions on Systems, Man and Cybernetics, Part A: Systems and Humans 40, 3, 475--485. Google ScholarDigital Library
- Zhao, M., and Zhu, S. 2011. Portrait painting using active templates. In Proceedings of the 11th International Symposium on Non-Photorealistic Animation and Rendering, NPAR '11, 117--124. Google ScholarDigital Library
Index Terms
- Style and abstraction in portrait sketching
Comments