Abstract
We propose a real-time rendering system for automatically creating a caricature drawing, i.e., an exaggerated portrait, of a human face, based on simultaneous use of a range image (or 3D mesh) and a registered photograph of the same face. Combining these information sources provides complementary information. Significant geometric lines such as occluding contours and suggestive contours are extracted from the range data, while textured areas corresponding to shading features are extracted from the photograph. These are combined, and then distorted to produce the final caricature. The final output may be produced using a choice of non-photorealistic rendering styles. Our system method works well for low resolution range images; for these it is fast enough to allow the viewpoint to be chosen in real time. The final output combines significant lines, textured areas, and optional shading, giving a pleasing result which preserves not only the shape cues of the geometric description, but also other essential visual characteristics of the facial image that cannot be deduced from geometry alone.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Blake, W., 2006. Drawing Portraits: a Step-by-Step Art Instruction Book. Watson-Guptill Publications.
Boyer, V., 2005. An Artistic Portrait Caricature Model. LNCS, 3804:595–600. [doi:10.1007/11595755_72]
Brennan, S.E., 1985. The caricature generator: the dynamic exaggeration of faces by computer. Leonardo, 18(3):170–178. [doi:10.2307/1578048]
Canny, J., 1986. A computational approach to edge detection. IEEE Trans. Pattern Anal. Mach. Intell., 8(6):679–698. [doi:10.1109/TPAMI.1986.4767851]
Chen, H., Liu, Z., Rose, C., Xu, Y., Shum, H.Y., Salesin, D., 2004. Example-Based Composite Sketching of Human Portraits. Proc. 3rd Int. Symp. on Non-photorealistic Animation and Rendering, p.95–153. [doi:10.1145/987657.987673]
Chen, Y.L., Liao, W.H., Chiang, P.Y., 2006. Generation of 3D Caricature by Fusing Caricature Images. IEEE Int. Conf. on Systems, Man and Cybernetics, p.866–871. [doi:10.1109/ICSMC.2006.384498]
Clarke, L., Chen, M., Mora, B., 2011. Automatic generation of 3D caricatures based on artistic deformation styles. IEEE Trans. Visual. Comput. Graph., 17(6):808–821. [doi:10.1109/TVCG.2010.76]
Cole, F., Golovinskiy, A., Limpaecher, A., Barros, H.S., Finkelstein, A., Funkhouser, T., Rusinkiewicz, S., 2008. Where do people draw lines? ACM Trans. Graph., 27(3), Article 88, p.1–11. [doi:10.1145/1360612.1360687]
DeCarlo, D., 2012. Depicting 3D shape using lines. SPIE, 8291:829116. [doi:10.1117/12.916463]
DeCarlo, D., Finkelstein, A., Rusinkiewicz, S., Santella, A., 2003. Suggestive contours for conveying shape. ACM Trans. Graph., 22(3):848–855. [doi:10.1145/882262.882 354]
Flynn, P.J., Bowyer, K.W., Phillips, P.J., 2003. Assessment of Time Dependency in Face Recognition: an Initial Study. Audio and Video-Based Biometric Person Authentication, p.44–51. [doi:10.1007/3-540-44887-X_6]
Freeman, J.T., 2006. Drawing Portraits. Crowood Press, UK.
Frowd, C., Bruce, V., Ross, D., McIntyre, A., Hancock, P.J.B., 2007. An application of caricature: how to improve the recognition of facial composites. Vis. Cogn., 15(8):954–984. [doi:10.1080/13506280601058951]
Fujiwara, T., Koshimizu, H., Fujimura, K., Fujita, G., Noguchi, Y., Ishikawa, N., 2001. 3D Modeling System of Human Face and Full 3D Facial Caricaturing. Proc. 17th Int. Conf. on Virtual Systems and Multimedia, p.625–633. [doi:10.1109/VSMM.2001.969721]
Huang, Y., Martin, R.R., Rosin, P.L., Meng, X., Yang, C., 2009. Expressive line drawings of human faces from range images. Sci. China Ser. F, 52(2):295–307. [doi:10.1007/s11432-009-0039-3]
Isenberg, T., Neumann, P., Carpendale, S., Sousa, M.C., Jorge, J.A., 2006. Non-photorealistic Rendering in Context: an Observational Study. Proc. 4th Int. Symp. on Nonphotorealistic Animation and Rendering, p.115–126. [doi:10.1145/1124728.1124747]
Judd, T., Durand, F., Adelson, E., 2007. Apparent ridges for line drawing. ACM Trans. Graph., 26(3), Article 19. [doi:10.1145/1276377.1276401]
Kang, H., Lee, S., Chui, C.K., 2007. Coherent Line Drawing. Proc. 5th Int. Symp. on Non-photorealistic Animation and Rendering, p.43–49. [doi:10.1145/1274871.1274878]
Kolomenkin, M., Shimshoni, I., Tal, A., 2008. Demarcating curves for shape illustration. ACM Trans. Graph., 27(5), Article 157. [doi:10.1145/1409060.1409110]
Liang, L., Chen, H., Xu, Y.Q., Shum, H.Y., 2002. Example-Based Caricature Generation with Exaggeration. Proc. 10th Pacific Conf. on Computer Graphic and Application, p.386–393.
Rosin, P., Collomosse, J. (Eds.), 2013. Image and Video-Based Artistic Stylisation. In: Computational Imaging and Vision. Springer-Verlag London. [doi:10.1007/978-1-4471-4519-6]
Rusinkiewicz, S., 2004. Estimating Curvatures and Their Derivatives on Triangle Meshes. Proc. 2nd Int. Symp. on 3D Data Processing, Visualization and Transmission, p.486–493. [doi:10.1109/TDPVT.2004.1335277]
Soon, A., Lee, W.S., 2006. Shape-based detail-preserving exaggeration of extremely accurate 3D faces. Vis. Comput., 22(7):478–492. [doi:10.1007/s00371-006-0023-5]
Sun, X., Rosin, P.L., Martin, R.R., Langbein, F.C., 2007. Fast and effective feature preserving mesh denoising. IEEE Trans. Visual. Comput. Graph., 13(5):925–938. [doi:10.1109/TVCG.2007.1065]
Tsai, W.H., 1985. Moment-preserving thresholding: a new approach. Comput. Vis. Graph. Image Process., 29(3): 377–393. [doi:10.1016/0734-189X(85)90133-1]
Xu, Z., Chen, H., Zhu, S.C., Luo, J., 2008. A hierarchical compositional model for face representation and sketching. IEEE Trans. Pattern Anal. Mach. Intell., 30(6):955–969. [doi:10.1109/TPAMI.2008.50]
Zhang, L., He, Y., Xie, X., Chen, W., 2009. Laplacian Lines for Real-Time Shape Illustration. Proc. Symp. on Interactive 3D Graphics and Games, p.129–136. [doi:10.1145/1507149.1507170]
Author information
Authors and Affiliations
Corresponding author
Additional information
Project supported by the National Natural Science Foundation of China (Nos. 61003149 and U1035004) and the Natural Science Foundation of Shandong Province, China (No. ZR2010FQ011)
Rights and permissions
About this article
Cite this article
Wang, L., Lou, Lm., Yang, Cl. et al. Portrait drawing from corresponding range and intensity images. J. Zhejiang Univ. - Sci. C 14, 530–541 (2013). https://doi.org/10.1631/jzus.CIDE1306
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1631/jzus.CIDE1306