Abstract
In this paper, we propose an image driven shape deformation approach for stylizing a 3D mesh using styles learned from existing 2D illustrations. Our approach models a 2D illustration as a planar mesh and represents the shape styles with four components: the object contour, the context curves, user-specified features and local shape details. After the correspondence between the input model and the 2D illustration is established, shape stylization is formulated as a style-constrained differential mesh editing problem. A distinguishing feature of our approach is that it allows users to directly transfer styles from hand-drawn 2D illustrations with individual perception and cognition, which are difficult to identify and create with 3D modeling and editing approaches. We present a sequence of challenging examples including unrealistic and exaggerated paintings to illustrate the effectiveness of our approach.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Alexa, M., 2003. Differential coordinates for local mesh morphing and deformation. Vis. Comput., 19(2):105–114.
Allen, B., Curless, B., Popovic, Z., 2003. The space of human body shapes: reconstruction and parameterization from range scans. ACM Trans. Graph., 22(3):587–594. [doi:10. 1145/882262.882311]
Biermann, H., Martin, I., Bernardini, F., Zorin, D., 2002. Cut-and-Paste Editing of Multiresolution Surfaces. Proc. 29th Annual Conf. on Computer Graphics and Interactive Techniques, p.312–321. [doi:10.1145/566570.566583]
Funkhouser, T., Kazhdan, M., Shilane, P., Min, P., Kiefer, W., Tal, A., Rusinkiewicz, S., Dobkin, D., 2004. Modeling by example. ACM Trans. Graph., 23(3):652–663. [doi:10. 1145/1015706.1015775]
Guskov, I., Sweldens, W., Schroder, P., 1999. Multiresolution Signal Processing for Meshes. Proc. 26th Annual Conf. on Computer Graphics and Interactive Techniques, p.325–334. [doi:10.1145/311535.311577]
Hornung, A., Dekkers, E., Kobbelt, L., 2007. Character animation from 2D pictures and 3D motion data. ACM Trans. Graph., 26(1): Article 1, p.1–9.
Hu, J., Liu, L., Wang, G., 2007. Dual Laplacian morphing for triangular meshes. Comput. Anim. Virtual Worlds, 18(4–5): 271–277. [doi:10.1002/cav.182]
Igarashi, T., Matsuoka, S., Tanaka, H., 1999. Teddy: a Sketching Interface for 3D Freeform Design. Proc. 26th Annual Conf. on Computer Graphics and Interactive Techniques, p.409–416. [doi:10.1145/311535.311602]
Ju, T., Zhou, Q.Y., Hu, S.M., 2007. Editing the topology of 3D models by sketching. ACM Trans. Graph., 26(3): Article 42, p.1–9.
Kobbelt, L., Campagna, S., Vorsatz, J., Seidel, H.P., 1998. Interactive Multi-Resolution Modeling on Arbitrary Meshes. Proc. 25th Annual Conf. on Computer Graphics and Interactive Techniques, p.105–114. [doi:10.1145/280814.280831]
Li, Y., Gleicher, M., Xu, Y.Q., Shum, H.Y., 2003. Stylizing Motion with Drawings. Proc. of ACM SIGGRAPH/Eurographics Symp. on Computer Animation, p.309–319.
Lipman, Y., Sorkine, O., Levin, D., Cohen-Or, D., 2005. Linear rotation-invariant coordinates for meshes. ACM Trans. Graph., 24(3):479–487. [doi:10.1145/1073204.1073217]
McReynolds, T., Blythe, D., Grantham, B., Nelson, S., 1999. Advanced Graphics Programming Techniques Using OpenGL. SIGGRAPH Course Notes. Available from http://www.opengl.org/resources/code/samples/sig99/advanced99/notes/notes.html [Accessed on Mar. 20, 2008]
Mount, D., Arya, S, 2006. ANN: A Library for approximate nearest neighbor searching, Version 1.1.1. Available from http://www.cs.umd.edu/~mount/ANN [Accessed on June 5, 2008].
Nealen, A., Sorkine, O., Alexa, M., Cohen-Or, D., 2005. A sketch-based interface for detail-preserving mesh editing. ACM Trans. Graph., 24(3):1142–1147.
Nealen, A., Igarashi, T., Sorkine, O., Alexa, M., 2007. Fiber-Mesh: designing freeform surfaces with 3D curves. ACM Trans. Graph., 26(3): Article 41, p.1–9.
Rose, K., Sheffer, A., Wither, J., Cani, M.P., Thibert, B., 2007. Developable Surfaces from Arbitrary Sketched Boundaries. Proc. 15th Eurographics Symp. on Geometry Processing, p.163–172.
Sander, P.V., Gu, X., Gortler, S.J., Hoppe, H., Snyder, J., 2000. Silhouette Clipping. Proc. 27th Annual Conf. on Computer Graphics and Interactive Techniques, p.327–334. [doi:10.1145/344779.344935]
Sheffer, A., Kraevoy, V., 2004. Pyramid Coordinates for Morphing and Deformation. Proc. 2nd Int. Symp. on 3D Data Processing, Visualization, and Transmission, p.68–75. [doi:10.1109/TDPVT.2004.1335149]
Shewchuk, J.R., 2002. Delaunay refinement algorithms for triangular mesh generation. Comput. Geom., 22(1–3): 21–74. [doi:10.1016/S0925-7721(01)00047-5]
Sorkine, O., Cohen-Or, D., Lipman, Y., Alexa, M., Rossl, C., Seidel, H.P., 2004. Laplacian Surface Editing. Proc. Eurographics/ACM SIGGRAPH Symp. on Geometry Processing, p.179–188.
Sumner, R.W., Popovic, J., 2004. Deformation transfer for triangle meshes. ACM Trans. Graph., 23(3):399–405. [doi:10.1145/1015706.1015736]
Weng, Y., Xu, W., Wu, Y., Zhou, K., Guo, B., 2006. 2D shape deformation using nonlinear least squares optimization. Vis. Comput., 22(9–11):653–660. [doi:10.1007/s00371-006-0054-y]
Yu, Y., Zhou, K., Xu, D., Shi, X., Bao, H., Guo, B., Shum, H.Y., 2004. Mesh editing with Poisson-based gradient field manipulation. ACM Trans. Graph., 23(3):644–651.
Zhou, K., Huang, J., Snyder, J., Liu, X., Bao, H., Guo, B., Shum, H.Y., 2005. Large mesh deformation using the volumetric graph Laplacian. ACM Trans. Graph., 24(3): 496–503. [doi:10.1145/1073204.1073219]
Zimmermann, J., Nealen, A., Alexa, M., 2007. SilSketch: Automated Sketch-Based Editing of Surface Meshes. Proc. 4th Eurographics Workshop on Sketch-Based Interfaces and Modeling, p.496–503.
Author information
Authors and Affiliations
Corresponding author
Additional information
Project (Nos. 60776799 and 60873123) supported by the National Natural Science Foundation of China
Rights and permissions
About this article
Cite this article
Tan, Gh., Chen, W. & Liu, Lg. Image driven shape deformation using styles. J. Zhejiang Univ. - Sci. C 11, 27–35 (2010). https://doi.org/10.1631/jzus.C0910089
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1631/jzus.C0910089