Abstract
We present a learning-based 3D facial expression mapping technique that preserves facial expression details and works in real time for even high resolution meshes. Our approach is inspired by a previously developed technique called deformation transfer [1]. The deformation transfer technique preserves facial expression details but its computational overhead makes it not suitable for real time applications. To accelerate computation, we use a piecewise linear function to represent the mapping from the direct motion (the difference between the expression face and the neutral face) to the motion obtained by the deformation transfer method. This piecewise linear function is learned offline from a small set of training data. The online computation is thus reduced to the evaluation of the piecewise linear functions which is significantly faster. As a result, we are able to perform real time expression mapping for even high resolution 3D meshes.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Sumner, R.W., Popović, J.: Deformation Transfer for Triangle Meshes. In: ACM Siggraph, pp. 399–405 (2004)
Kähler, K., Haber, J., Seidel, H.-P.: Geometry-based Muscle Modeling for Facial Animation. In: Graphics Interface, pp. 37–46 (2001)
Lee, Y., Terzopoulos, D., Waters, K.: Realistic Modelling for Facial Animation. In: ACM Siggraph, pp. 55–62 (1995)
Zhang, L., Snavely, N., Curless, B., Seitz, S.M.: Spacetime faces: high resolution capture for modeling and animation. ACM Transaction on Graphics 23(3), 548–558 (2004)
Parke, F.I., Waters, K.: Computer Facial Animation. AK Peters, Wellesley, Mass (1996)
Brennan, S.E.: Caricature Generator, MS Visual Studies, Dept. of Architecture, Massachusettes Inst. Of Technology, Cambridge, Mass. (1982)
Litwinowcz, P., Williams, L.: Animating Images with Drawings. In: ACM Siggraph, pp. 409–412 (1994)
Williams, L.: Performance-Driven Facial Animation. Computer Graphics, 235–242 (1990)
Liu, Z., Shan, Y., Zhang, Z.: Expressive expression mapping with ratio images. In: ACM Siggraph, pp. 271–276 (2001)
Pighin, F., Hecker, J., Lischinski, D., Szeliski, R., Salesin, D.H.: Synthesizing realistic facial expressions from photographs. In: ACM Siggraph, pp. 75–84 (1998)
Pyun, P., Kim, Y., Chae, W.: An Example-based Approach for Facial Expression Cloning. In: ACM Siggraph/EuroGraphics Symposium on Computer Animation, pp. 277–288 (2003)
Noh, J.-Y., Neumann, U.: Expression Cloning. In: ACM Siggraph, pp. 277–288 (2001)
Zhang, Q., Liu, Z., Guo, B., Shum, H.: Geometry-Driven Photorealistic Facial Expression Synthesis. In: Eurography/Siggraph Symposium on Computer Animation, pp. 177–187 (2003)
Zhang, Q., Liu, Z., Guo, B., Terzopoulos, D., Shum, H.: Geometry-Driven Photorealistic Facial Expression Synthesis. IEEE Transaction on Visualization and Computer Graphics 12(1), 48–60 (2006)
Duda, R.O., Hart, P.E., Stork, D.G.: Pattern Classification. Wiley Interscience, Chichester (2000)
Krüger, J., Westermann, R.: Linear Algebra Operators for GPU Implementation of Numerical Algorithms. In: ACM Siggraph, pp. 908–916 (2003)
Challis, J.H.: A procedure for determining rigid body transformation parameters. Journal of Biomechanics 28(6), 733–737 (1995)
Davis, T.A.: Umfpack version 4.1 user guide. Technical report, University of Florida.TR-03-008 (2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Song, M., Liu, Z., Guo, B. (2006). Real-Time Facial Expression Mapping for High Resolution 3D Meshes. In: Nishita, T., Peng, Q., Seidel, HP. (eds) Advances in Computer Graphics. CGI 2006. Lecture Notes in Computer Science, vol 4035. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11784203_24
Download citation
DOI: https://doi.org/10.1007/11784203_24
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-35638-7
Online ISBN: 978-3-540-35639-4
eBook Packages: Computer ScienceComputer Science (R0)