Abstract
We propose a technique for automatically generating a realistic facial animation with precise individual facial geometry and characteristic facial expressions. Our method is divided into two key methods: the head modeling process automatically generates a whole head model only from facial range scan data, the facial animation setup process automatically generates key shapes which represent individual facial expressions based on physics-based facial muscle simulation with an individual muscle layout estimated from facial expression videos. Facial animations considering individual characteristics can be synthesized using the generated head model and key shapes. Experimental results show that the proposed method can generate facial animations where 84% of subjects can identify themselves. Therefore, we conclude that our head modeling techniques are effective to entertainment system like a Future Cast.
Chapter PDF
Similar content being viewed by others
Keywords
References
Alexander, O., Rogers, M., Lambeth, W., Chiang, N., Devebec, P.: Creating a Photoreal Digital Actor: The Digital Emily Project. In: SIGGRAPH 2009: ACM SIGGRAPH 2009, Course Notes (2009)
Allen, B., Curless, B., Popović, Z.: The Space of Human Body Shapes: Reconstruction and Parameterization from Range Scans. In: SIGGRAPH 2003: ACM SIGGRAPH 2003, Papers, pp. 587–594 (2003)
Choe, B., Lee, H., Ko, H.: Performance-driven Muscle-based Facial Animation. In: Proc. of Computer Animation, vol. 12, pp. 67–79 (2001)
Blanz, V., Basso, C., Poggio, T., Vetter, T.: Reanimating Faces in Images and Video. Computer Graphics Forum 22(3), 641–650 (2003)
Bouguet, J.-Y.: Pyramidal Implementation of the Lucas Kanade Feature Tracker Description of the Algorithm (2000)
De Carlo, D., Metaxas, D., Stone, M.: An Anthropometric Face Model using Variational Techniques. In: SIGGRAPH 1998: Proceedings of the 25th Annual Conference on Computer Graphics and Interactive Techniques, pp. 67–74 (1998)
Kähler, K., Haber, J., Yamauchi, H., Seidel, H.-P.: Head Shop: Generating Animated Head Models with Anatomical Structure. In: SCA 2002: Proceedings of the 2002 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, pp. 55–63 (2002)
Kraevoy, V., Sheffer, A.: Template Based Mesh Completion. In: SGP 2005: Proceedings of the third Eurographics Symposium on Geometry Processing, pp. 13–22 (2005)
Maejima, A., Wemler, S., Machida, T., Takebayashi, M., Morishima, S.: Instant Casting Movie Theater: The Future Cast System. IEICE Transactions on Information and Systems E91-D(4), 1135–1148 (2008)
Mukai, T., Kuriyama, S.: Geostatistical Motion Interpolation. In. In: SIGGRAPH 2005: ACM SIGGRAPH 2005, Papers, pp. 1062–1070 (2005)
Pighin, F., Hecker, J., Lischinski, D., Szeliski, R., Salesin, D.H.: Synthesizing Realistic Facial Expressions from Photographs. In: SIGGRAPH 1998: Proceedings of the 25th Annual Conference on Computer Graphics and Interactive Techniques, pp. 75–84 (1998)
Joshi, P., Tien, W.C., Desbrun, M., Pighin, F.: Learning Controls for Blend Shape based Realistic Facial Animation. In: SCA 2003: Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Computer Animation, pp. 187–192 (2003)
Sifakis, E., Neverov, I., Fedkiw, R.: Automatic Determination of Facial Muscle Activations from Sparse Motion Capture Marker Data. In: SIGGRAPH 2005: ACM SIGGRAPH 2005 Papers, pp. 417–425 (2005)
Vlasic, D., Brand, M., Pfister, H., Popović, J.: Face Transfer with Multilinear Models 24, 426–433 (2005)
Lee, Y., Terzopulus, D., Waters, K.: Realistic Modeling for Facial Animation. In: Proceedings of SIGGRAPH 1995, pp. 55–62 (1995)
Yotsukura, T., Morishima, S., Nakamura, S.: Face Expression Synthesis based on a Facial Motion Distribution Chart. In: SIGGRAPH 2004: ACM SIGGRAPH 2004, Posters, p. 85 (2004)
Zhu, C., Byrd, R.H., Lu, P., Nocedal, J.: Algorithm 778: L-bfgs-b: Fortran subroutines for large-scale bound-constrained optimization. ACM Trans. Math. Softw. 23(4), 550–560 (1997)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Maejima, A., Kubo, H., Morishima, S. (2011). Realistic Facial Animation by Automatic Individual Head Modeling and Facial Muscle Adjustment. In: Shumaker, R. (eds) Virtual and Mixed Reality - Systems and Applications. VMR 2011. Lecture Notes in Computer Science, vol 6774. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-22024-1_29
Download citation
DOI: https://doi.org/10.1007/978-3-642-22024-1_29
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-22023-4
Online ISBN: 978-3-642-22024-1
eBook Packages: Computer ScienceComputer Science (R0)