Abstract
In this paper, we present a fast individual face modeling and animation system. The input of the system is a single frontal face image, which is captured by an ordinary video camera. And the output is 3D individual facial animation. Firstly, an Adaboost method is used to detect the face in the image. Then the key points of the face are located with the inverse compositional algorithm based active appearance models (AAM). The 3D geometry mesh of the individual face is then generated with morphable models. Finally, the direction and magnitude of existed motion vectors are adjusted according to different 3D face shapes using expression cloning technique. With this system, we can achieve realistic 3D facial animation with minimal and often no manual tuning. The experiments show that our system is fast enough for common applications.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Lee, Y.C., Terzopoulos, D., Waters, K.: Constructing Physics-based Facial Models of Individuals. In: Proceedings of Graphics Interface, pp. 1–8 (1993)
Lee, Y.C., Terzopoulos, D., Waters, K.: Realistic Face Modeling for Animation. In: Siggraph proceedings, pp. 55–62 (1995)
Faugeras, O., Quan, L., Sturn, P.: Self-calibration of a 1D Projective Camera and its Application to the Selfcalibration of a 2D Projective Camera. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI) 22(10), 1179–1185 (2000)
Beumier, C., Acheroy, M.: 3D Facial Surface Acquisition by Structured Light. In: International Workshop on Synthetic-Natural Hybrid Coding and Three Dimensional Imaging, Santorini, Greece, September 15-17, pp. 103–106 (1999)
Liu, Z.C., Zhang, Z.Y., Jacobs, C., Cohen, M.: Rapid Modeling of Animated Faces from Video. Technical Report, MSR-TR 2000-11 (2000)
Gao, W., Yan, J., Shan, S.G., Chen, X.L.: Individual 3D Face Synthesis Based on Orthogonal Photos and Speech-Driven Facial Animation. In: 7th IEEE International Conference on Image Processing (ICIP 2000), Vancouver, British Columbia, Canada, September 10-13 (2000)
Lee, W., Magnenat-Thalmann, N.: Fast Head Modeling for Animation. Journal Image and Vision Computing 18(4), 355–364 (2000)
Ip, H.H.S., Yin, L.J.: Constructing a 3D Individual Head Model from two Orthogonal Views. In: the Visual Computer, pp. 254–266. Springer, Heidelberg (1996)
Blanz, V., Vetter, T.: A morphable model for the synthesis of 3D faces. In: Proceedings of the 26th annual conference on Computer graphics and interactive techniques, pp. 187–194 (July 1999)
Zhang, Y., Prakashb, E.C., Sunga, E.: Constructing a Realistic Face Model of an Individual for Expression Animation. Animation International Journal of Information Technology 8(2), 10–25 (2002)
Williams, L.: Performance-Driven Facial Animation. SIGGRAPH Computer Graphics 24, 235–242 (1990)
Noh, J.-Y., Neumann, U.: Expression Cloning. In: Proceedings of the 28th annual conference on Computer graphics and interactive techniques (August 2001)
Matthews, I., Baker, S.: Active Appearance Models Revisited. International Journal of Computer Vision 60(2), 135–164 (2004)
Freund, Y., Schapire, R.E.: A decision-theoretic generalization of on-line learning and an application to boosting. Journal of Computer and System Sciences 55(1), 119–139 (1997)
Viola, P., Jones, M.: Rapid Object Detection using a Boosted Cascade of Simple Features. In: IEEE CVPR (2001)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Ding, B., Wang, Y., Yao, J., Lu, P. (2006). A Fast Individual Face Modeling and Facial Animation System. In: Pan, Z., Aylett, R., Diener, H., Jin, X., Göbel, S., Li, L. (eds) Technologies for E-Learning and Digital Entertainment. Edutainment 2006. Lecture Notes in Computer Science, vol 3942. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11736639_120
Download citation
DOI: https://doi.org/10.1007/11736639_120
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-33423-1
Online ISBN: 978-3-540-33424-8
eBook Packages: Computer ScienceComputer Science (R0)