Abstract
In this paper we propose a new method for precise face expression tracking in a video sequence which uses a hierarchical animation system built over a morphable polygonal 3D face model. Its low-level animation mechanism is based upon MPEG-4 specification which is implemented via local point-driven mesh deformations adaptive to the face geometry. The set of MPEG-4 animation parameters is in its turn controlled by a higher-level system based upon facial muscles structure. That allows us to perform precise tracking of complicated facial expressions as well as to produce face-to-face retargeting by transmitting the expression parameters to the different faces.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Kalinkina, D., Gagalowicz, A., Roussel, R.: 3D reconstruction of a human face from images using morphological adaptation. In: Gagalowicz, A., Philips, W. (eds.) MIRAGE 2007. LNCS, vol. 4418, pp. 212–224. Springer, Heidelberg (2007)
Roussel, R., Gagalowicz, A.: Morphological Adaptation of a 3D Model of Face from Images. In: MIRAGE (2003)
Roussel, R., Gagalowicz, A.: A hierarchical face behavior model for a 3D face tracking without markers. In: Gagalowicz, A., Philips, W. (eds.) CAIP 2005. LNCS, vol. 3691, pp. 854–861. Springer, Heidelberg (2005)
GRETA: Embodied Conversational Agent, http://linc.iut.univ-paris8.fr/greta/
Pandzic, I.S., Forchheimer, R.: MPEG-4 facial animation
Dementhon, D., Davis, L.S.: Model-based Object Pose in 25 Lines of Code. International Journal of Computer Vision 15, 123–141 (1995)
Buhmann, M.D.: Radial Basis Functions: Theory and Implementations. Justus-Liebig-Universität Giessen, Germany
Press, W.H., Teukolsky, S.A., Vetterling, W.T., Flannery, B.P.: Numerical Recipes in C
Pasquariello, S., Pelachaud, C.: Greta: A Simple Facial Animation Engine. In: Proc. of the 6th Online World Conference on Soft Computing in Industrial Applications (2001)
Schwerdt, K., Crowley, J.L.: Robust Face Tracking Using Color. In: 4th IEEE International Conference on Automatic Face and Gesture Recognition, pp. 90–95 (2000)
Bibby, C., Reid, I.: Robust Real-Time Visual Tracking Using Pixel-Wise Posteriors. In: Forsyth, D., Torr, P., Zisserman, A. (eds.) ECCV 2008, Part I. LNCS, vol. 5302, pp. 831–844. Springer, Heidelberg (2008)
Cipolla, R., Gee, A.: Fast Visual Tracking by Temporal Consensus. Image and Vision Computing, 105–114 (1996)
Drummond, T., Cipolla, R.: Real-time Tracking of Complex Structures with On-line Camera Calibration. In: British Machine Vision Conference, pp. 574–583 (1999)
Terzopoulos, D., Waters, K.: Physically-Based Facial Modeling, Analysis, and Animation. The Journal of Visualization, Analysis, and Animation 1,2, 73–80 (1990)
Terzopoulos, D., Waters, K.: Analysis and Synthesis of Facial Image Sequence Using Physical and Anatomical Models. IEEE Trans. on Pattern Analysis and Machine Intelligence, 569–579 (1993)
Lanitis, A., Taylor, C.J., Cootes, T.F.: Automatic Interpretation and Coding of Face Images Using Flexible Models. IEEE Trans. on Pattern Analysis and Machine Intelligence 17, 743–756 (1997)
Black, M.J., Yacoob, Y.: Tracking and Recognizing Rigid and Non-Rigid Facial Motions Using Local Parametric Models of Image Motion. In: International Conference on Computer Vision, pp. 374–381 (1995)
Malciu, M., Prêteux, F., Buzuloiu, V.: 3D Global Head Pose Estimation: A Robust Approach. In: Proceedings of International Workshop on Synthetic-Natural Hybrid Coding and Three Dimensional Imaging (1999)
Reveret, L., Essa, I.: Visual Coding and Tracking of Speech Related Facial Motions. In: CVPR 2001 Workshop on Cues in Communication (2001)
Ekman, P., Friesen, W.: Facial Action Coding System: A Technique for the Measurement of Facial Movement. Consulting Psychologists Press, Palo Alto (1978)
Ahlberg, J.: Using the Active Appearance Algorithm for Face and Facial Feature Tracking. In: ICCV 2001 Workshop on Recognition, Analysis and Tracking of Faces and Gestures in Real-Time Systems, pp. 68–72 (2001)
Fanelli, G.: Facial Features Tracking Using Active Appearance Models. University essay from Linköpings universitet (2006)
Douglas DeCarlo, D.: Optical Flow Constraints on Deformable Models with Applications to Face Tracking. International Journal of Computer Vision 38, 99–127 (2000)
GPGPU Reduction Tutorial, http://www.mathematik.uni-dortmund.de/~goeddeke/gpgpu/
Roivainen, P., Li, H., Forchheimer, R.: 3-D Motion Estimation in Model-Based Facial Image Coding. IEEE Transactions on Pattern Analysis and Machine Intelligence 15, 545–555 (1993)
Gokturk, S.B., Bouguet, J.-Y., Tomasi, C., Girod, B.: Model-Based Face Tracking for View-Independent Facial Expression Recognition. In: FGR (2002)
Pighin, F., Szeliski, R., Salesin, D.H.: Resynthesizing Facial Animation through 3D Model-Based Tracking. In: Proceedings of the 7th IEEE International Conference on Computer Vision, vol. 1, pp. 143–150 (1999)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Kalinkina, D., Gagalowicz, A. (2009). New Human Face Expression Tracking. In: Gagalowicz, A., Philips, W. (eds) Computer Vision/Computer Graphics CollaborationTechniques. MIRAGE 2009. Lecture Notes in Computer Science, vol 5496. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-01811-4_29
Download citation
DOI: https://doi.org/10.1007/978-3-642-01811-4_29
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-01810-7
Online ISBN: 978-3-642-01811-4
eBook Packages: Computer ScienceComputer Science (R0)