Abstract
Facial expression is the most important channel for human nonverbal communication. This paper presents a novel and effective approach to automatic 3D Facial Expression Recognition, FER based on the Muscular Movement Model (MMM). In contrast to most of existing methods, MMM deals with such an issue in the viewpoint of anatomy. It first automatically segments the input face by localizing the corresponding points around each muscular region of the reference face using Iterative Closest Normal Pattern (ICNP). A set of shape features of multiple differential quantities, including coordinates, normals and shape index values, are then extracted to describe the geometry deformation of each segmented region. Therefore, MMM tends to combine both the advantages of the model based techniques as well as the feature based ones. Meanwhile, we analyze the importance of these muscular areas, and a score level fusion strategy which optimizes the weights of the muscular areas by using a Genetic Algorithm (GA) is proposed in the learning step. The muscular areas with their optimal weights are finally combined to predict the expression label. The experiments are carried out on the BU-3DFE database, and the results clearly demonstrate the effectiveness of the proposed method.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Berretti, S., Bimbo, A.D., Pala, P., Amor, B.B., Daoudi, M.: A set of selected sift features for 3D facial expression recognition. In: ICPR (2010)
Gong, B., Wang, Y., Liu, J., Tang, X.: Automatic facial expression recognition on a single 3D face by exploring shape deformation. ACM MM (2009)
Hao, T., Huang, T.S.: 3D facial expression recognition based on automatically selected features. In: CVPRW (2008)
Klassen, E., Srivastava, A.: Geodesics between 3D closed curves using path-straightening. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006, Part I. LNCS, vol. 3951, pp. 95–106. Springer, Heidelberg (2006)
Lemaire, P., Amor, B.B., Ardabilian, M., Chen, L., Daoudi, M.: Fully automatic 3D facial expression recognition using a region-based approach. J-HGBU (2011)
Li, H., Jean-Marie, M., Chen, L.: 3D facial expression recognition based on histograms of surface differential quantities. ACIVS (2011)
Mohammadzade, H., Hatzinakos, D.: Iterative closest normal point for 3D face recognition. IEEE TPAMI (2013)
Mpiperis, I., Malassiotis, S., Strintzis, M.G.: Bilinear models for 3D face and facial expression recognition. IEEE TIFS (2008)
Nair, P., Cavallaro, A.: 3D face detection landmark localization and registration using a point distribution model. IEEE TMM (2009)
Soyel, H., Demirel, H.: Facial expression recognition using 3D facial feature distances. ICIAR (2007)
Szeptycki, P., Ardabilian, M., Chen, L.: A coarse-to-fine curvature analysis-based rotation invariant 3D face landmarking. In: BTAS (2009)
Fang, T., Zhao, X., Ocegueda, O., Shah, S.K., Kakadiaris, I.A.: 3D facial expression recognition: A perspective on promises and challenges. In: FG (2011)
Wang, J., Yin, L., Wei, X., Sun, Y.: 3D facial expression recognition based on primitive surface feature distribution. In: CVPR (2006)
Yin, L., Wei, X., Longo, P., Bhuvanesh, A.: Analyzing facial expressions using intensity-variant 3D data for human computer interaction. In: ICPR (2006)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Zhen, Q., Huang, D., Wang, Y., Chen, L. (2015). Muscular Movement Model Based Automatic 3D Facial Expression Recognition. In: He, X., Luo, S., Tao, D., Xu, C., Yang, J., Hasan, M.A. (eds) MultiMedia Modeling. MMM 2015. Lecture Notes in Computer Science, vol 8935. Springer, Cham. https://doi.org/10.1007/978-3-319-14445-0_45
Download citation
DOI: https://doi.org/10.1007/978-3-319-14445-0_45
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-14444-3
Online ISBN: 978-3-319-14445-0
eBook Packages: Computer ScienceComputer Science (R0)