Skip to main content

A Dense Deformation Field for Facial Expression Analysis in Dynamic Sequences of 3D Scans

  • Conference paper
  • 1443 Accesses

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 8212))

Abstract

In this paper, we present a fully automatic approach for identity-independent facial expression recognition from 3D video sequences. Towards this goal, we propose a novel approach to extract a dense scalar field that represents the deformations between faces conveying different expressions. We extract relevant features from this deformation field using LDA and then train a dynamic model on these features using HMM. Experiments conducted on BU-4DFE dataset following state-of-the-art settings show the effectiveness of the proposed approach.

This work is supported by the French Research Agency (ANR) through the 3D Face Analyzer project under the contract ANR 2010 INTB 0301 01.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Ekman, P.: Universals and cultural differences in facial expressions of emotion. In: Proc. Nebraska Symposium on Motivation, Lincoln, NE, vol. 19, pp. 207–283 (1972)

    Google Scholar 

  2. Zeng, Z., Pantic, M., Roisman, G., Huang, T.: A survey of affect recognition methods: Audio, visual, and spontaneous expressions. IEEE Transactions on Pattern Analysis and Machine Intelligence 31, 39–58 (2009)

    Article  Google Scholar 

  3. Yin, L., Wei, X., Sun, Y., Wang, J., Rosato, M.: A 3D facial expression database for facial behavior research. In: Proc. IEEE Int. Conf. on Automatic Face and Gesture Recognition, Southampton, UK, pp. 211–216 (2006)

    Google Scholar 

  4. Savran, A., Alyüz, N., Dibeklioğlu, H., Çeliktutan, O., Gökberk, B., Sankur, B., Akarun, L.: Bosphorus database for 3D face analysis. In: Schouten, B., Juul, N.C., Drygajlo, A., Tistarelli, M. (eds.) BIOID 2008. LNCS, vol. 5372, pp. 47–56. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

  5. Yin, L., Chen, X., Sun, Y., Worm, T., Reale, M.: A high-resolution 3D dynamic facial expression database. In: Int. Conf. on Automatic Face and Gesture Recognition (FGR 2008), Amsterdam, The Netherlands, pp. 1–6 (2008)

    Google Scholar 

  6. Li, Y., Mian, A., Lu, W., Krishna, A.: Using kinect for face recognition under varying poses, expressions, illumination and disguise. In: Proc. IEEE Workshop on Applications of Computer Vision, Tampa, FL, pp. 186–192 (2013)

    Google Scholar 

  7. Benedikt, L., Kajic, V., Cosker, D., Rosin, P., Marshall, D.: Facial dynamics in biometric identification. In: Proc. British Machine Vision Conference, Leeds, UK, pp. 1–10 (2008)

    Google Scholar 

  8. Benedikt, L., Cosker, D., Rosin, P.L., Marshall, D.: Assessing the uniqueness and permanence of facial actions for use in biometric applications. IEEE Transactions on Systems, Man and Cybernetics - Part A 40, 449–460 (2010)

    Article  Google Scholar 

  9. Sun, Y., Yin, L.: Facial expression recognition based on 3D dynamic range model sequences. In: Proc. Eur. Conf. on Computer Vision, Marseille, France, pp. 58–71 (2008)

    Google Scholar 

  10. Sandbach, G., Zafeiriou, S., Pantic, M., Rueckert, D.: A dynamic approach to the recognition of 3D facial expressions and their temporal models. In: IEEE Conf. on Automatic Face and Gesture Recognition, Santa Barbara, CA, pp. 406–413 (2011)

    Google Scholar 

  11. Le, V., Tang, H., Huang, T.S.: Expression recognition from 3D dynamic faces using robust spatio-temporal shape features. In: IEEE Conference on Automatic Face and Gesture Recognition, Santa Barbara, CA, pp. 414–421 (2011)

    Google Scholar 

  12. Srivastava, A., Klassen, E., Joshi, S.H., Jermyn, I.H.: Shape analysis of elastic curves in euclidean spaces. IEEE Transactions on Pattern Analysis and Machine Intelligence 33, 1415–1428 (2011)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer International Publishing Switzerland

About this paper

Cite this paper

Drira, H., Ben Amor, B., Daoudi, M., Berretti, S. (2013). A Dense Deformation Field for Facial Expression Analysis in Dynamic Sequences of 3D Scans. In: Salah, A.A., Hung, H., Aran, O., Gunes, H. (eds) Human Behavior Understanding. HBU 2013. Lecture Notes in Computer Science, vol 8212. Springer, Cham. https://doi.org/10.1007/978-3-319-02714-2_13

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-02714-2_13

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-02713-5

  • Online ISBN: 978-3-319-02714-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics