Skip to main content

A Coarse-to-Fine Classification Scheme for Facial Expression Recognition

  • Conference paper
Book cover Image Analysis and Recognition (ICIAR 2004)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 3212))

Included in the following conference series:

Abstract

In this paper, a coarse-to-fine classification scheme is used to recognize facial expressions (angry, disgust, fear, happiness, neutral, sadness and surprise) of novel expressers from static images. In the coarse stage, the seven-class problem is reduced to a two-class one as follows: First, seven model vectors are produced, corresponding to the seven basic facial expressions. Then, distances from each model vector to the feature vector of a testing sample are calculated. Finally, two of the seven basic expression classes are selected as the testing sample’s expression candidates (candidate pair). In the fine classification stage, a K-nearest neighbor classifier fulfils final classification. Experimental results on the JAFFE database demonstrate an average recognition rate of 77% for novel expressers, which outperforms the reported results on the same database.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Pantic, M., Rothkrantz, L.J.M.: Automatic analysis of facial expressions: the state of the art. IEEE Transactions on Pattern Analysis and Machine Intelligence 22, 1424–1445 (2000)

    Article  Google Scholar 

  2. Fasel, B., Luettin, J.: Automatic facial expression analysis: A survey. Pattern Recognition 36, 259–275 (2003)

    Article  MATH  Google Scholar 

  3. Fellenz, W., Taylor, J., Tsapatsoulis, N., Kollias, S.: Comparing template-based, featurebased and supervised classification of facial expression from static images. Computational Intelligence and Applications (1999)

    Google Scholar 

  4. Lyons, M., Budynek, J., Akamastu, S.: Automatic classification of single facial images. IEEE Trans. Pattern Analysis and Machine Intelligence 21, 1357–1362 (1999)

    Article  Google Scholar 

  5. Zhang, Z.: Feature-based facial expression recognition: Sensitivity analysis and experiment with a multi-layer perceptron. Pattern Recognition and Artificial Intelligence 13, 893–911 (1999)

    Article  Google Scholar 

  6. Zhang, Z., Lyons, M., Schuster, M., Akamatsu, S.: Comparison between geometry-based and Garbor-wavelet-based facial expression recognition using multi-layer perceptron. In: Third International Conference on Automatic Face and Gesture Recognition, pp. 454–459 (1998)

    Google Scholar 

  7. Guo, G.D., Dyer, C.R.: Simultaneous feature selection and classifier training via linear programming: A case study for face expression recognition. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 346–352 (2003)

    Google Scholar 

  8. Buciu, I., Kotropoulos, C., Pitas, I.: ICA and gabor representation for facial expression recognition. In: International Conference on Image Processing, pp. 855–858 (2003)

    Google Scholar 

  9. Fasel, B.: Head-pose invariant facial expression recognition using convolutional neural networks. In: Fourth IEEE Conference on Multimodal Interfaces, pp. 529–534 (2002)

    Google Scholar 

  10. Gargesha, M., Kuchi, P.: Facial expression recognition using artificial neural networks. IEEE 511: Artificial Neural Computation Systems (2002)

    Google Scholar 

  11. Ojala, T., Pietikäinen, M., Mäenpää, T.: Multiresolution gray-scale and rotation invariant texture classification with Local Binary Patterns. IEEE Transactions on Pattern Analysis and Machine Intelligence 24, 971–987 (2002)

    Article  Google Scholar 

  12. Ahonen, T., Hadid, A., Pietikäinen, M.: Face recognition with local binary patterns. In: 8th European Conference on Computer Vision, pp. 469–481 (2004)

    Google Scholar 

  13. Lyons, M., Akamastu, S., Kamachi, M., Gyoba, J.: Coding facial expressions with Gabor wavelets. In: Third IEEE Conference on Face and Gesture Recognition, pp. 200–205 (1998)

    Google Scholar 

  14. Bolme, D., Teixeira, M., Beveridge, J., Draper, B.: The CSU face identification evaluation system user’s guide: its purpose, feature and structure. In: Third International Conference on Computer Vision Systems, pp. 304–313 (2003)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2004 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Feng, X., Hadid, A., Pietikäinen, M. (2004). A Coarse-to-Fine Classification Scheme for Facial Expression Recognition. In: Campilho, A., Kamel, M. (eds) Image Analysis and Recognition. ICIAR 2004. Lecture Notes in Computer Science, vol 3212. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-30126-4_81

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-30126-4_81

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-23240-7

  • Online ISBN: 978-3-540-30126-4

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics