Skip to main content
Log in

A novel application of self-organizing network for facial expression recognition from radial encoded contours

  • Focus
  • Published:
Soft Computing Aims and scope Submit manuscript

Abstract

We propose an efficient algorithm for recognizing facial expressions using biologically plausible features: contours of face and its components with radial encoding strategy. A self-organizing network (SON) is applied to check the homogeneity of the encoded contours and then different classifiers, such as SON, multi-layer perceptron and K-nearest neighbor, are used for recognizing expressions from contours. Experimental results show that the recognition accuracy of our algorithm is comparable to that of other algorithms in the literature on the Japanese female facial expression database. We also apply our algorithm to Taiwanese facial expression image database to demonstrate its efficiency in recognizing facial expressions.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

References

  • Belhumeur P, Hespanha J, Kriegman D (1997) Eigenfaces vs. Fisherface: recognition using class specific linear projection. IEEE Trans Pattern Anal Mach Intell 19(7):711–720

    Article  Google Scholar 

  • Chen LF, Yen YS (2007) Taiwanese facial expression image database. Brain Mapping Labratory, Institute of Brain Science, National Yang-Ming University, Taipei. Available at http://bml.ym.edu.tw/∼download/html

  • Cootes T, Edwards G, Taylor C (2001) Active appearance models. IEEE Trans Pattern Anal Mach Intell 23(6):564–571

    Article  Google Scholar 

  • Dailey M, Cottrell G (1999) PCA Gabor for expression recognition. Institution UCSD, Number CS-629

  • Duda RO, Hart PE, Stork DG (2001) Pattern classification, 2nd edn. Wiley, New York

    Google Scholar 

  • Ekman P (1992) An argument for basic emotions. Cognit Emot 6:169–200

    Article  Google Scholar 

  • Ekman P, Friesen W (1978) Facial action coding system: a technique for the measurement of facial movement. Consulting Psychologists Press, Palo Alto

    Google Scholar 

  • Ezzat T, Poggio T (1996) Facial analysis and synthesis using image-based models. In: Second international conference on automatic face and gesture recognition, Vermont, USA, pp 116–121

  • Fasel B, Luettin J (2003) Automatic facial expression analysis: a survey. Pattern Recognit 36:259–275

    Article  MATH  Google Scholar 

  • Ganesh Murthy CNS, Venkatesh YV (1994) Efficient classification by neural networks using encoded patterns. Electron Lett 31:400–403

    Google Scholar 

  • Huang D, Xiang C, Ge SS (2007) Feature extraction for face recognition using recursive Bayesian linear discriminant. In: International symposium on image and signal processing and analysis, Istanbul, Turkey, pp 356–361

  • Kamachi M, Lyons M, Gyoba J (1998) The Japanese female facial expression (JAFFE) database. Available at http://www.kasrl.org/jaffe.html

  • Kobayashi H, Hara F (1997) Facial interaction between animated 3D face robot and human Beings. In: International conference on systems, man and cybernetics, Orlando, Florida, USA, pp 3732–3737

  • Kohonen T (1995) Self-organizing map, 2nd edn. Springer, Berlin

    Google Scholar 

  • Li C, Xu C, Gui C, Fox MD (2005) Level set evolution without reinitialization: a new variational formulation. In: IEEE computer society international conference on computer vision and pattern recognition, San Diego, USA, pp 430–436

  • Lyons M, Budynek J, Akamatsu S (1999) Automatic classification of single facial images. IEEE Trans Pattern Anal Mach Intell 21:1357–1362

    Article  Google Scholar 

  • Moller MF (1993) A scaled conjugate gradient algorithm for fast supervised learning. Neural Netw 6:525–533

    Article  Google Scholar 

  • Osher S, Sethian JA (1988) Fronts propagating with curvature-dependent speed: algorithms based on Hamilton–Jacobi formulations. J Comput Phys 79:12–49

    Article  MATH  MathSciNet  Google Scholar 

  • Riesenhuber M, Poggio T (1999) Hierarchical models of object recognition in cortex. Nat Neurosci 2(11):1019–1025

    Article  Google Scholar 

  • Shinohara Y, Otsu N (2004) Facial expression recognition using Fisher weight maps. In: Sixth IEEE international conference on automatic face and gesture recognition, Seoul, Korea, pp 499–504

  • Simon M (2005) Facial expression: a visual reference for artists. Watson-Guptill, New York

    Google Scholar 

  • Snowden R, Thompson P, Troscianko T (2006) Basic vision: an introduction to visual perception. Oxford, New York

    Google Scholar 

  • Sumengen B (2004) A Matlab toolbox implementing level set methods. In: Vision Research Lab, University of California, USA. Available at http://barissumengen.com/level_set_method.

  • Xiang C, Huang D (2006) Feature extraction using recursive cluster-based linear discriminant with application to face recognition. IEEE Trans Image Process 15(12):3824–3832

    Article  MathSciNet  Google Scholar 

  • Xiang C, Fan XA, Lee TH (2006) Face recognition using recursive Fisher linear discriminant. IEEE Trans Image Process 15(8):2097–2105

    Article  Google Scholar 

  • Zhang Z, Lyons M, Schuster M, and Akamatsu S (1998) Comparison between geometry-based and Gabor-wavelets-based facial expression recognition using multi-layer perceptron. In: Third IEEE international conference on automatic face and gesture recognition. Nara, Japan pp 454–459

  • Zheng W, Zhou X, Zou C, Zhao L (2006) Facial expression recognition using kernel canonical correlation analysis (KCCA). IEEE Trans Neural Netw 17(1):233–238

    Article  Google Scholar 

Download references

Acknowledgments

The research reported here was supported by NUS Academic Research Fund R-263-000-362-112. The authors thank Professor Teuvo Kohonen (Helsinki University of Technology) for permission to use his SOM Toolbox. The authors also gratefully acknowledge the anonymous reviewers and editors for their helpful comments to substantially improve the quality of this paper.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to C. Xiang.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Gu, W.F., Venkatesh, Y.V. & Xiang, C. A novel application of self-organizing network for facial expression recognition from radial encoded contours. Soft Comput 14, 113–122 (2010). https://doi.org/10.1007/s00500-009-0441-1

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00500-009-0441-1

Keywords

Navigation