Skip to main content
Springer Nature Link
Log in

Facial Expression Recognition from Webcam Based on Active Shape Models and Support Vector Machines

  • Conference paper
Ambient Assisted Living and Daily Activities (IWAAL 2014)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 8868))

Included in the following conference series:

  • 2973 Accesses

Abstract

This paper introduces an application that uses a webcam and aims to recognize emotions of an elderly from his/her facial expression in real-time. Six basic emotions (Happiness, Sadness, Anger, Fear, Disgust and Surprise) as well as a Neutral state are distinguished. Active shape models are applied for feature extraction, the Cohn-Kanade, JAFFE and MMI databases are used for training, and support vector machines (ν-SVM) are employed for facial expression classification. In the future, the application is thought to be the starting point to enhance the mood of the elderly by external stimuli.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. Gascueña, J.M., Castillo, J.C., Navarro, E., Fernández-Caballero, A.: Engineering the development of systems for multisensory monitoring and activity interpretation. International Journal of Systems Science 45(4), 728–740 (2014)

    Article  MATH  Google Scholar 

  2. Alugupally, N., Samal, A., Marx, D., Bhatia, S.: Analysis of landmarks in recognition of face expressions. Pattern Recognition and Image Analysis 21(4), 681–693 (2011)

    Article  Google Scholar 

  3. Maglogiannis, I., Vouyioukas, D., Aggelopoulos, C.: Face detection and recognition of natural human emotion using Markov random fields. Personal and Ubiquitous Computing 13(1), 95–101 (2009)

    Article  Google Scholar 

  4. Wang, L., Gu, X., Wang, Y., Zhang, L.: Happy-sad expression recognition using emotion geometry feature and support vector machine. In: Köppen, M., Kasabov, N., Coghill, G. (eds.) ICONIP 2008, Part II. LNCS, vol. 5507, pp. 535–542. Springer, Heidelberg (2009)

    Chapter  Google Scholar 

  5. Zhang, L., Tjondronegoro, D.W., Chandran, V.: Discovering the best feature extraction and selection algorithms for spontaneous facial expression recognition. In: Proc. 2012 IEEE Conference on Multimedia and Expo, pp. 1027–1032 (2012)

    Google Scholar 

  6. Cootes, T.F., Taylor, C.J., Coper, D.H., Graham, J.: Active shape models - their training and application. Computer Vision and Image Understanding 61(1), 38–59 (1996)

    Article  Google Scholar 

  7. Cortes, C., Vapnik, V.: Support-vector networks. Machine Learning 20(3), 273–297 (1995)

    MATH  Google Scholar 

  8. Chang, Y., Hu, C., Feris, R., Turk, M.: Manifold based analysis of facial expression. Image and Vision Computing 24(6), 605–614 (2006)

    Article  Google Scholar 

  9. Pantic, M., Bartlett, M.: Machine analysis of facial expressions. In: Face Recognition, ch. 20, pp. 978–973 (2007) ISBN 978-3-902613-03-5

    Google Scholar 

  10. Hsieh, C.-C., Jiang, M.-K.: A facial expression classification system based on active shape model and support vector machine. In: Proc. 2011 International Symposium on Computer Science and Society, pp. 311–314 (2011)

    Google Scholar 

  11. Wu, J., Mei, L.: A face recognition algorithm based on ASM and Gabor features of key points. In: Proceedings of SPIE 8768, Article number 87686L (2013)

    Google Scholar 

  12. Wan, C., Tian, Y., Liu, S.: Facial expression recognition in video sequences. In: Proc. 10th World Congress on Intelligent Control and Automation, pp. 4766–4770 (2012)

    Google Scholar 

  13. Gang, L., Xiao-hua, L., Ji-liu, Z., Xiao-gang, G.: Geometric feature based facial expression recognition using multiclass support vector machines. In: Proc. 2009 IEEE International Conference on Granular Computing, pp. 318–321 (2009)

    Google Scholar 

  14. Zhao, X., Zhang, H., Xu, Z.: Expression recognition by extracting facial features of shapes and textures. Journal of Computational Information Systems 8(8), 3377–3384 (2012)

    Google Scholar 

  15. Cruz, A., Bhanu, B.: A biologically inspired approach for fusing facial expression and appearance for emotion recognition. In: Proc. 19th IEEE International Conference on Image Processing, pp. 2625–2628 (2012)

    Google Scholar 

  16. Zhou, Q., Wang, X.: Real-time facial expression recognition system based-on geometric features. Lecture Notes in Electrical Engineering, vol. 212, pp. 449–456 (2013)

    Google Scholar 

  17. Ekman, P., Friesen, W.V., Hager, J.C.: Facial Action Coding System (FACS) (2002), http://face-and-emotion.com/dataface/facs/new_version.jsp

  18. Wei, Y.: Research on facial expression recognition and synthesis. Master Thesis. Department of Computer Science and Technology, Nanjing University (2009), http://code.google.com/p/asmlibrary

  19. Stegmann, M.B.: Analysis and segmentation of face images using point annotations and linear subspace techniques. Technical Report IMM-REP-2002-22 (2002), http://www2.imm.dtu.dk/pubdb/views/publication_details.php?id=922

  20. Cootes, T.F., Cristinacce, D., Babalola, K.: BioID face database (2005), http://www.bioid.com/index.php?q=downloads/software/bioid-face-database.html

  21. Chan, C.H.: The XM2VTS Database (2000), http://www.ee.surrey.ac.uk/CVSSP/xm2vtsdb/

  22. Chang, C.C., Lin, C.J.: LIBSVM: a library for support vector machines. ACM Transactions on Intelligent Systems and Technology 2(27), 1–27 (2011)

    Article  Google Scholar 

  23. Wu, T.F., Lin, C.J., Wang, R.C.: Probability estimates for multi-class classification by pairwise coupling. Journal of Machine Learning Research 5, 975–1005 (2004)

    MATH  Google Scholar 

  24. Lyons, M.J., Kamachi, M., Gyoba, J.: Japanese Female Facial Expressions (JAFFE). Database of Digital Images (1997), http://www.kasrl.org/jaffe_info.html

  25. Valstar, M.F., Pantic, M.: Induced disgust, happiness and surprise: an addition to the IMM facial expression database. In: Proc. International Conference on Language Resources and Evaluation, Workshop on Emotion, pp. 65–70 (2010)

    Google Scholar 

  26. Kanade, T., Cohn, J., Tian, Y.L.: Comprehensive database for facial expression analysis. In: Proc. 4th IEEE International Conference on Automatic Face and Gesture Recognition, pp. 46–53 (2000)

    Google Scholar 

  27. Lucey, P., Cohn, J.F., Kanade, T., Saragih, J., Ambadar, Z., Matthews, I.: The Extended Cohn-Kanade Dataset (CK+): A complete facial expression dataset for action unit and emotion-specified expression. In: Proc. 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, pp. 94–101 (2010)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Instituto de Investigación en Informática de Albacete (I3A), 02071, Albacete, Spain

    Elena Lozano-Monasor, María T. López & Antonio Fernández-Caballero

  2. Departamento de Sistemas Informáticos, Universidad de Castilla-La Mancha, 02071, Albacete, Spain

    María T. López, Antonio Fernández-Caballero & Francisco Vigo-Bustos

Authors
  1. Elena Lozano-Monasor
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. María T. López
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Antonio Fernández-Caballero
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Francisco Vigo-Bustos
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. School of Engineering, University of Warwick, CV4 7AL, Coventry, UK

    Leandro Pecchia

  2. School of Computer Science and Informatics, De Montfort University, The Gateway, LE1 9BH, Leicester, UK

    Liming Luke Chen

  3. Institute, School of Computing and Mathematics, University of Ulster, Computer Science Research, Jordanstown Campus, Shore Road, BT37 0QB, Newtownabbey, UK

    Chris Nugent

  4. Escuela Superior de Informática, Castilla La Mancha University, Paseo de la Universidad 4, 13071, Ciudad, Real, Spain

    José Bravo

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer International Publishing Switzerland

About this paper

Cite this paper

Lozano-Monasor, E., López, M.T., Fernández-Caballero, A., Vigo-Bustos, F. (2014). Facial Expression Recognition from Webcam Based on Active Shape Models and Support Vector Machines. In: Pecchia, L., Chen, L.L., Nugent, C., Bravo, J. (eds) Ambient Assisted Living and Daily Activities. IWAAL 2014. Lecture Notes in Computer Science, vol 8868. Springer, Cham. https://doi.org/10.1007/978-3-319-13105-4_23

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-13105-4_23

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-13104-7

  • Online ISBN: 978-3-319-13105-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics