Skip to main content

Facial Emotion Recognition with AI

  • Conference paper
  • First Online:
Human-Computer Interaction (HCI-COLLAB 2023)

Abstract

The paper presents a work with AI on using computer vision algorithms to detect human emotions in the context of the video when the user looks at different video images. This work aims to present the development of software that detects emotions by recognizing users’ facial expressions using AI algorithms and image process pipelines. The process of seeing emotions is done by evaluating users with images, which has allowed the application of computer vision algorithms that detect images according to the authors of the discipline of psychology, who propose the emotions and how they can be recognized. In this work, it has been demonstrated that it is possible to recognize emotions with the algorithms used and the development and training of the software performed from facial expressions. However, for a correct interpretation of emotions, the system must be trained in a context with more images and other complementary algorithms that allow differentiating emotions represented by facial expressions with very similar patterns to improve certainty and accuracy.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 109.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 139.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Banafa, A.: Qué es la computación afectiva? Obtenido de OpenMind BBVA (2016).https://www.bbvaopenmind.com/tecnologia/mundo-digital/que-es-la-computacion-afectiva/

  2. Darwin, C., Prodger, P.: The Expression of the Emotions in Man and Animals. Oxford University Press, Oxford (1996)

    Google Scholar 

  3. Ekman, P. Strong evidence for universals in facial expressions: a reply to Russell’s mistaken critique (1994)

    Google Scholar 

  4. Salovey, P., Mayer, J.: Emotional Intelligence. Imagin. Cogn. Pers. 9(3), 185–211 (1990)

    Article  Google Scholar 

  5. García, A.R.: La educación emocional, el autoconcepto, la autoestima y su importancia en la infancia. Estudios y propuestas socioeducativas 44, 241–257 (2013)

    Google Scholar 

  6. Russell, J.A.: A circumplex model of effect. J. Pers. Soc. Psychol. 39(6), 1161 (1980)

    Article  Google Scholar 

  7. Ekman, P.: Basic Emotions. En In Handbook of cognition and emotion, pp. 45–60 (1999)

    Google Scholar 

  8. Rusell, J. A. Reading emotions from and into faces: Resurrecting a dimensional-contextual perspective (1997)

    Google Scholar 

  9. Plutchik, R.: The nature of emotions. Am. Sci. 89(4), 334–350 (2001)

    Article  Google Scholar 

  10. Plutchik, R.E., Conte, H.R.: Circumplex models of personality and emotions. Am. Psychol. Ass. xi–484 (1997)

    Google Scholar 

  11. Bledsoe, W.W.: Man-Machine Facial Recognition: Report on a Large-Scale Experiment. Technical report PRI 22, Panoramic Research, Palo Alto, California (1966)

    Google Scholar 

  12. Schapire, R.E.: Explaining Adaboost. Empirical Inference: Festschrift in Honor of Vladimir N. Vapnik (2013)

    Google Scholar 

  13. Wang, Y.Q.: An analysis of the Viola-Jones face detection algorithm. Image Process. Line 4, 128–148 (2014). https://doi.org/10.5201/ipol.2014.104

    Article  Google Scholar 

  14. Krizhevsky, A., Sutskever, I., Hinton, G.E.: ImageNet classification with deep convolutional neural networks. In: Advances in Neural Information Processing Systems, vol. 25(2) (2017). https://doi.org/10.1145/3065386

  15. Simonyan, K., Zisserman, A.: Very deep convolutional neural networks for large-scale image recognition (2014). https://arxiv.org/pdf/1409.1556.pdf%E3%80%82

  16. Sotil, D. A. RPubs. Obtenido de (2022). https://rpubs.com/

  17. Mathworks (2022).https://www.mathworks.com/help/images/integral-image.html

  18. Thomas, J.R., Nelson, J.K., Silverman, S.J. Research Methods in Physical. Human Kinetics, 5th ed (2005)

    Google Scholar 

  19. Hernández, Sampieri, R., Fernández, C., Baptista, L.C.: Metodología de la Investigación. Chile: McGraw Hill (2003)

    Google Scholar 

  20. Albaladejo, X., Díaz, J.R., Quesada, A.X., Iglesias, J.: proyectos agiles.org. Obtenido de (2021).https://proyectosagiles.org/pm-partners

  21. Zhang, K., Zhang, Z., Li, Z., Qiao, Y.: Joint face detection and alignment using multitask cascaded convolutional networks. IEEE Signal Process. Lett. 23(10), 1499–1503 (2016)

    Article  Google Scholar 

  22. Centeno, I. D. P. MTCNN face detection implementation for TensorFlow, as a pip package (2021). https://github.com/ipazc/mtcnn

  23. Chollet, F. Xception: Deep learning with depthwise separable convolutions. Comput. Vis. Pattern Recogn. (2016). https://doi.org/10.1109/CVPR.2017.195

  24. M., S. FER - 2013. Obtenido de (2019). https://www.kaggle.com/

  25. Choi, D., Song, B.: Facial micro-expression recognition using two-dimensional landmark feature maps. IEEE Access 8, 121549–121563 (2020). https://doi.org/10.1109/ACCESS.2020.3006958

    Article  Google Scholar 

  26. Park, S., Kim, B., Chilamkurti, N.: A robust facial expression recognition algorithm based on multi-rate feature fusion scheme. Sensors (Basel, Switzerland) 21, 6954 (2021). https://doi.org/10.3390/s21216954

    Article  PubMed  Google Scholar 

  27. Abdel-Hamid, L.: An efficient machine learning-based emotional valence recognition approach towards wearable EEG. Sensors (Basel, Switzerland) 23, 1255 (2023). https://doi.org/10.3390/s23031255

    Article  PubMed  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Gabriel M. Ramírez V. .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Ballesteros, J.A., Ramírez V., G., Moreira, F., Solano, A., Pelaez, C.A. (2024). Facial Emotion Recognition with AI. In: Ruiz, P.H., Agredo-Delgado, V., Mon, A. (eds) Human-Computer Interaction. HCI-COLLAB 2023. Communications in Computer and Information Science, vol 1877. Springer, Cham. https://doi.org/10.1007/978-3-031-57982-0_14

Download citation

Publish with us

Policies and ethics