Abstract
Social cognition disorders cause important social and communicative impairments in people suffering from autism or schizophrenia, as they have difficulty recognising emotions in others and expressing their own. This paper introduces the prototype of an innovative computer-based training tool as an attempt to improve the expressiveness of facial emotions in people with socio-cognitive deficits. This tool is designed so that the therapist plans training and evaluation sessions, which are composed of several stages and adapted to each patient. In some of them, the patient learns about facial expressions using pictures while in other stages he/she proves what he/she has learnt, and the system automatically evaluates the performance. The system provides the therapist with post-therapy tools to analyse the results and the performance of the patient.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Baron-Cohen, S., Wheelwright, S., Skinner, R., Martin, J., Clubley, E.: The autism-spectrum quotient (AQ): evidence from Asperger syndrome/high-functioning autism, malesand females, scientists and mathematicians. J. Autism Dev. Disord. 31(1), 5–17 (2001)
Berggren, S., Fletcher-Watson, S., Milenkovic, N., Marschik, P.B., Bölte, S., Jonsson, U.: Emotion recognition training in autism spectrum disorder: a systematic review of challenges related to generalizability. Dev. Neurorehabilitation 1–14 (2017)
Bölte, S., Feineis-Matthews, S., Leber, S., Dierks, T., Hubl, D., Poustka, F.: The development and evaluation of a computer-based program to test and to teach the recognition of facial affect. Int. J. Circumpolar Health 61, 61–68 (2002)
Calvo, M.G., Nummenmaa, L.: Perceptual and affective mechanisms in facial expression recognition: an integrative review. Cogn. Emot. 30(6), 1081–1106 (2016)
Castillo, J.C., Castro-González, Á., Fernández-Caballero, A., Latorre, J.M., Pastor, J.M., Fernández-Sotos, A., Salichs, M.A.: Software architecture for smart emotion recognition and regulation of the ageing adult. Cogn. Comput. 8(2), 357–367 (2016)
Ekman, P.: Universals and cultural differences in facial expressions of emotion. In: Nebraska Symposium on Motivation, pp. 207—282. University of Nebraska Press (1972)
Fernández-Caballero, A., Latorre, J.M., Pastor, J.M., Fernández-Sotos, A.: Improvement of the elderly quality of life and care through smart emotion regulation. In: Pecchia, L., Chen, L.L., Nugent, C., Bravo, J. (eds.) Ambient Assisted Living and Daily Activities, pp. 348–355. Springer (2014)
Fernández-Caballero, A., Martínez-Rodrigo, A., Pastor, J.M., Castillo, J.C., Lozano-Monasor, E., López, M.T., Zangr’oniz, R., Latorre, J.M., Fernández-Sotos, A.: Smart environment architecture for emotion detection and regulation. J. Biomed. Inform. 64, 55–73 (2016)
Ginani, G.E., Pradella-Hallinan, M., Pompéia, S.: Identification of emotional expressiveness in facial photographs over 36 h of extended vigilance in healthy young men - a preliminary study. Cogn. Emot. 31(2), 339–348 (2017)
Gottesman, I.I.: Schizophrenia Genesis: The Origins of Madness. WH Freeman/Times Books/Henry Holt & Co (1991)
Kaiser, J., Crespo-Llado, M.M., Turati, C., Geangu, E.: The development of spontaneous facial responses to others’ emotions in infancy: An EMG study. Scientific Reports 7, 17500 (2017)
LaCava, P.G., Golan, O., Baron-Cohen, S., Myles, B.S.: Using assistive technology to teach emotion recognition to students with Asperger syndrome a pilot study. Remedial Spec. Educ. 28(3), 174–181 (2007)
Lozano-Monasor, E., López, M.T., Vigo-Bustos, F., Fernández-Caballero, A.: Facial expression recognition in ageing adults: from lab to ambient assisted living. J. Ambient. Intell. Humanized Comput. 8(4), 567–578 (2017)
Rosenberg, H., McDonald, S., Dethier, M., Kessels, R.P., Westbrook, R.F.: Facial emotion recognition deficits following moderate-severe traumatic brain injury (TBI): re-examining the valence effect and the role of emotion intensity. J. Int. Neuropsychol. Soc. 20(10), 994–1003 (2014)
Seidel, E.M., Habel, U., Kirschner, M., Gur, R.C., Derntl, B.: The impact of facial emotional expressions on behavioral tendencies in females and males. J. Exp. Psychology. Hum. Percept. Perform. 36(2), 500–507 (2010)
Silver, M., Oakes, P.: Evaluation of a new computer intervention to teach people with autism or Asperger syndrome to recognize and predict emotions in others. Autism 5(3), 299–316 (2001)
Walsh, J.A., Creighton, S.E., Rutherford, M.D.: Emotion perception or social cognitive complexity: What drives face processing deficits in autism spectrum disorder? J. Autism Dev. Disord. 46(2), 615–623 (2016)
Acknowledgements
This work was partially supported by Spanish Ministerio de Economía, Industria y Competitividad, Agencia Estatal de Investigación (AEI)/European Regional Development Fund under EmoBioFeedback (DPI2016-80894-R), HA-SYMBIOSIS (TIN2015-72931-EXP) and Vi-SMARt (TIN2016-79100-R) grants, and by the Centro de Investigación Biomédica en Red de Salud Mental (CIBERSAM) of the Spanish Instituto de Salud Carlos III.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
García, A.S., González, P., Fernández-Caballero, A., Navarro, E. (2019). An Innovative Tool to Get Better at Expressing Facial Emotions. In: Novais, P., et al. Ambient Intelligence – Software and Applications –, 9th International Symposium on Ambient Intelligence. ISAmI2018 2018. Advances in Intelligent Systems and Computing, vol 806. Springer, Cham. https://doi.org/10.1007/978-3-030-01746-0_34
Download citation
DOI: https://doi.org/10.1007/978-3-030-01746-0_34
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-01745-3
Online ISBN: 978-3-030-01746-0
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)