Abstract
This paper focuses on improving facial affect recognition, which is a fundamental aspect of social cognition. This is an important issue, as deficits in social cognition influence the functionality and quality of life of patients with brain disorders. In this regard, a proposal for designing avatar-based therapies dedicated to impaired patients is introduced. In addition, the validation of the tool by expert therapists is presented.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Abirached, B., Zhang, Y., Aggarwal, J.K., Fernandes, T., Carlos, J., Orvalho, V.: Improving communication skills of children with ASDs through interaction with virtual characters. In: IEEE 1st International Conference on Serious Games and Applications for Health, pp. 3493–3502. IEEE (2011)
Baron-Cohen, S., Wheelwright, S., Skinner, R., Martin, J., Clubley, E.: The autism-spectrum quotient (AQ): evidence from Asperger syndrome/high-functioning autism, malesand females, scientists and mathematicians. J. Autism Dev. Disord. 31(1), 5–17 (2001)
Beer, J.M., Fisk, A.D., Rogers, W.A.: Emotion recognition of virtual agents facial expressions: the effects of age and emotion intensity. In: Proceedings of the Human Factors and Ergonomics Society, vol. 53, No. 2, pp. 131–135 (2009)
Brothers, L.: The neural basis of primate social communication. Motiv. Emot. 14(2), 81–91 (1990)
Ekman, P.: Universals and cultural differences in facial expressions of emotion. In: Nebraska Symposium on Motivation, pp. 207–282. University of Nebraska Press, Lincoln (1972)
Fernández-Caballero, A., Martínez-Rodrigo, A., Pastor, J.M., Castillo, J.C., Lozano-Monasor, E., López, M.T., Zangr’oniz, R., Latorre, J.M., Fernández-Sotos, A.: Smart environment architecture for emotion detection and regulation. J. Biomed. Inf. 64, 55–73 (2016)
Fernández-Caballero, A., Navarro, E., Fernández-Sotos, P., González, P., Ricarte, J.J., Latorre, J.M., Rodriguez-Jimenez, R.: Human-avatar symbiosis for the treatment of auditory verbal hallucinations in schizophrenia through virtual/augmented reality and brain-computer interfaces. Front. Neuroinformatics 11, 64 (2017)
García-Sánchez, M., Teruel, M.A., Navarro, E., González, P., Fernández-Caballero, A.: A distributed tool to perform dynamic therapies for social cognitive deficit through avatars. In: Ubiquitous Computing and Ambient Intelligence, pp. 731–741. Springer, Cham (2017)
Garrido, M.V., Lopes, D., Prada, M., Rodrigues, D., Jerónimo, R., Mourão, R.P.: The many faces of a face: comparing stills and videos of facial expressions in eight dimensions (SAVE database). Behav. Res. Methods 49(4), 1343–1360 (2016)
Gottesman, I.I.: Schizophrenia Genesis: The Origins of Madness. WH Freeman/Times Books/Henry Holt & Co., New York City (1991)
Green, M.F., Penn, D.L., Bentall, R., Carpenter, W.T., Gaebel, W., Gur, R.C., Kring, A.M., Park, S., Silverstein, S.M., Heinssen, R.: Social cognition in schizophrenia: an NIMH workshop on definitions, assessment, and research opportunities. Schizophr. Bull. 34(6), 1211–1220 (2008)
Lahera, G., Ruiz-Murugarren, S., Iglesias, P., Ruiz-Bennasar, C., Herrería, E., Montes, J.M., Fernández-Liria, A.: Social cognition and global functioning in bipolar disorder. J. Nerv. Ment. Dis. 200(2), 135–141 (2012)
Pinkham, A.E., Penn, D.L., Green, M.F., Buck, B., Healey, K., Harvey, P.D.: The social cognition psychometric evaluation study: results of the expert survey and RAND panel. Schizophr. Bull. 40(4), 813–823 (2014)
Pinkham, A.E., Penn, D.L., Green, M.F., Harvey, P.D.: Social cognition psychometric evaluation: results of the initial psychometric study. Schizophr. Bull. 42(2), 494–504 (2016)
Roark, D.A., Barrett, S.E., Spence, M.J., Abdi, H., O’Toole, A.J.: Psychological and neural perspectives on the role of motion in face recognition. Behav. Cogn. Neurosci. Rev. 2(1), 15–46 (2003)
Rosenberg, H., McDonald, S., Dethier, M., Kessels, R.P., Westbrook, R.F.: Facial emotion recognition deficits following moderatesevere traumatic brain injury (TBI): Re-examining the valence effect and the role of emotion intensity. J. Int. Neuropsychol. Soc. 20(10), 994–1003 (2014)
Tracy, J.L., Randles, D., Steckler, C.M.: The nonverbal communication of emotions. Curr. Opin. Behav. Sci. 3, 25–30 (2015)
Acknowledgments
This work was partially supported by Spanish Ministerio de Economía, Industria y Competitividad, Agencia Estatal de Investigación (AEI)/European Regional Development Fund under EmoBioFeedback (DPI2016-80894-R), HA-SYMBIOSIS (TIN2015-72931-EXP) and Vi-SMARt (TIN2016-79100-R) grants, and by the Centro de Investigación Biomédica en Red de Salud Mental (CIBERSAM) of the Instituto de Salud Carlos III.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
García, A.S., Navarro, E., Fernández-Caballero, A., González, P. (2019). Towards the Design of Avatar-Based Therapies for Enhancing Facial Affect Recognition. In: Novais, P., et al. Ambient Intelligence – Software and Applications –, 9th International Symposium on Ambient Intelligence. ISAmI2018 2018. Advances in Intelligent Systems and Computing, vol 806. Springer, Cham. https://doi.org/10.1007/978-3-030-01746-0_36
Download citation
DOI: https://doi.org/10.1007/978-3-030-01746-0_36
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-01745-3
Online ISBN: 978-3-030-01746-0
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)