Skip to main content
SpringerLink
Log in

Emotion Recognition in Children with Autism Spectrum Disorder Using Convolutional Neural Networks

  • Conference paper
  • First Online:
Trends and Applications in Information Systems and Technologies (WorldCIST 2021)

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 1365))

Included in the following conference series:

Abstract

Autism Spectrum Disorder (ASD) is a neurodevelopmental disorder, and it is defined as the persistent difficulty in maturing the socialization process. By applying different therapies, health professionals have made advances that promise to improve patients’ conditions. Taking advantage of technologies like Artificial Intelligence (AI) techniques, improvements in therapies have been obtained. This article proposes creating a smart mirror to recognize five basic emotions: Angry, Fear, Sad, Happy, and neutral. The above is based on Convolutional Neural Networks (CNN), which can support therapies performed by health professionals to children with ASD.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Wainer, A.L., Ingersoll, B.R.: The use of innovative computer technology for teaching social communication to individuals with autism spectrum disorders. Res. Autism Spectr. Disord. 5(1), 96–107 (2011)

    Article  Google Scholar 

  2. Adolphs, R.: Neural systems for recognizing emotion. Curr. Opin. Neurobiol. 12(2), 169–177 (2002)

    Article  Google Scholar 

  3. Ekman, P.: An argument for basic emotions. Cogn. Emot. 6(3), 169–200 (1992)

    Article  Google Scholar 

  4. Wang, A.T., Dapretto, M., Hariri, A.R., Sigman, M., Bookheimer, S.Y.: Neural correlates of facial affect processing in children and adolescents with autism spectrum disorder. J. Am. Acad. Child Adolesc. Psychiatry 43(4), 481–490 (2004)

    Article  Google Scholar 

  5. American Psychiatric Association: Diagnostic and Statistical Manual of Mental Disorders (DSM-5®). American Psychiatric Pub. (2013)

    Google Scholar 

  6. Wieckowski, A.T., Flynn, L.T., Richey, J.A., Gracanin, D., White, S.W.: Measuring change in facial emotion recognition in individuals with autism spectrum disorder: a systematic review. Autism 24(7), 1607–1628 (2020)

    Article  Google Scholar 

  7. Abirached, B., et al.: Improving communication skills of children with ASDs through interaction with virtual characters. In: 1st International Conference on Serious Games and Applications for Health (SeGAH) Proceedings, pp. 1–4 (2011)

    Google Scholar 

  8. Pavez, R., Diaz, J., Vega, D.: Emotion recognition in children with ASD using technologies: a systematic mapping study. In: 38th International Conference of the Chilean Computer Science Society (SCCC) Proceedings (2019). https://doi.org/10.1109/sccc49216.2019.8966449

  9. Gu, J., et al.: Recent advances in convolutional neural networks. Pattern Recognit. 77, 354–377 (2018)

    Article  Google Scholar 

  10. Bisong, E.: What is deep learning? Building machine learning and deep learning models on Google cloud platform, pp. 327–329 (2019). https://doi.org/10.1007/978-1-4842-4470-8_27

  11. Tian, S., Yang, W., Grange, J.M.L., Wang, P., Huang, W., Ye, Z.: Smart healthcare: making medical care more intelligent. Glob. Health J. 3(3), 62–65 (2019)

    Article  Google Scholar 

  12. Rogers, S.J., Bennetto, L., McEvoy, R., Pennington, B.F.: Imitation and pantomime in high-functioning adolescents with autism spectrum disorders. Child Dev. 67(5), 2060–2073 (1996)

    Article  Google Scholar 

  13. Goldsmith, T.R., LeBlanc, L.A.: Use of technology in interventions for children with autism. J. Early Intensive Behav. Intervent. 1(2), 166–178 (2004)

    Article  Google Scholar 

  14. Harrold, N., Tan, C.T., Rosser, D., Leong, T.W.: CopyMe: a portable real-time feedback expression recognition game for children. In: Proceedings of the Extended Abstracts of the 32nd Annual ACM Conference on Human Factors in Computing Systems, pp. 1195–1200, April 2014. Accessed 09 July 2019

    Google Scholar 

  15. Fan, M., Fan, J., Jin, S., Antle, A.N., Pasquier, P.: EmoStory: a game-based system supporting children’s emotional development. In: Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems, April 2018. Accessed 09 July 2019

    Google Scholar 

  16. Voss, C., et al.: Superpower glass: delivering unobtrusive real-time social cues in wearable systems. In: Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct (2016). Accessed 09 July 2019

    Google Scholar 

  17. Chu, H.-C., Tsai, W.W.-J.M., Liao, J., Chen, Y.-M.: Facial emotion recognition with transition detection for students with high-functioning autism in adaptive e-learning. Soft Comput. 22(9), 2973–2999 (2018)

    Article  Google Scholar 

  18. Fan, J., Bekele, E., Warren, Z., Sarkar, N.: EEG analysis of facial affect recognition process of individuals with ASD performance prediction leveraging social context. In: Seventh International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW) Proceedings, pp. 38–43 (2017)

    Google Scholar 

  19. Uluyagmur-Ozturk, M., et al.: ADHD and ASD classification based on emotion recognition data. In 15th IEEE International Conference on Machine Learning and Applications (ICMLA) Proceedings, pp. 810–813 (2016)

    Google Scholar 

  20. Tamil, P.S., Vyshnavi, P., Jagadish, R., Srikumar, S., Veni, S.: Emotion recognition from videos using facial expressions. In: Dash, S.S., Vijayakumar, K., Panigrahi, B.K., Das, S. (eds.) Artificial Intelligence and Evolutionary Computations in Engineering Systems, vol. 517, pp. 565–576. Springer, Singapore (2017)

    Chapter  Google Scholar 

  21. Zhao, X., Zou, J., Li, H., Dellandrea, E., Kakadiaris, I.A., Chen, L.: Automatic 2.5-D facial landmarking and emotion annotation for social interaction assistance. IEEE Trans. Cybern. 46(9), 2042–2055 (2016)

    Article  Google Scholar 

  22. Washington, P., et al.: A wearable social interaction aid for children with autism. In: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems, pp. 2348–2354 (2016). Accessed 09 July 2019

    Google Scholar 

  23. Adams, A., Robinson, P.: Expression training for complex emotions using facial expressions and head movements. In: 2015 International Conference on Affective Computing and Intelligent Interaction (ACII) Proceedings, pp. 784–786 (2015)

    Google Scholar 

  24. Lucey, P., Cohn, J.F., Kanade, T., Saragih, J., Ambadar, Z., Matthews, I.: The extended Cohn-Kanade dataset: a complete dataset for action unit and emotion-specified expression. In: 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops (2010). https://doi.org/10.1109/cvprw.2010.5543262

  25. Goodfellow, I.J., et al.: Challenges in representation learning: a report on three machine learning contests. Neural Netw. 64, 59–63 (2015)

    Article  Google Scholar 

  26. Rieffe, C., Meerum, M.T., Kotronopoulou, K.: Awareness of single and multiple emotions in high-functioning children with autism. J. Autism Dev. Disord. 37(3), 455–465 (2007)

    Article  Google Scholar 

  27. Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition (2014)

    Google Scholar 

  28. He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition (2015)

    Google Scholar 

  29. Bottou, L.: Stochastic gradient descent tricks. In: Lecture Notes in Computer Science, pp. 421–436 (2012). https://doi.org/10.1007/978-3-642-35289-8_25

  30. Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. In: Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR (2001). https://doi.org/10.1109/cvpr.2001.990517

Download references

Funding

This work was supported by the FCT – Fundação para a Ciência e a Tecnologia, I.P. [Project UIDB/05105/2020].

Author information

Authors and Affiliations

  1. Depto. Cs. de la Computación e Informática, Universidad de la Frontera, Temuco, Chile

    Rodolfo Pávez & Jaime Díaz

  2. Depto. de Sistemas e Informática, Universidad de Caldas, Manizales, Colombia

    Jeferson Arango-López

  3. Depto. Procesos Diagnósticos y Evaluación, Universidad Católica de Temuco, Temuco, Chile

    Danay Ahumada

  4. Hospital Hernán Henriquez Aravena, Temuco, Chile

    Carolina Méndez

  5. REMIT, IJP, Universidade Portucalense and IEETA, Universidade de Aveiro, Aveiro, Portugal

    Fernando Moreira

Authors
  1. Rodolfo Pávez
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jaime Díaz
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jeferson Arango-López
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Danay Ahumada
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Carolina Méndez
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Fernando Moreira
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jaime Díaz .

Editor information

Editors and Affiliations

  1. ISEG, University of Lisbon, Lisbon, Portugal

    Álvaro Rocha

  2. College of Engineering, The Ohio State University, Columbus, OH, USA

    Hojjat Adeli

  3. Institute of Data Science and Digital Technologies, Vilnius University, Vilnius, Lithuania

    Gintautas Dzemyda

  4. DCT, Universidade Portucalense, Porto, Portugal

    Fernando Moreira

  5. Department of Information Sciences, University of Sheffield, Lisbon, Portugal

    Ana Maria Ramalho Correia

Rights and permissions

Reprints and permissions

Copyright information

© 2021 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Pávez, R., Díaz, J., Arango-López, J., Ahumada, D., Méndez, C., Moreira, F. (2021). Emotion Recognition in Children with Autism Spectrum Disorder Using Convolutional Neural Networks. In: Rocha, Á., Adeli, H., Dzemyda, G., Moreira, F., Ramalho Correia, A.M. (eds) Trends and Applications in Information Systems and Technologies. WorldCIST 2021. Advances in Intelligent Systems and Computing, vol 1365. Springer, Cham. https://doi.org/10.1007/978-3-030-72657-7_56

Download citation

Publish with us

Policies and ethics

Search

Navigation