research-article

EmoTEA: Teaching Children with Autism Spectrum Disorder to Identify and Express Emotions

Authors:

Jose Maria Garcia-Garcia,

María del Mar Cabañero,

Victor M. R. Penichet,

María D. LozanoAuthors Info & Claims

Interacción '19: Proceedings of the XX International Conference on Human Computer Interaction

Article No.: 36, Pages 1 - 8

https://doi.org/10.1145/3335595.3335639

Published: 25 June 2019 Publication History

Abstract

In this paper we present a novel software application developed as a serious game to teach children with Autism Spectrum Disorder (ASD) to identify and express emotions. The system incorporates cutting-edge technology to support innovative interaction mechanisms based on Tangible User Interfaces (TUI) and emotion recognition based on facial expressions. This way, children interact with the system in a natural way just by grasping objects with their hands and using their faces. The system has been assessed in the premises of an association with children with ASD. The outcomes of the evaluation are very positive showing the validity of the proposal.

References

[1]

Affectiva. (2018). Affectiva. Emotion Recognition Software and Analysis. Retrieved from: https://www.affectiva.com/

[2]

Autism Spectrum Disorder, 299.00 (F84.0). In: American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition. American Psychiatric Publishing; 2013

[3]

Bondy, A. S., & Frost, L. A. (1994). The Picture Exchange Communication System. Focus on Autistic Behavior, 9(3), 1--19.

[4]

Brooke, J. (1996). "SUS-A quick and dirty usability scale" in Usability evaluation in industry, 1st ed, Jordan, Patrick W., Thomas, Bruce, Weerdmeester, Bernard A and McClelland, Ian L. Ed. Great Britain: Taylor & Francis, 1996, ch. 21, pp. 189--194.

[5]

Daniels, A. M., & Mandell, D. S. (2014). Explaining differences in age at autism spectrum disorder diagnosis: A critical review. Autism, 18(5), 583--597.

[6]

Djaouti, D., Álvarez, J., & Jessel, J.-P. (2011). Classifying Serious Games: the G/P/S model.

[7]

Ekman, P. (1999). Basic emotions. Handbook of cognition and emotion, 45--60.

[8]

Ekman, P., & Friesen, W. V. (1976). Measuring facial movement. Environmental psychology and nonverbal behavior, 1(1), 56--75.

[9]

Ekman, P; Oster, H. (1979). Facial Expressions of Emotion. Annual Review of Psychology, 527--554.

[10]

Garcia-Garcia, J. M., Penichet, V. M. R., & Lozano, M. D. (2017). Emotion detection: a technology review. In Proceedings of the XVIII International Conference on Human Computer Interaction - Interacción '17 (pp. 1--8). New York, New York, USA: ACM Press.

Digital Library

[11]

Gotham, K., Pickles, A., & Lord, C. (2012). Trajectories of autism severity in children using standardized ADOS scores. Pediatrics, 130(5), e1278--84.

[12]

Granic, I., Lobel, A., & Engels, R. C. (2014). The benefits of playing video games. American psychologist, 69(1), 66.

[13]

Jack, R. E., Garrod, O. G. B., & Schyns, P. G. (2014). Dynamic facial expressions of emotion transmit an evolving hierarchy of signals over time. Current Biology, 24(2), 187--192.

[14]

Kleinginna, P. R. J., & Kleinginna, A. M. (1981). A Categorized List of Emotion Definitions, with Suggestions for a Consensual Definition. Motivation and Emotion, 5(3), 263--291.

[15]

Lord, C., Risi, S., DiLavore, P. S., Shulman, C., Thurm, A., & Pickles, A. (2006). Autism From 2 to 9 Years of Age. Archives of General Psychiatry, 63(6), 694.

[16]

Marshal, P. (2007). Do tangible interfaces enhance learning? In Proceedings of the 1st international conference on Tangible and embedded interaction, Baton Rouge, Louisiana, February 2007. PP: 163--170.

Digital Library

[17]

Picard, R. W. (1995). Affective Computing. MIT Press, (321), 1--16.

[18]

Plutchik, R. (2001). The Nature of Emotions: Human emotions have deep evolutionary roots, a fact that may explain their complexity and provide tools for clinical practice. American Scientist. Sigma Xi, The Scientific Research Honor Society.

[19]

Psychology Today. What Is Emotional Intelligence? Retrieved from Psychology Today: https://www.psychologytoday.com/us/basics/emotional-intelligence

[20]

Rante, H., Lund, M. & Caliz, D. (2018). The Role of Tangible Interfaces in Enhancing Children's Engagement in Learning. In International Conference on Electrical Systems, Technology and Information (ICESTI 2017).

[21]

WebMD. What Are the Treatments for Autism? Retrieved from: https://www.webmd.com/brain/autism/understanding-autism-treatment

[22]

Wierzbicka, A. (1986). Human emotions: universal or culture-specific?. American anthropologist, 88(3), 584--594.

[23]

Zyda, M., 2005. From visual simulation to virtual reality to games. Computer, 38(9), 25--32.

Digital Library

[24]

Shaer, O., & Hornecker, E. (2010). Tangible User Interfaces: Past, Present, and Future Directions. Foundations and Trends® in Human-Computer Interaction, 3(1-2), 1--137.

Digital Library

Cited By

Gonzalez SAlmazán ACornejo RCaro K(2024)Following UCD and SCRUM for Designing a Virtual Environment to Support the Emotional Development of Children with AutismFollowing UCD and SCRUM for Designing a Virtual Environment to Support the Emotional Development of Children with AutismAvances en Interacción Humano-Computadora10.47756/aihc.y9i1.1809:1(257-260)Online publication date: 30-Nov-2024
https://doi.org/10.47756/aihc.y9i1.180
Almazán AGonzalez SCornejo RCaro K(2024)Design of a Virtual Assistant for Emotional Support of Children with Autism Spectrum DisorderDesign of a Virtual Assistant for Emotional Support of Children with Autism Spectrum DisorderAvances en Interacción Humano-Computadora10.47756/aihc.y9i1.1549:1(104-108)Online publication date: 30-Nov-2024
https://doi.org/10.47756/aihc.y9i1.154
Honorato NSoltiyeva AOliveira WDelabrida SHamari JAlimanova M(2024)Gameful strategies in the education of autistic children: a systematic literature review, scientometric analysis, and future research roadmapSmart Learning Environments10.1186/s40561-024-00309-611:1Online publication date: 4-Jun-2024
https://doi.org/10.1186/s40561-024-00309-6
Show More Cited By

Index Terms

EmoTEA: Teaching Children with Autism Spectrum Disorder to Identify and Express Emotions
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction techniques

Recommendations

Emotional Robot to Examine Differences in Play Patterns and Affective Response of Children with and Without ASD
HRI '16: The Eleventh ACM/IEEE International Conference on Human Robot Interaction

Robots are often employed to proactively engage children with Autism Spectrum Disorder (ASD) in well-defined physical or social activities to promote specific educational or therapeutic outcomes. However, much can also be learned by leveraging a robot's ...
Validation of Emotions as a Measure of Selective Attention in Children with Autism Spectrum Disorder
ICEIT 2020: Proceedings of the 2020 9th International Conference on Educational and Information Technology

This research studied the validation of emotions as a measure of selective attention in children with autism spectrum disorder (ASD) and their typically developing (TD) peers. Seven basic emotions such as anger, sadness, disgust, joy, surprise, fear and ...
Sexting experiences and motivations among adolescents with ADHD and ASD
Abstract
Sexting (i.e., to send and receive self-produced sexual materials) has become a common element in adolescents’ socio-sexual exploration. Although often harmless, sexting also involves the risk of abuse, and potentially more so for some ...
Highlights
- Adolescents, including those with ADHD/ASD, mainly use sexting for sexual gratification and exploration.

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

Interacción '19: Proceedings of the XX International Conference on Human Computer Interaction

June 2019

296 pages

ISBN:9781450371766

DOI:10.1145/3335595

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 25 June 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

Interacción 2019

Interacción 2019: XX International Conference on Human Computer Interaction

June 25 - 28, 2019

Gipuzkoa, Donostia, Spain

Acceptance Rates

Interacción '19 Paper Acceptance Rate 62 of 90 submissions, 69%;

Overall Acceptance Rate 109 of 163 submissions, 67%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

17
Total Citations
View Citations
445
Total Downloads

Downloads (Last 12 months)70
Downloads (Last 6 weeks)11

Reflects downloads up to 03 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Gonzalez SAlmazán ACornejo RCaro K(2024)Following UCD and SCRUM for Designing a Virtual Environment to Support the Emotional Development of Children with AutismFollowing UCD and SCRUM for Designing a Virtual Environment to Support the Emotional Development of Children with AutismAvances en Interacción Humano-Computadora10.47756/aihc.y9i1.1809:1(257-260)Online publication date: 30-Nov-2024
https://doi.org/10.47756/aihc.y9i1.180
Almazán AGonzalez SCornejo RCaro K(2024)Design of a Virtual Assistant for Emotional Support of Children with Autism Spectrum DisorderDesign of a Virtual Assistant for Emotional Support of Children with Autism Spectrum DisorderAvances en Interacción Humano-Computadora10.47756/aihc.y9i1.1549:1(104-108)Online publication date: 30-Nov-2024
https://doi.org/10.47756/aihc.y9i1.154
Honorato NSoltiyeva AOliveira WDelabrida SHamari JAlimanova M(2024)Gameful strategies in the education of autistic children: a systematic literature review, scientometric analysis, and future research roadmapSmart Learning Environments10.1186/s40561-024-00309-611:1Online publication date: 4-Jun-2024
https://doi.org/10.1186/s40561-024-00309-6
Zhou NDevleminck SGeurts L(2024)Tangible Affect: A Literature Review of Tangible Interactive Systems Addressing Human Core Affect, Emotions and MoodsProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661608(424-440)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661608
R S RNS MMasali MDwivedi IDeshpande PK R V(2024)Augmented Reality Learn Suite for Autistic Children2024 IEEE International Conference for Women in Innovation, Technology & Entrepreneurship (ICWITE)10.1109/ICWITE59797.2024.10503285(207-211)Online publication date: 16-Feb-2024
https://doi.org/10.1109/ICWITE59797.2024.10503285
Kavikeshawa H(2024)AI-Based Early Intervention for Enhancing Facial Emotion Recognition in Children with Autism Spectrum Disorder in Sri Lanka2024 9th International Conference on Information Technology Research (ICITR)10.1109/ICITR64794.2024.10857750(1-6)Online publication date: 5-Dec-2024
https://doi.org/10.1109/ICITR64794.2024.10857750
Toma MTurcu CTurcu CVlad STiliute DPascu P(2023)Extended Reality-Based Mobile Application Solutions for the Therapy of Children with Autism Spectrum Disorders: A Systematic Literature Review (Preprint)JMIR Serious Games10.2196/49906Online publication date: 13-Jun-2023
https://doi.org/10.2196/49906
Zolyomi ASnyder J(2023)Designing for Common Ground: Visually Representing Conversation Dynamics of Neurodiverse DyadsProceedings of the ACM on Human-Computer Interaction10.1145/36100577:CSCW2(1-33)Online publication date: 4-Oct-2023
https://dl.acm.org/doi/10.1145/3610057
Mathilde YFleck S(2023)Embodying emotional presence through a tangible interface in a hybrid collaborative learning situation: state of the artAdjunct Proceedings of the 34th Conference on l'Interaction Humain-Machine10.1145/3577590.3589602(1-9)Online publication date: 3-Apr-2023
https://dl.acm.org/doi/10.1145/3577590.3589602
Pepa LSpalazzi LCapecci MCeravolo M(2023)Automatic Emotion Recognition in Clinical Scenario: A Systematic Review of MethodsIEEE Transactions on Affective Computing10.1109/TAFFC.2021.312878714:2(1675-1695)Online publication date: 1-Apr-2023
https://doi.org/10.1109/TAFFC.2021.3128787
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten