Natalie Harrold
ABSTRACT
Assistive tools are commonly used to aid children experiencing emotional developmental problems associated with psychological disorders, such as autism spectrum disorders (ASDs). In many cases early intervention is crucial to ease the struggle to identify key facial expressions and the emotions they are used to convey. Combining automatic facial expression recognition technology with real-time feedback on player performance, CopyMe is an iPad game that aims to provide a means for children to learn expressions to demonstrate emotions. In this paper, we discuss findings from a pilot study conducted at a childcare centre to evaluate the feasibility of CopyMe's use as a serious game for children to learn emotions through observation and mimicry. Based on observational and interview data, we found that the children, especially the ones affected by ASDs, were able to perform well in the game and generally expressed enjoyment during play. The design of CopyMe as well as our current findings will be most interesting for CHI attendees working in the domain of affective interfaces and serious games, especially those that target children.
Supplemental Material
Available for Download
Zip file containing a PDF of the Accompanying Poster
- Ekman, P. An Argument for Basic Emotions. Cognition & Emotion 6, 3--4 (1992), 169--200.Google Scholar
Cross Ref
- Frauenberger, C., Good, J., Alcorn, A., and Pain, H. Supporting the design contributions of children with autism spectrum conditions. In Proc. 11th International Conference on Interaction Design and Children IDC '12, ACM Press (New York, New York, USA, June 2012), 134. Google ScholarDigital Library
- Harrold, N., Tan, C. T., and Rosser, D. Towards an expression recognition game to assist the emotional development of children with autism spectrum disorders. In Proc. SIGGRAPH Asia WASA '12, ACM Press (New York, New York, USA, 2012), 33. Google ScholarDigital Library
- Hayes, G. R., Hirano, S., Marcu, G., Monibi, M., Nguyen, D. H., and Yeganyan, M. Interactive visual supports for children with autism. Personal Ubiquitous Comput. 14, 7 (2010), 663--680. Google ScholarDigital Library
- Park, J. H., Abirached, B., and Zhang, Y. A framework for designing assistive technologies for teaching children with ASDs emotions. In Proc CHI EA 2012, ACM Press (May 2012), 2423. Google ScholarDigital Library
- Saragih, J. M., Lucey, S., and Cohn, J. Face alignment through subspace constrained mean-shifts. In Proc. ICCV 2009 (September 2009).Google ScholarCross Ref
- Tan, C. T., Harrold, N., and Rosser, D. Designing CopyMe : an expression mimicking serious game. In Proc. SIGGRAPH Asia 2013 MGIA, ACM (2013). Google ScholarDigital Library
- Tan, C. T., Rosser, D., and Harrold, N. Crowdsourcing facial expressions using popular gameplay. In Proc. SIGGRAPH Asia 2013 Technical Briefs, ACM Press (2013). Google ScholarDigital Library
Index Terms
- CopyMe: a portable real-time feedback expression recognition game for children
Recommendations
Can you CopyMe?: an expression mimicking serious game
SA '13: SIGGRAPH Asia 2013 Symposium on Mobile Graphics and Interactive ApplicationsEmotional development is an important aspect in the early years of growth in young children, especially those with psychological disorders like autism spectrum disorders (ASDs), whereby emotional development becomes crucial. However, traditional paper-...
EmoStory: A Game-based System Supporting Children's Emotional Development
CHI EA '18: Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing SystemsChildren's emotional skills are important for their success. However, children with Autism Spectrum Disorders have difficulties in understanding social contexts and recognizing and expressing facial expressions. In this paper, we present the design of ...
CopyMe: an emotional development game for children
CHI EA '14: CHI '14 Extended Abstracts on Human Factors in Computing SystemsProper emotional development is important for young children, especially those with psychological disorders such as autism spectrum disorders (ASDs), whereby early intervention becomes crucial. However, traditional paper-based interventions are mostly ...
Comments