skip to main content
10.1145/3544549.3585809acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
Work in Progress

AEDLE: Designing Drama Therapy Interface for Improving Pragmatic Language Skills of Children with Autism Spectrum Disorder Using AR

Published:19 April 2023Publication History

ABSTRACT

This research proposes AEDLE, a new interface combining AR with drama therapy — an approved method of improving pragmatic language skills — to offer effective, universal, and accessible language therapy for children with Autism Spectrum Disorder (ASD). People with ASD commonly have a disability in pragmatic language and experience difficulty speaking. However, although therapy in childhood is necessary to prevent long-term social isolation due to such constraints, the limited number of therapists forbids doing so. Technology-based therapy can be a solution, but studies on utilizing digital therapy to improve pragmatic language are still insufficient. We conducted a preliminary user study with an ASD child and a therapist to investigate how the child with ASD reacts to drama therapy using AEDLE. We observed that our ASD child actively participated in AEDLE-mediated drama therapy, used our insights to recommend design suggestions for AR-based drama therapy, and explored various ways to utilize AEDLE.

Skip Supplemental Material Section

Supplemental Material

3544549.3585809-talk-video.mp4

mp4

45.8 MB

3544549.3585809-video-preview.mp4

mp4

71.9 MB

References

  1. Catherine Adams. 2003. Intervention for developmental pragmatic language impairments. Aula Abierta 82 (2003), 79–96.Google ScholarGoogle Scholar
  2. Adobe. 2023. Adobe After Effects. Adobe. Retrieved March 5, 2023 from https://www.adobe.com/kr/Google ScholarGoogle Scholar
  3. Adobe. 2023. professional video editing software | adobe premiere pro. Adobe. Retrieved March 5, 2023 from https://www.adobe.com/products/premiere.htmlGoogle ScholarGoogle Scholar
  4. Catherine Aldred, Jonathan Green, and Catherine Adams. 2004. A new social communication intervention for children with autism: pilot randomised controlled treatment study suggesting effectiveness. Journal of Child Psychology and Psychiatry 45, 8 (2004), 1420–1430.Google ScholarGoogle ScholarCross RefCross Ref
  5. Haneen Almurashi, Rahma Bouaziz, Wallaa Alharthi, Mohammed Al-Sarem, Mohammed Hadwan, and Slim Kammoun. 2022. Augmented reality, serious games and picture exchange communication system for people with ASD: systematic literature review and future directions. Sensors 22, 3 (2022), 1250.Google ScholarGoogle ScholarCross RefCross Ref
  6. Nirit Bauminger and Connie Kasari. 2000. Loneliness and friendship in high-functioning children with autism. Child development 71, 2 (2000), 447–456.Google ScholarGoogle Scholar
  7. Marcia Jean Carter. 2014. Diagnostic and statistical manual of mental disorders. Therapeutic recreation journal 48, 3 (2014), 275.Google ScholarGoogle Scholar
  8. Monica Chester, Amanda L Richdale, and Jane McGillivray. 2019. Group-based social skills training with play for children on the autism spectrum. Journal of Autism and Developmental Disorders 49, 6 (2019), 2231–2242.Google ScholarGoogle ScholarCross RefCross Ref
  9. Blythe A Corbett, Alexandra P Key, Lydia Qualls, Stephanie Fecteau, Cassandra Newsom, Catherine Coke, and Paul Yoder. 2016. Improvement in social competence using a randomized trial of a theatre intervention for children with autism spectrum disorder. Journal of autism and developmental disorders 46, 2 (2016), 658–672.Google ScholarGoogle ScholarCross RefCross Ref
  10. P. Ekman and W.V. Friesen. 1978. Facial action coding system: A technique for the measurement of facial movement. Consulting Psychologists Press, Palo Alto, CA.Google ScholarGoogle Scholar
  11. Tiago Fernandes, Samanta Alves, José Miranda, Cristina Queirós, and Verónica Orvalho. 2011. LIFEisGAME: A facial character animation system to help recognize facial expressions. In ENTERprise Information Systems: International Conference, CENTERIS 2011, Vilamoura, Portugal, October 5-7, 2011, Proceedings, Part III. Springer, International Conference on Enterprise Information Systems, Beijing, China, 423–432.Google ScholarGoogle ScholarCross RefCross Ref
  12. Sue Fletcher-Watson, Alexandra Petrou, Juliet Scott-Barrett, Pamela Dicks, Catherine Graham, Anne O’Hare, Helen Pain, and Helen McConachie. 2016. A trial of an iPad™ intervention targeting social communication skills in children with autism. Autism 20, 7 (2016), 771–782.Google ScholarGoogle ScholarCross RefCross Ref
  13. Loretta Gallo-Lopez and Lawrence C Rubin. 2012. Play-based interventions for children and adolescents with autism spectrum disorders. Routledge, .Google ScholarGoogle Scholar
  14. Emma Godfrey and Deborah Haythorne. 2013. Benefits of dramatherapy for Autism Spectrum Disorder: a qualitative analysis of feedback from parents and teachers of clients attending Roundabout dramatherapy sessions in schools. Dramatherapy 35, 1 (2013), 20–28.Google ScholarGoogle ScholarCross RefCross Ref
  15. Marine Grandgeorge and Nobuo Masataka. 2016. Atypical color preference in children with autism spectrum disorder. Frontiers in psychology 7 (2016), 1976.Google ScholarGoogle Scholar
  16. Bruce Hanington and Bella Martin. 2019. Universal methods of design expanded and revised: 125 Ways to research complex problems, develop innovative ideas, and design effective solutions. Rockport publishers, Beverly, Massachusetts.Google ScholarGoogle Scholar
  17. Lee Seung Hee.2022. A Model of the Relationship between Maintenance and Generalization in Applied Behavior Analysis. Journal of Emotional ‘I&’ Behavioral Disorders 38, 2 (2022), 45–62.Google ScholarGoogle Scholar
  18. Lim Hee-Jung and Hong Joon-Pyo. 2019. Effect of Errorless learning versus Systematic fading in the mand and tact training on the speech acquisition for the children with autistic disorder. Journal of Behavior Analysis and Support 6, 1 (2019), 21–40.Google ScholarGoogle ScholarCross RefCross Ref
  19. BAE HEE-SOOK and Sun Hyung Lee. 2015. Group Language Therapy for Development of Pragmatic Skills of Children with ASD –DvT Theatrical Model Approach–. The Journal of Drama(DR) ., 45 (2015), 113–140. https://doi.org/10.15716/dr.2015..45.113Google ScholarGoogle ScholarCross RefCross Ref
  20. Mehmet Kesim and Yasin Ozarslan. 2012. Augmented reality in education: current technologies and the potential for education. Procedia-social and behavioral sciences 47 (2012), 297–302.Google ScholarGoogle Scholar
  21. Julie A Kientz, Gillian R Hayes, Matthew S Goodwin, Mirko Gelsomini, and Gregory D Abowd. 2019. Interactive technologies and autism. Synthesis lectures on assistive, rehabilitative, and health-preserving technologies 9, 1 (2019), i–229.Google ScholarGoogle Scholar
  22. Sunghee Lee. 2022. A Model of the Relationship between Maintenance and Generalization in Applied Behavior Analysis. JOURNAL OF EMOTIONAL & BEHAVIORAL DISORDERS 38, 2 (2022), 45–62. https://doi.org/10.33770/JEBD.38.2.2Google ScholarGoogle ScholarCross RefCross Ref
  23. Jeannie Lewis and Sube Banerjee. 2013. An investigation of the therapeutic potential of stories in Dramatherapy with young people with autistic spectrum disorder. Dramatherapy 35, 1 (2013), 29–42.Google ScholarGoogle ScholarCross RefCross Ref
  24. Jill Locke, Eric H Ishijima, Connie Kasari, and Nancy London. 2010. Loneliness, friendship quality and the social networks of adolescents with high-functioning autism in an inclusive school setting. Journal of Research in Special Educational Needs 10, 2 (2010), 74–81.Google ScholarGoogle ScholarCross RefCross Ref
  25. Danielle Matthews, Hannah Biney, and Kirsten Abbot-Smith. 2018. Individual differences in children’s pragmatic ability: A review of associations with formal language, social cognition, and executive functions. Language Learning and Development 14, 3 (2018), 186–223.Google ScholarGoogle ScholarCross RefCross Ref
  26. Meta. 2023. Oculus quest store: VR Games, Apps, & More. Meta. Retrieved March 5, 2023 from https://www.oculus.comGoogle ScholarGoogle Scholar
  27. S Oh, EJ Lee, and YT Kim. 2012. Preliminary study on developing test items of children’s pragmatic language checklist. Journal of Speech & Hearing Disorders 21, 2 (2012), 111–135.Google ScholarGoogle ScholarCross RefCross Ref
  28. Lauren Parsons, Reinie Cordier, Natalie Munro, Annette Joosten, and Renee Speyer. 2017. A systematic review of pragmatic language interventions for children with autism spectrum disorder. PloS one 12, 4 (2017), e0172242.Google ScholarGoogle ScholarCross RefCross Ref
  29. Robert Poláček. 2020. User Interface Concept for Smart Glasses. Ph. D. Dissertation. University of West Bohemia. https://doi.org/10.13140/RG.2.2.26591.69288/1Google ScholarGoogle ScholarCross RefCross Ref
  30. Christian Ryan and Caitríona Ní Charragáin. 2010. Teaching emotion recognition skills to children with autism. Journal of autism and developmental disorders 40, 12 (2010), 1505–1511.Google ScholarGoogle ScholarCross RefCross Ref
  31. Samsung. 2023. Samsung Gear Series: 360. Samsung. Retrieved March 5, 2023 from https://www.samsung.com/sec/gear/360/Google ScholarGoogle Scholar
  32. Sarah Spencer. 2013. Language Disorders from Infancy Through Adolescence: Listening, Speaking, Reading, Writing and Communicating4th edn Edited by RheaPaul and Courtenay F. Norbury (St. Louis, MO: Elsevier Mosby, 2012)[Pp. 756] ISBN 978-0-323-07184-0.£ 75.99.Google ScholarGoogle Scholar
  33. Marcus L Thomeer, Rachael A Smith, Christopher Lopata, Martin A Volker, Alanna M Lipinski, Jonathan D Rodgers, Christin A McDonald, and Gloria K Lee. 2015. Randomized controlled trial of mind reading and in vivo rehearsal for high-functioning children with ASD. Journal of autism and developmental disorders 45, 7 (2015), 2115–2127.Google ScholarGoogle ScholarCross RefCross Ref
  34. Stavros Tsikinas and Stelios Xinogalos. 2018. Designing effective serious games for people with intellectual disabilities. In 2018 IEEE global engineering education conference (EDUCON). IEEE, 2018 IEEE Global Engineering Education Conference, Santa Cruz de Tenerife, Canary Islands, Spain, 1896–1903.Google ScholarGoogle Scholar
  35. Francesco Vona, Mattia Gianotti, Alberto Patti, Jessica Barbieri, Lukasz Moskwa, Francesco Riccardo Di Gioia, and Franca Garzotto. 2022. Combining Virtual and Augmented Reality to improve daily autonomy for people with Autism Spectrum Disorder. In Proceedings of the 2022 International Conference on Advanced Visual Interfaces. Association for Computing Machinery, New York, NY, United States, 1–3.Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. AEDLE: Designing Drama Therapy Interface for Improving Pragmatic Language Skills of Children with Autism Spectrum Disorder Using AR

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in
        • Published in

          cover image ACM Conferences
          CHI EA '23: Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems
          April 2023
          3914 pages
          ISBN:9781450394222
          DOI:10.1145/3544549

          Copyright © 2023 Owner/Author

          Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 19 April 2023

          Check for updates

          Qualifiers

          • Work in Progress
          • Research
          • Refereed limited

          Acceptance Rates

          Overall Acceptance Rate6,164of23,696submissions,26%

          Upcoming Conference

          CHI PLAY '24
          The Annual Symposium on Computer-Human Interaction in Play
          October 14 - 17, 2024
          Tampere , Finland

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        Full Text

        View this article in Full Text.

        View Full Text

        HTML Format

        View this article in HTML Format .

        View HTML Format