research-article

Starrypia: An AR Gamified Music Adjuvant Treatment Application for Children with Autism Based on Combined Therapy

Authors:

Shuo TangAuthors Info & Claims

UIST '23: Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology

Article No.: 41, Pages 1 - 16

https://doi.org/10.1145/3586183.3606755

Published: 29 October 2023 Publication History

UIST '23: Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology

Starrypia: An AR Gamified Music Adjuvant Treatment Application for Children with Autism Based on Combined Therapy

Pages 1 - 16

Abstract
Supplemental Material
References

Abstract

In this paper, we present Starrypia, a lightweight gamified music adjuvant treatment application to improve the symptoms of mild autistic children, eliminating the geographical and time constraints faced by traditional treatment. Adopting ABA (Applied Behavior Analysis) behavioral theory as the principle, Starrypia follows the stimulus-response-reinforcement-pause process and incorporates music therapy and sensory integration. Based on AR, Starrypia provides multi-sensory intervention through music generated by BiLSTM deep model, 3D visual scenes, touch interaction to keep children focused and calm. We conducted a controlled experiment on 20 children to test Starrypia’s effectiveness and attraction. Children’s pre-test and post-test scores on two autism rating scales and performance during the test were applied to measure their abilities and engagement. Experimental results indicated that children showed great interest in Starrypia and presented evident symptom remission and advance in overall abilities after 4 weeks of use. In conclusion, Starrypia is practicable in both therapeutic effect and user experience, and conspicuously instrumental in promoting sensory ability.

Supplemental Material

ZIP File

Supplemental File

Download
102.68 MB

References

[1]

Sarthak Agarwal, Vaibhav Saxena, Vaibhav Singal, and Swati Aggarwal. 2018. LSTM based Music Generation with Dataset Preprocessing and Reconstruction Techniques. In 2018 IEEE Symposium Series on Computational Intelligence (SSCI). 455–462. https://doi.org/10.1109/SSCI.2018.8628712

[2]

Haneen Almurashi, Rahma Bouaziz, Wallaa Alharthi, Mohammed Al-Sarem, Mohammed Hadwan, and Slim Kammoun. 2022. Augmented Reality, Serious Games and Picture Exchange Communication System for People with ASD: Systematic Literature Review and Future Directions. Sensors 22, 3 (2022), 1250. https://doi.org/10.3390/s22031250

[3]

Carmen Berenguer, Inmaculada Baixauli, Soledad Gómez García, María Andres Sebastia, and SIMONA DE STASIO. 2020. Exploring the Impact of Augmented Reality in Children and Adolescents with Autism Spectrum Disorder: A Systematic Review. International Journal of Environmental Research and Public Health 17 (08 2020), 6143. https://doi.org/10.3390/ijerph17176143

[4]

Vera Bernard-Opitz, N. Sriram, and Sharul Sapuan. 1999. Enhancing Vocal Imitations in Children with Autism Using the IBM Speech Viewer. Autism 3, 2 (1999), 131–147. https://doi.org/10.1177/1362361399003002004 arXiv:https://doi.org/10.1177/1362361399003002004

[5]

T. P. Berney. 1999. Autism: Preparing for Adulthood. By Patricia Howling. Routledge, London, 1997. pp. 294. £12.99 (pb).The Journal of Child Psychology and Psychiatry and Allied Disciplines 40, 2 (1999), 309–309. https://doi.org/10.1017/S0021963098213072

[6]

Anjali Bhatara, Eve-Marie Quintin, Eric Fombonne, and Daniel J Levitin. 2013. Early sensitivity to sound and musical preferences and enjoyment in adolescents with autism spectrum disorders.Psychomusicology: Music, Mind, and Brain 23, 2 (2013), 100.

[7]

SK Bhatt, NI De Leon, and Adel Al-Jumaily. 2017. Augmented reality game therapy for children with autism spectrum disorder. International Journal on Smart Sensing and Intelligent Systems 7, 2 (2017), 519–536.

[8]

Marianna Boso, Mario Comelli, Tomaso Vecchi, Francesco Barale, and Pierluigi Politi. 2009. Exploring musical taste in severely autistic subjects: preliminary data. Annals of the New York Academy of Sciences 1169, 1 (2009), 332–335.

[9]

Jean-Pierre Briot. 2021. From artificial neural networks to deep learning for music generation: history, concepts and trends. Neural Computing and Applications 33 (01 2021), 1–27. https://doi.org/10.1007/s00521-020-05399-0

Digital Library

[10]

Jean-Pierre Briot and François Pachet. 2020. Deep Learning for Music Generation: Challenges and Directions. Neural Comput. Appl. 32, 4 (feb 2020), 981–993. https://doi.org/10.1007/s00521-018-3813-6

Digital Library

[11]

Rachael Bevill Burns, Hasti Seifi, Hyosang Lee, and Katherine J. Kuchenbecker. 2021. A Haptic Empathetic Robot Animal for Children with Autism. In Companion of the 2021 ACM/IEEE International Conference on Human-Robot Interaction (Boulder, CO, USA) (HRI ’21 Companion). Association for Computing Machinery, New York, NY, USA, 583–585. https://doi.org/10.1145/3434074.3446352

Digital Library

[12]

Ya-Yun Chen, Mirko Uljarevic, Joshua Neal, Steven Greening, Hyungwook Yim, and Tae-Ho Lee. 2022. Excessive Functional Coupling With Less Variability Between Salience and Default Mode Networks in Autism Spectrum Disorder. Biological Psychiatry: Cognitive Neuroscience and Neuroimaging 7, 9 (2022), 876–884. https://doi.org/10.1016/j.bpsc.2021.11.016

[13]

Liu Xiaodi Chen Jingying. 2020. The Assessment of Children with Autism Supported by Human-computer Interaction Technology—Comparison of Assessment Results based on the Revised Edition of C-PEP and Human-computer Interactive Games. Modern Educational Technology 30, 52-58 (2020).

[14]

Hang Chu, Raquel Urtasun, and Sanja Fidler. 2016. Song From PI: A Musically Plausible Network for Pop Music Generation. (11 2016).

[15]

Miguel Civit, Javier Civit-Masot, Francisco Cuadrado, and M.J. Escalona. 2022. A systematic review of artificial intelligence-based music generation: Scope, applications, and future trends. Expert Systems with Applications 209 (07 2022), 118190. https://doi.org/10.1016/j.eswa.2022.118190

Digital Library

[16]

Miguel Civit, Javier Civit-Masot, Francisco Cuadrado, and Maria J. Escalona. 2022. A systematic review of artificial intelligence-based music generation: Scope, applications, and future trends. Expert Systems with Applications 209 (2022), 118190. https://doi.org/10.1016/j.eswa.2022.118190

Digital Library

[17]

Mario Covarrubias, Shefali Mehta, and Milton Carlos Espinosa. 2022. Augmented Reality Game for Children with Autism Spectrum Disorder. 462–467. https://doi.org/10.1007/978-3-031-08648-9_53

Digital Library

[18]

Anthony Cuvo. 2011. Applied Behavior Analysis. Springer New York, 230–235. https://doi.org/10.1007/978-0-387-79948-3_1610

[19]

Salatiel Dantas, FRANCISCO MENDES NETO, Rodrigo Lima, Francisco Macedo, Jhonny Santo, and Washington Silva. 2017. Knowledgemon Hunter: A Serious Game with Geolocation to Support Learning of Children with Autism and Learning Difficulties. 293–296. https://doi.org/10.1109/SVR.2017.45

[20]

Teresa L. Davenport. 2011. Autism Behavior Checklist. Springer US, Boston, MA, 182–183. https://doi.org/10.1007/978-0-387-79061-9_249

[21]

Barış Ekici, Feyza KONUK, Şerife DURSUN, Öykü UNAY, and Burak TATLI. 2020. Neuroplay method combined with home-based Ayres sensory integration for autism: A case report. Journal of Surgery and Medicine 4 (03 2020). https://doi.org/10.28982/josam.613563

[22]

Yesim Fazlioglu and Gulen Baran. 2008. A Sensory Integration Therapy Program on Sensory Problems for Children with Autism. Perceptual and motor skills 106 (05 2008), 415–22. https://doi.org/10.2466/PMS.106.2.415-422

[23]

Deborah Fein, Marianne Barton, and Thyde Dumont-Mathieu. 2017. Optimizing Outcome in Autism Spectrum Disorders. Policy Insights from the Behavioral and Brain Sciences 4, 1 (2017), 71–78. https://doi.org/10.1177/2372732216685098 arXiv:https://doi.org/10.1177/2372732216685098

[24]

Wayne W Fisher, Cathleen C Piazza, and Henry S Roane. 2021. Handbook of applied behavior analysis. Guilford Publications.

[25]

Mark French and Rod Handy. 2007. Spectrograms: Turning Signals into Pictures. Journal of Engineering Technology 24 (03 2007), 32–35.

[26]

Meng-Xue Fu, Qin Lin, Ji-Jun Wu, Xiao-Li Zhong, Ling-Na Yang, and Guo-Jing Han. 3920. A review of the research on music therapy in hospice care. Frontiers of Nursing 7, 3 (3920), 179–183. https://doi.org/

[27]

Monika Geretsegger, Cochavit Elefant, Karin Mössler, and Christian Gold. 2014. Music therapy for people with autism spectrum disorder. The Cochrane library6 (17 June 2014). https://doi.org/10.1002/14651858.CD004381.pub3

[28]

Maureen Grissom. 2011. Childhood Autism Rating Scales. Springer New York, New York, NY, 553–554. https://doi.org/10.1007/978-0-387-79948-3_1530

[29]

Gaëtan Hadjeres and Francois Pachet. 2016. DeepBach: a Steerable Model for Bach chorales generation. (12 2016).

[30]

Joshua Hailpern, Andrew Harris, Reed La Botz, Brianna Birman, and Karrie Karahalios. 2012. Designing Visualizations to Facilitate Multisyllabic Speech with Children with Autism and Speech Delays(DIS ’12). Association for Computing Machinery, New York, NY, USA, 126–135. https://doi.org/10.1145/2317956.2317977

Digital Library

[31]

Francesca Happé and Uta Frith. 2006. The weak coherence account: detail-focused cognitive style in autism spectrum disorders. Journal of autism and developmental disorders 36, 1 (2006), 5–25.

[32]

Casper Harteveld and Steven C. Sutherland. 2015. The Goal of Scoring: Exploring the Role of Game Performance in Educational Games. Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (2015).

Digital Library

[33]

Liu guihua He Yingshuang. 2022. Effect of parent-child cooperative music therapy on children with autism spectrum disorder and their mothers: a prospective randomized controlled study. Chinese Journal Of Contemporary Pediatrics005 (2022), 024.

[34]

Kara Hume, Jessica R Steinbrenner, Samuel L Odom, Kristi L Morin, Sallie W Nowell, Brianne Tomaszewski, Susan Szendrey, Nancy S McIntyre, Serife Yücesoy-Özkan, and Melissa N Savage. 2021. Evidence-based practices for children, youth, and young adults with autism: Third generation review. Journal of autism and developmental disorders (2021), 1–20.

[35]

Tianyu Jiang, Qinyin Xiao, and Xueyuan Yin. 2019. Music Generation Using Bidirectional Recurrent Network. In 2019 IEEE 2nd International Conference on Electronics Technology (ICET). 564–569. https://doi.org/10.1109/ELTECH.2019.8839399

[36]

Dr Preeti K, Dr Shoba Srinath, Dr Shekhar P Seshadri, Dr Satish C Girimaji, and Dr John Vijay Sagar Kommu. 2017. Lost time—Need for more awareness in early intervention of autism spectrum disorder. Asian Journal of Psychiatry 25 (2017), 13–15. https://doi.org/10.1016/j.ajp.2016.07.021

[37]

Kamran Khowaja, Banire Bilikis, Dena Al-Thani, Mohammed Tahri Sqalli, Aboubakr Aqle, Asadullah Shah, and Siti Salwah Salim. 2020. Augmented Reality for Learning of Children and Adolescents With Autism Spectrum Disorder (ASD): A Systematic Review. IEEE Access PP (04 2020), 1–1. https://doi.org/10.1109/ACCESS.2020.2986608

[38]

Lynn Kern Koegel, Robert L Koegel, Kristen Ashbaugh, and Jessica Bradshaw. 2014. The importance of early identification and intervention for children with or at risk for autism spectrum disorders. International journal of speech-language pathology 16, 1 (2014), 50–56.

[39]

A Blythe LaGasse. 2017. Social outcomes in children with autism spectrum disorder: a review of music therapy outcomes. Patient Related Outcome Measures 8 (2017), 23–32. https://doi.org/10.2147/PROM.S106267 arXiv:https://www.tandfonline.com/doi/pdf/10.2147/PROM.S106267PMID: 28260959.

[40]

Chun-I Lee, I-Ping Chen, Chi-Min Hsieh, and Chia-Ning Liao. 2017. Design Aspects of Scoring Systems in Game. Art and Design Review 05 (01 2017), 26–43. https://doi.org/10.4236/adr.2017.51003

[41]

Susan Leekam. 2016. Social cognitive impairment and autism: What are we trying to explain?Philosophical Transactions of the Royal Society B: Biological Sciences 371 (01 2016), 20150082. https://doi.org/10.1098/rstb.2015.0082

[42]

Jiajia Li, Zixia Zheng, Xiemin Wei, and Guanyun Wang. 2021. FaceMe: An Augmented Reality Social Agent Game for Facilitating Children’s Learning about Emotional Expressions. 17–19. https://doi.org/10.1145/3474349.3480216

Digital Library

[43]

Tianbi Li, Yewei Li, Yixiao Hu, Yuyin Wang, Cheuk Man Lam, Wei Ni, Xueqin Wang, and Li Yi. 2021. Heterogeneity of visual preferences for biological and repetitive movements in children with autism spectrum disorder. Autism Research 14, 1 (2021), 102–111.

[44]

Yini Liao, Karola Dillenburger, Wei He, Ying Xu, and Hongwei Cai. 2020. A Systematic Review of Applied Behavior Analytic Interventions for Children with Autism in Mainland China. Review Journal of Autism and Developmental Disorders (29 Jan. 2020). https://doi.org/10.1007/s40489-020-00196-w

[45]

Genqiang Li Lijun Sun. 2010. On the Application of Music Therapy to the Intervention of Children with Autism. Chinese Journal of Special Education No.120, 48-53 (2010).

[46]

Hayoung A. Lim. 2010. Use of Music in the Applied Behavior Analysis Verbal Behavior Approach for Children with Autism Spectrum Disorders. Music Therapy Perspectives 28, 2 (11 2010), 95–105. https://doi.org/10.1093/mtp/28.2.95 arXiv:https://academic.oup.com/mtp/article-pdf/28/2/95/6834425/28-2-95.pdf

[47]

Hayoung A. Lim and Ellary Draper. 2011. The Effects of Music Therapy Incorporated with Applied Behavior Analysis Verbal Behavior Approach for Children with Autism Spectrum Disorders. Journal of Music Therapy 48, 4 (12 2011), 532–550. https://doi.org/10.1093/jmt/48.4.532 arXiv:https://academic.oup.com/jmt/article-pdf/48/4/532/5114453/48-4-532.pdf

[48]

Joana Lobo, Soichiro Matsuda, Izumi Futamata, Ryoichi Sakuta, and Kenji Suzuki. 2019. CHIMELIGHT: Augmenting Instruments in Interactive Music Therapy for Children with Neurodevelopmental Disorders. In Proceedings of the 21st International ACM SIGACCESS Conference on Computers and Accessibility (Pittsburgh, PA, USA) (ASSETS ’19). Association for Computing Machinery, New York, NY, USA, 124–135. https://doi.org/10.1145/3308561.3353784

Digital Library

[49]

Xufeng Ma and Jianhua Yang. 2021. Development of the Interactive Rehabilitation Game System for Children with Autism Based on Game Psychology. Mobile Information Systems 2021 (10 2021). https://doi.org/10.1155/2021/6020208

[50]

Laura Malinverni, Joan Mora Guiard, Vanesa Padillo, Lilia Valero, Amaia Hervás, and Narcis Pares. 2016. An inclusive design approach for developing video games for children with Autism Spectrum Disorder. Computers in Human Behavior 71 (01 2016). https://doi.org/10.1016/j.chb.2016.01.018

Digital Library

[51]

G. Marine and M. Nobuo. 2016. Atypical Color Preference in Children with Autism Spectrum Disorder. Frontiers in Psychology 7 (2016), 1976–.

[52]

Anabela Marto, Henrique A. Almeida, and Alexandrino Gonçalves. 2019. Using Augmented Reality in Patients with Autism: A Systematic Review. In VipIMAGE 2019, João Manuel R. S. Tavares and Renato Manuel Natal Jorge (Eds.). Springer International Publishing, Cham, 454–463.

[53]

Teresa A May-Benson and Jane A Koomar. 2010. Systematic review of the research evidence examining the effectiveness of interventions using a sensory integrative approach for children. The American Journal of Occupational Therapy 64, 3 (2010), 403–414.

[54]

Dan Mi, Lu Qin, 2022. Classification System of National Music Rhythm Spectrogram Based on Biological Neural Network. Computational Intelligence and Neuroscience 2022 (2022).

[55]

Chara Papoutsi, Athanasios Drigas, and Charalabos Skianis. 2018. Mobile Applications to Improve Emotional Intelligence in Autism - A Review. Int. J. Interact. Mob. Technol. 12 (2018), 47–61.

[56]

Narcis Pares, Anna Carreras, Jaume Durany, Jaume Ferrer, Pere Freixa, David Gomez, Orit Kruglanski, Roc Parés, J. Ignasi Ribas, Miquel Soler, and Àlex Sanjurjo. 2005. Promotion of Creative Activity in Children with Severe Autism Through Visuals in an Interactive Multisensory Environment. Proceedings of: Interaction Design and Children 2005, IDC 2005 (06 2005). https://doi.org/10.1145/1109540.1109555

Digital Library

[57]

Yordan Penev, Kaitlyn Dunlap, Arman Husic, Cathy Hou, Peter Washington, Emilie Leblanc, Aaron Kline, John Kent, Anthony Ng-Thow-Hing, Bennett Liu, Christopher Harjadi, Meagan Tsou, Manisha Desai, and Dennis P Wall. 2021. A Mobile Game Platform for Improving Social Communication in Children with Autism: A Feasibility Study. Applied clinical informatics 12, 5 (October 2021), 1030—1040. https://doi.org/10.1055/s-0041-1736626

[58]

Karen Pierce, David Conant, Roxana Hazin, Richard Stoner, and Jamie Desmond. 2011. Preference for geometric patterns early in life as a risk factor for autism. Archives of general psychiatry 68, 1 (2011), 101–109.

[59]

Nancy Pollock. 2009. Sensory integration: A review of the current state of the evidence. Occupational therapy now 11, 5 (2009), 6–10.

[60]

Xiaomin Hao Quanli Liu. 2020. The Current Situation Study of the Research on the Music Therapy for Children with Special Education Need in China. Journal of Kunming University 42, 45-55 (2020). https://doi.org/10.14091/j.cnki.kmxyxb.2020.02.007

[61]

Grazia Ragone, Judith Good, and Kate Howland. 2021. How Technology Applied to Music-Therapy and Sound-Based Activities Addresses Motor and Social Skills in Autistic Children. Multimodal Technologies and Interaction 5, 3 (2021). https://doi.org/10.3390/mti5030011

[62]

Alaine E. Reschke-Hernández. 2011. History of Music Therapy Treatment Interventions for Children with Autism. Journal of Music Therapy 48, 2 (07 2011), 169–207. https://doi.org/10.1093/jmt/48.2.169 arXiv:https://academic.oup.com/jmt/article-pdf/48/2/169/5205353/48-2-169.pdf

[63]

Joel E. Ringdahl, Todd Kopelman, and Terry S. Falcomata. 2023. Applied Behavior Analysis and Its Application to Autism and Autism-Related Disorders. Springer International Publishing, Cham, 37–58. https://doi.org/10.1007/978-3-031-27587-6_3

[64]

Michele Schnur Ritholz. 2014. The Primacy of Music and Musical Resources in Nordoff-Robbins Music Therapy. Music Therapy Perspectives 32, 1 (07 2014), 8–17. https://doi.org/10.1093/mtp/miu017 arXiv:https://academic.oup.com/mtp/article-pdf/32/1/8/3876990/miu017.pdf

[65]

Henry S Roane, Wayne W Fisher, and James E Carr. 2016. Applied behavior analysis as treatment for autism spectrum disorder. The Journal of pediatrics 175 (2016), 27–32.

[66]

François Robain, Michel Godel, Nada Kojovic, Martina Franchini, Fiona Journal, and Marie Schaer. 2022. Measuring social orienting in preschoolers with autism spectrum disorder using cartoons stimuli. Journal of Psychiatric Research 156 (2022), 398–405. https://doi.org/10.1016/j.jpsychires.2022.10.039

[67]

Sara Semino, Mirella Zanobini, and Maria Carmen Usai. 2021. Visual memory profile in children with high functioning autism. Applied Neuropsychology: Child 10, 1 (2021), 26–36.

[68]

Samata R. Sharma, Xenia Gonda, and Frank I. Tarazi. 2018. Autism Spectrum Disorder: Classification, diagnosis and therapy. Pharmacology & Therapeutics 190 (2018), 91–104. https://doi.org/10.1016/j.pharmthera.2018.05.007

[69]

Aubyn C. Stahmer, Laura Schreibman, and Allison B. Cunningham. 2011. Toward a technology of treatment individualization for young children with autism spectrum disorders. Brain Research 1380 (2011), 229–239. https://doi.org/10.1016/j.brainres.2010.09.043 The Emerging Neuroscience of Autism Spectrum Disorders.

[70]

Stavros Tsikinas and Stelios Xinogalos. 2019. Studying the effects of computer serious games on people with intellectual disabilities or autism spectrum disorder: A systematic literature review. Journal of Computer Assisted Learning 35 (02 2019). https://doi.org/10.1111/jcal.12311

[71]

Kiley Tyler, Megan Macdonald, and Kristi Menear. 2014. Physical Activity and Physical Fitness of School-Aged Children and Youth with Autism Spectrum Disorders. Autism research and treatment 2014 (09 2014), 312163. https://doi.org/10.1155/2014/312163

[72]

Mirko Uljarevic, Grace Baranek, Giacomo Vivanti, Darren Hedley, Kristelle Hudry, and Alison Lane. 2017. Heterogeneity of sensory features in autism spectrum disorder: Challenges and perspectives for future research. Autism research : official journal of the International Society for Autism Research 10 (03 2017). https://doi.org/10.1002/aur.1747

[73]

Katherine Valencia, Cristian Rusu, Daniela Quiñones Otey, and Erick Jamet. 2019. The Impact of Technology on People with Autism Spectrum Disorder: A Systematic Literature Review. Sensors 19 (10 2019), 4485. https://doi.org/10.3390/s19204485

[74]

Catalin Voss, Jessey Schwartz, Jena Daniels, Aaron Kline, Nick Haber, Peter Washington, Qandeel Tariq, Thomas N Robinson, Manisha Desai, Jennifer M Phillips, 2019. Effect of wearable digital intervention for improving socialization in children with autism spectrum disorder: a randomized clinical trial. JAMA pediatrics 173, 5 (2019), 446–454.

[75]

Madhushi Welikala and T.G.I. Fernando. 2020. Komposer V2: A Hybrid Approach to Intelligent Musical Composition Based on Generative Adversarial Networks with a Variational Autoencoder. 413–425. https://doi.org/10.1007/978-3-030-63128-4_31

[76]

Wim Westera. 2019. Why and how serious games can become far more effective: Accommodating productive learning experiences, learner motivation and the monitoring of learning gains. Journal of Educational Technology & Society 22, 1 (2019), 59–69.

[77]

Andrew JO Whitehouse, Joanna Granich, Gail Alvares, Margherita Busacca, Matthew N Cooper, Alena Dass, Thi Duong, Rajes Harper, Wendy Marshall, Amanda Richdale, 2017. A randomised controlled trial of an iP ad-based application to complement early behavioural intervention in Autism Spectrum Disorder. Journal of Child Psychology and Psychiatry 58, 9 (2017), 1042–1052.

[78]

Arnold Wilkins. 2003. Reading Through Colour.

[79]

ZHANG Bingchen ZHAO Yuwan. 2020. Research on role modeling design of intervention card for autistic children based on visual cognition. Journal of Graphics 41, 3, Article 461 (2020), 461-468 pages.

[80]

Cheng Zheng, Caowei Zhang, Xuan Li, Xin Liu, Chuqi Tang, Guanyun Wang, Cheng Yao, Fan Zhang, Wenjie Xu, and Fangtian Ying. 2017. Toon-Chat: A Cartoon-Masked Chat System for Children with Autism. In ACM SIGGRAPH 2017 Posters (Los Angeles, California) (SIGGRAPH ’17). Association for Computing Machinery, New York, NY, USA, Article 50, 2 pages. https://doi.org/10.1145/3102163.3102249

Digital Library

Cited By

Liu JHuang DSong YLuo SHu B(2024)Foldiverse: Augmenting Paper Folding Physiotherapy for Children with Autism via Family-Centered Mixed Reality DesignCompanion Proceedings of the 2024 Annual Symposium on Computer-Human Interaction in Play10.1145/3665463.3678823(378-383)Online publication date: 14-Oct-2024
https://dl.acm.org/doi/10.1145/3665463.3678823
Guo GQiu Z(2024)DentAR: Innovating Dental Visits with Sensory Experiences in AR for People with Autism Spectrum DisorderExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650926(1-7)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3650926

Index Terms

Starrypia: An AR Gamified Music Adjuvant Treatment Application for Children with Autism Based on Combined Therapy
1. Computer systems organization
  1. Dependable and fault-tolerant systems and networks
    1. Redundancy
  2. Embedded and cyber-physical systems
    1. Embedded systems
    2. Robotics
2. Networks
  1. Network properties
    1. Network reliability

Recommendations

CHIMELIGHT: Augmenting Instruments in Interactive Music Therapy for Children with Neurodevelopmental Disorders
ASSETS '19: Proceedings of the 21st International ACM SIGACCESS Conference on Computers and Accessibility

In this paper, we propose a new mobile system to support therapists for teaching and tracking socio-communicative behaviors in children with neurodevelopmental disorders during music therapy sessions. The CHIMELIGHT system was designed to deal with the ...
Robot Assisted Music Therapy: A Case Study with Children Diagnosed with Autism
HRI '16: The Eleventh ACM/IEEE International Conference on Human Robot Interaction

Music therapy is often used for children with autism to improve social interaction, communication, and imitation skills through music. Increasingly, music therapists have incorporated technology into therapy sessions as therapeutic tools. Robotics has ...
Individual Differences of Children with Autism in Robot-assisted Autism Therapy
HRI '22: Proceedings of the 2022 ACM/IEEE International Conference on Human-Robot Interaction

Research has recognized the importance of individual differences of children with Autism Spectrum Disorder (ASD) that require interventions to meet their heterogeneous needs. This relatively large-scale study investigates a robot-assisted autism therapy (...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

UIST '23: Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology

October 2023

1825 pages

ISBN:9798400701320

DOI:10.1145/3586183

Editors:
Sean Follmer
Stanford University, USA
,
Jeff Han,
Jürgen Steimle
Saarland University, Germany
,
Nathalie Henry Riche
Microsoft Research, USA

Copyright © 2023 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 October 2023

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

UIST '23

Sponsor:

UIST '23: The 36th Annual ACM Symposium on User Interface Software and Technology

October 29 - November 1, 2023

CA, San Francisco, USA

Acceptance Rates

Overall Acceptance Rate 561 of 2,567 submissions, 22%

Upcoming Conference

UIST '25

Sponsor:
sigchi
sigchi

The 38th Annual ACM Symposium on User Interface Software and Technology

September 28 - October 1, 2025

Busan , Republic of Korea

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
613
Total Downloads

Downloads (Last 12 months)395
Downloads (Last 6 weeks)38

Reflects downloads up to 28 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Liu JHuang DSong YLuo SHu B(2024)Foldiverse: Augmenting Paper Folding Physiotherapy for Children with Autism via Family-Centered Mixed Reality DesignCompanion Proceedings of the 2024 Annual Symposium on Computer-Human Interaction in Play10.1145/3665463.3678823(378-383)Online publication date: 14-Oct-2024
https://dl.acm.org/doi/10.1145/3665463.3678823
Guo GQiu Z(2024)DentAR: Innovating Dental Visits with Sensory Experiences in AR for People with Autism Spectrum DisorderExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650926(1-7)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3650926

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Figures

Tables

Media

View Table of Conten