Narayan Ghiotti
ABSTRACT
Autistic children’s emotional meltdown is a common challenge faced by their caregivers, including their teachers and families. Communicating their problems can be extremely challenging for many autistic children, making it difficult for caregivers to identify the triggers of these meltdowns. Previous studies have revealed that autistic children find it easier to communicate with non-human objects, such as comfort dolls or social robots. In light of this, we have designed Kodi, a mobile virtual conversational agent aimed at bridging the communication gap between autistic children and their caregivers during distressing situations. Kodi’s appearance can be personalized to match the child’s favorite characters, such as a bunny or a dinosaur. To provide additional comfort, Kodi comes with furry phone cases that offer haptic stimulation. When the child faces stressful situations, caregivers can prompt Kodi on children’s mobile device, allowing the child to express their emotions with various input modalities (emojis, text, voice) and listen to soothing stories. Caregivers can tailor these stories to suit each child’s unique needs. Furthermore, Kodi will employ keyword analysis to summarize conversations, identify potential triggers for emotional meltdowns (e.g., loud noises in a shopping mall, unexpected changes at school), and alert caregivers of potential problems, such as bullying. The data collected through Kodi holds the potential to be leveraged for predicting emotional meltdowns using machine learning techniques. This paper discusses the implications of the Kodi platform and outlines future research directions in this area.
- Sara Bernardini, Kaśka Porayska-Pomsta, and Tim J Smith. 2014. ECHOES: An intelligent serious game for fostering social communication in children with autism. Information Sciences 264 (2014), 41–60. https://doi.org/10.1016/j.ins.2013.10.027Google Scholar
Digital Library
- John-John Cabibihan, Ryad Chellali, Catherine Wing Chee So, Mohammad Aldosari, Olcay Connor, Ahmad Yaser Alhaddad, and Hifza Javed. 2018. Social robots and wearable sensors for mitigating meltdowns in autism-A pilot test. In Social Robotics: 10th International Conference, ICSR 2018, Qingdao, China, November 28-30, 2018, Proceedings 10. Springer, 103–114.Google ScholarCross Ref
- John-John Cabibihan, Hifza Javed, Marcelo Ang, and Sharifah Mariam Aljunied. 2013. Why robots? A survey on the roles and benefits of social robots in the therapy of children with autism. International journal of social robotics 5 (2013), 593–618. https://doi.org/10.1007/s12369-013-0202-2Google ScholarCross Ref
- Joshua J Diehl, Lauren M Schmitt, Michael Villano, and Charles R Crowell. 2012. The clinical use of robots for individuals with autism spectrum disorders: A critical review. Research in autism spectrum disorders 6, 1 (2012), 249–262. https://doi.org/10.1016/j.rasd.2011.05.006Google Scholar
- Pernille Dyrbjerg, Maria Vedel, and Lennart Pedersen. 2007. Everyday education: Visual support for children with autism. Jessica Kingsley Publishers.Google Scholar
- Hadeel Faras, Nahed Al Ateeqi, and Lee Tidmarsh. 2010. Autism spectrum disorders. Annals of Saudi medicine 30, 4 (2010), 295–300. doi: 10.4103/0256-4947.65261Google ScholarCross Ref
- Jennifer B Ganz and Richard L Simpson. 2004. Effects on communicative requesting and speech development of the picture exchange communication system in children with characteristics of autism. Journal of autism and developmental disorders 34 (2004), 395–409.Google ScholarCross Ref
- Paul Gringras, Dido Green, Barry Wright, Carla Rush, Masako Sparrowhawk, Karen Pratt, Victoria Allgar, Naomi Hooke, Danielle Moore, Zenobia Zaiwalla, 2014. Weighted blankets and sleep in autistic children—A randomized controlled trial. Pediatrics 134, 2 (2014), 298–306.Google ScholarCross Ref
- Patricia Heidt. 1981. Effect of therapeutic touch on anxiety level of hospitalized patients. Nursing Research 30, 1 (1981), 32–37.Google ScholarCross Ref
- Hideki Kozima, Cocoro Nakagawa, and Yuriko Yasuda. 2007. Children–robot interaction: a pilot study in autism therapy. Progress in brain research 164 (2007), 385–400. https://doi.org/10.1016/S0079-6123(07)64021-7Google Scholar
- Justin B Leaf, Misty L Oppenheim-Leaf, Ronald Leaf, Andrea B Courtemanche, Mitchell Taubman, John McEachin, Jan B Sheldon, and James A Sherman. 2012. Observational effects on the preferences of children with autism. Journal of Applied Behavior Analysis 45, 3 (2012), 473–483. https://doi.org/10.1901/jaba.2012.45-473Google ScholarCross Ref
- Samantha M Loi, Alice Bennett, Marta Pearce, Khanh Nguyen, Nicola T Lautenschlager, Rajiv Khosla, and Dennis Velakoulis. 2018. A pilot study exploring staff acceptability of a socially assistive robot in a residential care facility that accommodates people under 65 years old. International psychogeriatrics 30, 7 (2018), 1075–1080.Google ScholarCross Ref
- Matthew J Maenner, Zachary Warren, Ashley Robinson Williams, Esther Amoakohene, Amanda V Bakian, Deborah A Bilder, Maureen S Durkin, Robert T Fitzgerald, Sarah M Furnier, Michelle M Hughes, 2023. Prevalence and characteristics of autism spectrum disorder among children aged 8 years—Autism and Developmental Disabilities Monitoring Network, 11 sites, United States, 2020. MMWR Surveillance Summaries 72, 2 (2023), 1. https://www.cdc.gov/mmwr/volumes/72/ss/ss7202a1.htm?s_cid=ss7202a1_wGoogle ScholarCross Ref
- Paola Pennisi, Alessandro Tonacci, Gennaro Tartarisco, Lucia Billeci, Liliana Ruta, Sebastiano Gangemi, and Giovanni Pioggia. 2016. Autism and social robotics: A systematic review. Autism Research 9, 2 (2016), 165–183. https://doi.org/10.1002/aur.1527Google ScholarCross Ref
- Jasmine Phung, Melanie Penner, Clémentine Pirlot, and Christie Welch. 2021. What I wish you knew: Insights on burnout, inertia, meltdown, and shutdown from autistic youth. Frontiers in Psychology (2021), 4981. https://doi.org/10.3389/fpsyg.2021.741421Google Scholar
- Bertram O Ploog, Alexa Scharf, DeShawn Nelson, and Patricia J Brooks. 2013. Use of computer-assisted technologies (CAT) to enhance social, communicative, and language development in children with autism spectrum disorders. Journal of autism and developmental disorders 43 (2013), 301–322.Google ScholarCross Ref
- Kathleen A Quill. 1997. Instructional considerations for young children with autism: The rationale for visually cued instruction. Journal of autism and developmental disorders 27, 6 (1997), 697.Google ScholarCross Ref
- Isabelle Rapin. 1991. Autistic Children: Diagnosis and Clinical Features. Pediatrics 87, 5 (05 1991), 751–760. https://doi.org/10.1542/peds.87.5.751 arXiv:https://publications.aap.org/pediatrics/article-pdf/87/5/751/980159/751.pdfGoogle Scholar
- Florence D DiGennaro Reed, Sarah R Hyman, and Jason M Hirst. 2011. Applications of technology to teach social skills to children with autism. Research in Autism Spectrum Disorders 5, 3 (2011), 1003–1010. https://doi.org/10.1016/j.rasd.2011.01.022Google ScholarCross Ref
- Ben Robins, Paul Dickerson, Penny Stribling, and Kerstin Dautenhahn. 2004. Robot-mediated joint attention in children with autism: A case study in robot-human interaction. Interaction studies 5, 2 (2004), 161–198. https://doi.org/10.1075/is.5.2.02robGoogle ScholarCross Ref
- Joan Sol Roo, Renaud Gervais, Jeremy Frey, and Martin Hachet. 2017. Inner garden: Connecting inner states to a mixed reality sandbox for mindfulness. In Proceedings of the 2017 CHI conference on human factors in computing systems. 1459–1470. https://doi.org/10.1145/3025453.3025743Google ScholarDigital Library
- Sara Ryan. 2010. ‘Meltdowns’, surveillance and managing emotions; going out with children with autism. Health & Place 16, 5 (2010), 868–875. https://doi.org/10.1016/j.healthplace.2010.04.012Google ScholarCross Ref
- Mohammed A Saleh, Fazah Akhtar Hanapiah, and Habibah Hashim. 2021. Robot applications for autism: a comprehensive review. Disability and Rehabilitation: Assistive Technology 16, 6 (2021), 580–602. https://doi.org/10.1007/s12369-018-0508-1Google ScholarCross Ref
- Brian Scassellati, Henny Admoni, and Maja Matarić. 2012. Robots for use in autism research. Annual review of biomedical engineering 14 (2012), 275–294.Google Scholar
- Arielle AJ Scoglio, Erin D Reilly, Jay A Gorman, and Charles E Drebing. 2019. Use of social robots in mental health and well-being research: systematic review. Journal of medical Internet research 21, 7 (2019), e13322.Google ScholarCross Ref
- Katta Spiel, Christopher Frauenberger, Os Keyes, and Geraldine Fitzpatrick. 2019. Agency of Autistic Children in Technology Research—A Critical Literature Review. ACM Trans. Comput.-Hum. Interact. 26, 6, Article 38 (nov 2019), 40 pages. https://doi.org/10.1145/3344919Google ScholarDigital Library
- Adriana Tapus, Andreea Peca, Amir Aly, Cristina Pop, Lavinia Jisa, Sebastian Pintea, Alina S Rusu, and Daniel O David. 2012. Children with autism social engagement in interaction with Nao, an imitative robot: A series of single case experiments. Interaction studies 13, 3 (2012), 315–347. https://doi.org/doi.org/10.1075/is.13.3.01tapGoogle ScholarCross Ref
- Emelie Maria Thoren, Boris Metze, Christoph Bührer, and Lars Garten. 2013. Online support for parents of preterm infants: a qualitative and content analysis of Facebook ‘preemie’groups. Archives of Disease in Childhood-Fetal and Neonatal Edition 98, 6 (2013), F534–F538. https://doi.org/10.1136/archdischild-2012-303572Google ScholarCross Ref
- Bram Vanderborght, Ramona Simut, Jelle Saldien, Cristina Pop, Alina S Rusu, Sebastian Pintea, Dirk Lefeber, and Daniel O David. 2012. Using the social robot probo as a social story telling agent for children with ASD. Interaction Studies 13, 3 (2012), 348–372. https://doi.org/doi.org/10.1075/is.13.3.02vanGoogle ScholarCross Ref
- Joshua Wainer, Kerstin Dautenhahn, Ben Robins, and Farshid Amirabdollahian. 2014. A pilot study with a novel setup for collaborative play of the humanoid robot KASPAR with children with autism. International journal of social robotics 6 (2014), 45–65. https://doi.org/10.1007/s12369-013-0195-xGoogle ScholarCross Ref
Index Terms
- Prototyping Kodi: Defining Design Requirements to Develop a Virtual Chat-bot for Autistic Children and Their Caregivers
Recommendations
Facilitating Pretend Play in Autistic Children: Results from an Augmented Reality App Evaluation
ASSETS '18: Proceedings of the 20th International ACM SIGACCESS Conference on Computers and AccessibilityAutistic children find pretend play difficult. Previous work suggests Augmented Reality (AR) has potential in eliciting pretend play in children with autism. This paper presents the evaluation of an Augmented Reality app to help autistic children engage ...
Autistic Children's Use of Technology and Media: A Fieldwork Study
IDC '17: Proceedings of the 2017 Conference on Interaction Design and ChildrenThis qualitative field study conducted at a school for autistic children aimed to explain how low and medium functioning autistic children use technology at school. Additionally, it explored education professionals and parents' attitudes and concerns ...
Understanding Neurodiverse Social Play Between Autistic and Non-Autistic Children
CHI '24: Proceedings of the CHI Conference on Human Factors in Computing SystemsSocial play supports children to develop essential life skills and foster friendships. However, autistic and non-autistic children often do not have equal opportunities to engage in social play. Previous research to improve these opportunities tends to ...
Comments