skip to main content
10.1145/3584931.3606958acmconferencesArticle/Chapter ViewAbstractPublication PagescscwConference Proceedingsconference-collections
research-article

Prototyping Kodi: Defining Design Requirements to Develop a Virtual Chat-bot for Autistic Children and Their Caregivers

Published: 14 October 2023 Publication History

Abstract

Autistic children’s emotional meltdown is a common challenge faced by their caregivers, including their teachers and families. Communicating their problems can be extremely challenging for many autistic children, making it difficult for caregivers to identify the triggers of these meltdowns. Previous studies have revealed that autistic children find it easier to communicate with non-human objects, such as comfort dolls or social robots. In light of this, we have designed Kodi, a mobile virtual conversational agent aimed at bridging the communication gap between autistic children and their caregivers during distressing situations. Kodi’s appearance can be personalized to match the child’s favorite characters, such as a bunny or a dinosaur. To provide additional comfort, Kodi comes with furry phone cases that offer haptic stimulation. When the child faces stressful situations, caregivers can prompt Kodi on children’s mobile device, allowing the child to express their emotions with various input modalities (emojis, text, voice) and listen to soothing stories. Caregivers can tailor these stories to suit each child’s unique needs. Furthermore, Kodi will employ keyword analysis to summarize conversations, identify potential triggers for emotional meltdowns (e.g., loud noises in a shopping mall, unexpected changes at school), and alert caregivers of potential problems, such as bullying. The data collected through Kodi holds the potential to be leveraged for predicting emotional meltdowns using machine learning techniques. This paper discusses the implications of the Kodi platform and outlines future research directions in this area.

References

[1]
Sara Bernardini, Kaśka Porayska-Pomsta, and Tim J Smith. 2014. ECHOES: An intelligent serious game for fostering social communication in children with autism. Information Sciences 264 (2014), 41–60. https://doi.org/10.1016/j.ins.2013.10.027
[2]
John-John Cabibihan, Ryad Chellali, Catherine Wing Chee So, Mohammad Aldosari, Olcay Connor, Ahmad Yaser Alhaddad, and Hifza Javed. 2018. Social robots and wearable sensors for mitigating meltdowns in autism-A pilot test. In Social Robotics: 10th International Conference, ICSR 2018, Qingdao, China, November 28-30, 2018, Proceedings 10. Springer, 103–114.
[3]
John-John Cabibihan, Hifza Javed, Marcelo Ang, and Sharifah Mariam Aljunied. 2013. Why robots? A survey on the roles and benefits of social robots in the therapy of children with autism. International journal of social robotics 5 (2013), 593–618. https://doi.org/10.1007/s12369-013-0202-2
[4]
Joshua J Diehl, Lauren M Schmitt, Michael Villano, and Charles R Crowell. 2012. The clinical use of robots for individuals with autism spectrum disorders: A critical review. Research in autism spectrum disorders 6, 1 (2012), 249–262. https://doi.org/10.1016/j.rasd.2011.05.006
[5]
Pernille Dyrbjerg, Maria Vedel, and Lennart Pedersen. 2007. Everyday education: Visual support for children with autism. Jessica Kingsley Publishers.
[6]
Hadeel Faras, Nahed Al Ateeqi, and Lee Tidmarsh. 2010. Autism spectrum disorders. Annals of Saudi medicine 30, 4 (2010), 295–300.
[7]
Jennifer B Ganz and Richard L Simpson. 2004. Effects on communicative requesting and speech development of the picture exchange communication system in children with characteristics of autism. Journal of autism and developmental disorders 34 (2004), 395–409.
[8]
Paul Gringras, Dido Green, Barry Wright, Carla Rush, Masako Sparrowhawk, Karen Pratt, Victoria Allgar, Naomi Hooke, Danielle Moore, Zenobia Zaiwalla, 2014. Weighted blankets and sleep in autistic children—A randomized controlled trial. Pediatrics 134, 2 (2014), 298–306.
[9]
Patricia Heidt. 1981. Effect of therapeutic touch on anxiety level of hospitalized patients. Nursing Research 30, 1 (1981), 32–37.
[10]
Hideki Kozima, Cocoro Nakagawa, and Yuriko Yasuda. 2007. Children–robot interaction: a pilot study in autism therapy. Progress in brain research 164 (2007), 385–400. https://doi.org/10.1016/S0079-6123(07)64021-7
[11]
Justin B Leaf, Misty L Oppenheim-Leaf, Ronald Leaf, Andrea B Courtemanche, Mitchell Taubman, John McEachin, Jan B Sheldon, and James A Sherman. 2012. Observational effects on the preferences of children with autism. Journal of Applied Behavior Analysis 45, 3 (2012), 473–483. https://doi.org/10.1901/jaba.2012.45-473
[12]
Samantha M Loi, Alice Bennett, Marta Pearce, Khanh Nguyen, Nicola T Lautenschlager, Rajiv Khosla, and Dennis Velakoulis. 2018. A pilot study exploring staff acceptability of a socially assistive robot in a residential care facility that accommodates people under 65 years old. International psychogeriatrics 30, 7 (2018), 1075–1080.
[13]
Matthew J Maenner, Zachary Warren, Ashley Robinson Williams, Esther Amoakohene, Amanda V Bakian, Deborah A Bilder, Maureen S Durkin, Robert T Fitzgerald, Sarah M Furnier, Michelle M Hughes, 2023. Prevalence and characteristics of autism spectrum disorder among children aged 8 years—Autism and Developmental Disabilities Monitoring Network, 11 sites, United States, 2020. MMWR Surveillance Summaries 72, 2 (2023), 1. https://www.cdc.gov/mmwr/volumes/72/ss/ss7202a1.htm?s_cid=ss7202a1_w
[14]
Paola Pennisi, Alessandro Tonacci, Gennaro Tartarisco, Lucia Billeci, Liliana Ruta, Sebastiano Gangemi, and Giovanni Pioggia. 2016. Autism and social robotics: A systematic review. Autism Research 9, 2 (2016), 165–183. https://doi.org/10.1002/aur.1527
[15]
Jasmine Phung, Melanie Penner, Clémentine Pirlot, and Christie Welch. 2021. What I wish you knew: Insights on burnout, inertia, meltdown, and shutdown from autistic youth. Frontiers in Psychology (2021), 4981. https://doi.org/10.3389/fpsyg.2021.741421
[16]
Bertram O Ploog, Alexa Scharf, DeShawn Nelson, and Patricia J Brooks. 2013. Use of computer-assisted technologies (CAT) to enhance social, communicative, and language development in children with autism spectrum disorders. Journal of autism and developmental disorders 43 (2013), 301–322.
[17]
Kathleen A Quill. 1997. Instructional considerations for young children with autism: The rationale for visually cued instruction. Journal of autism and developmental disorders 27, 6 (1997), 697.
[18]
Isabelle Rapin. 1991. Autistic Children: Diagnosis and Clinical Features. Pediatrics 87, 5 (05 1991), 751–760. https://doi.org/10.1542/peds.87.5.751 arXiv:https://publications.aap.org/pediatrics/article-pdf/87/5/751/980159/751.pdf
[19]
Florence D DiGennaro Reed, Sarah R Hyman, and Jason M Hirst. 2011. Applications of technology to teach social skills to children with autism. Research in Autism Spectrum Disorders 5, 3 (2011), 1003–1010. https://doi.org/10.1016/j.rasd.2011.01.022
[20]
Ben Robins, Paul Dickerson, Penny Stribling, and Kerstin Dautenhahn. 2004. Robot-mediated joint attention in children with autism: A case study in robot-human interaction. Interaction studies 5, 2 (2004), 161–198. https://doi.org/10.1075/is.5.2.02rob
[21]
Joan Sol Roo, Renaud Gervais, Jeremy Frey, and Martin Hachet. 2017. Inner garden: Connecting inner states to a mixed reality sandbox for mindfulness. In Proceedings of the 2017 CHI conference on human factors in computing systems. 1459–1470. https://doi.org/10.1145/3025453.3025743
[22]
Sara Ryan. 2010. ‘Meltdowns’, surveillance and managing emotions; going out with children with autism. Health & Place 16, 5 (2010), 868–875. https://doi.org/10.1016/j.healthplace.2010.04.012
[23]
Mohammed A Saleh, Fazah Akhtar Hanapiah, and Habibah Hashim. 2021. Robot applications for autism: a comprehensive review. Disability and Rehabilitation: Assistive Technology 16, 6 (2021), 580–602. https://doi.org/10.1007/s12369-018-0508-1
[24]
Brian Scassellati, Henny Admoni, and Maja Matarić. 2012. Robots for use in autism research. Annual review of biomedical engineering 14 (2012), 275–294.
[25]
Arielle AJ Scoglio, Erin D Reilly, Jay A Gorman, and Charles E Drebing. 2019. Use of social robots in mental health and well-being research: systematic review. Journal of medical Internet research 21, 7 (2019), e13322.
[26]
Katta Spiel, Christopher Frauenberger, Os Keyes, and Geraldine Fitzpatrick. 2019. Agency of Autistic Children in Technology Research—A Critical Literature Review. ACM Trans. Comput.-Hum. Interact. 26, 6, Article 38 (nov 2019), 40 pages. https://doi.org/10.1145/3344919
[27]
Adriana Tapus, Andreea Peca, Amir Aly, Cristina Pop, Lavinia Jisa, Sebastian Pintea, Alina S Rusu, and Daniel O David. 2012. Children with autism social engagement in interaction with Nao, an imitative robot: A series of single case experiments. Interaction studies 13, 3 (2012), 315–347. https://doi.org/doi.org/10.1075/is.13.3.01tap
[28]
Emelie Maria Thoren, Boris Metze, Christoph Bührer, and Lars Garten. 2013. Online support for parents of preterm infants: a qualitative and content analysis of Facebook ‘preemie’groups. Archives of Disease in Childhood-Fetal and Neonatal Edition 98, 6 (2013), F534–F538. https://doi.org/10.1136/archdischild-2012-303572
[29]
Bram Vanderborght, Ramona Simut, Jelle Saldien, Cristina Pop, Alina S Rusu, Sebastian Pintea, Dirk Lefeber, and Daniel O David. 2012. Using the social robot probo as a social story telling agent for children with ASD. Interaction Studies 13, 3 (2012), 348–372. https://doi.org/doi.org/10.1075/is.13.3.02van
[30]
Joshua Wainer, Kerstin Dautenhahn, Ben Robins, and Farshid Amirabdollahian. 2014. A pilot study with a novel setup for collaborative play of the humanoid robot KASPAR with children with autism. International journal of social robotics 6 (2014), 45–65. https://doi.org/10.1007/s12369-013-0195-x

Cited By

View all
  • (2024)Envisioning Possibilities and Challenges of AI for Personalized Cancer CareCompanion Publication of the 2024 Conference on Computer-Supported Cooperative Work and Social Computing10.1145/3678884.3681885(415-421)Online publication date: 11-Nov-2024

Index Terms

  1. Prototyping Kodi: Defining Design Requirements to Develop a Virtual Chat-bot for Autistic Children and Their Caregivers

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    CSCW '23 Companion: Companion Publication of the 2023 Conference on Computer Supported Cooperative Work and Social Computing
    October 2023
    596 pages
    ISBN:9798400701290
    DOI:10.1145/3584931
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 14 October 2023

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. autism
    2. conversational agent
    3. social chat bot

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Conference

    CSCW '23
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 2,235 of 8,521 submissions, 26%

    Upcoming Conference

    CSCW '25

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)255
    • Downloads (Last 6 weeks)16
    Reflects downloads up to 17 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Envisioning Possibilities and Challenges of AI for Personalized Cancer CareCompanion Publication of the 2024 Conference on Computer-Supported Cooperative Work and Social Computing10.1145/3678884.3681885(415-421)Online publication date: 11-Nov-2024

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media