skip to main content
research-article

CheerBrush: A Novel Interactive Augmented Reality Coaching System for Toothbrushing Skills in Children with Autism Spectrum Disorder

Published: 15 October 2021 Publication History

Abstract

Autism Spectrum Disorder (ASD) is a common neurodevelopmental disorder that impacts one in every 54 children in the United States. Some children with ASD have learning and fine motor skill challenges that contribute to difficulties completing daily living tasks such as toothbrushing. Lack of toothbrushing skills may cause increased need for dental care and negative social feedback from peers. Technology based intelligent support systems offer the advantages of being accessible, engaging, and cost-effective. In this work, we present a novel interactive augmented reality coaching system, CheerBrush, to improve the toothbrushing skills of children with ASD. CheerBrush allows children to manipulate virtual objects like a toothbrush and toothpaste with their actual hand motions to practice the steps of toothbrushing. The virtual tasks of CheerBrush demonstrate these steps using audio and visual cues, while also showing the brushing process through a virtual avatar. CheerBrush also assesses toothbrushing skills with a custom designed mechatronic toothbrush to evaluate the system's coaching effectiveness. A feasibility study with 12 children (six children with ASD and six typically developing children) was conducted to evaluate the acceptability and effectiveness of CheerBrush. The data showed improvements in the toothbrushing motions and reduced stress for the children in the post-test. CheerBrush detects real-time movement of children and interacts with them by augmented reality, feedback and multimodal hints. We believe that CheerBrush has the potential to provide a low-cost, engaging and, beneficial intelligent support system to improve the toothbrushing skills of children with ASD.

References

[1]
J. Baio. 2012. Prevalence of autism spectrum disorders: Autism and developmental disabilities monitoring network, 14 sites, United States, 2008. In Autism Spectrum Disorders: Guidance, Research and Federal Activity 2012.
[2]
Y. S. Kim et al. 2011. Prevalence of autism spectrum disorders in a total population sample. Am. J. Psychiatry 2011, DOI:https://doi.org/10.1176/appi.ajp.2011.10101532
[3]
C. P. Johnson et al. 2007. Identification and evaluation of children with autism spectrum disorders. Pediatrics. 2007, DOI:
[4]
M. J. Maenner et al. 2020. Prevalence of autism spectrum disorder among children aged 8 years-autism and developmental disabilities monitoring network, 11 Sites, United States, 2016. MMWR Surveill. Summ. 69, 4 (2020), 1–12, DOI:
[5]
S. J. Blumberg, M. D. Bramlett, M. D. Kogan, L. A. Schieve, J. R. Jones, and M. C. Lu. 2013. Changes in prevalence of parent-reported autism spectrum disorder in school-aged U.S. children: 2007 to 2011—2012. Natl. Health Stat. Report. 2013.
[6]
P. Howlin, L. Magiati, and T. Charman. 2009. Systematic review of early intensive behavioral interventions for children with autism. American Journal on Intellectual and Developmental Disabilities 2009, DOI:
[7]
R. Iovannone, G. Dunlap, H. Huber, and D. Kincaid. 2003. Effective educational practices for students with autism spectrum disorders. Focus Autism Other Dev. Disabl. 18, 3 (2003), 150–165, DOI:
[8]
B. Braddock and K. Twyman. 2014. Access to treatment for toddlers with autism spectrum disorders. Clin. Pediatr. (Phila). 2014, DOI:
[9]
S. Bonis. 2016. Stress and parents of children with autism: A review of literature. Issues Ment. Health Nurs. 2016, DOI:
[10]
M. A. Maglione, D. Gans, L. Das, J. Timbie, and C. Kasari. 2012. Nonmedical interventions for children with ASD: Recommended guidelines and further research needs. Pediatrics 2012, DOI:
[11]
M. L. Ganz. 2007. The lifetime distribution of the incremental societal costs of autism. Arch. Pediatr. Adolesc. Med. 2007, DOI:
[12]
L. Kenny, C. Hattersley, B. Molins, C. Buckley, C. Povey, and E. Pellicano. 2016. Which terms should be used to describe autism? Perspectives from the UK autism community. Autism 2016, DOI:
[13]
B. O. Ploog, A. Scharf, D. Nelson, and P. J. Brooks. 2013. Use of computer-assisted technologies (CAT) to enhance social, communicative, and language development in children with autism spectrum disorders. J. Autism Dev. Disord. 43, 2 (2013), 301–322, DOI:
[14]
A. L. Wainer and B. R. Ingersoll. 2011. The use of innovative computer technology for teaching social communication to individuals with autism spectrum disorders. Res. Autism Spectr. Disord. 5, 1 (2011), 96–107, DOI:
[15]
W. Christine, B. Wright, G. Callaghan, and B. Coughlan. 2002. Do children with autism learn to read more readily by computer assisted instruction or traditional book methods? Autism pp. 71–91, 2002.
[16]
H. C. Shane and P. D. Albert. 2008. Electronic screen media for persons with autism spectrum disorders: Results of a survey. J. Autism Dev. Disord. 38, 8 (2008), 1499–1508, DOI:
[17]
R. C. Pennington. 2010. Computer-assisted instruction for teaching academic skills to students with autism spectrum disorders: A review of literature. Focus Autism Other Dev. Disabl. 25, 4 (2010), 239–248, DOI:
[18]
S. Parsons and S. Cobb. 2011. State-of-the-art of virtual reality technologies for children on the autism spectrum. Eur. J. Spec. Needs Educ. 26, 3 (2011), 355–366, DOI:
[19]
D. Strickland. 1997. Virtual reality for the treatment of autism. Stud. Health Technol. Inform. 1997, DOI:
[21]
[22]
J. Wade et al. 2014. Design of a virtual reality driving environment to assess performance of teenagers with ASD. 2014, DOI:
[23]
H. Zhao, Z. Zheng, A. Swanson, A. Weitlauf, Z. Warren, and N. Sarkar. 2018. Design of a haptic-gripper virtual reality system (HG) for analyzing fine motor behaviors in children with autism. ACM Trans. Access. Comput. 11, 4 (2018), DOI:
[24]
M. R. Kandalaft, N. Didehbani, D. C. Krawczyk, T. T. Allen, and S. B. Chapman. 2013. Virtual reality social cognition training for young adults with high-functioning autism. J. Autism Dev. Disord. 2013, DOI:
[25]
J. Carmigniani, B. Furht, M. Anisetti, P. Ceravolo, E. Damiani, and M. Ivkovic. 2011. Augmented reality technologies, systems and applications. Multimed. Tools Appl. 51, 1 (2011), 341–377, DOI:
[26]
S. C.-Y. Yuen, G. Yaoyuneyong, and E. Johnson. 2011. Augmented reality: An overview and five directions for AR in education. J. Educ. Technol. Dev. Exch. 4, 1 (2011), DOI:
[27]
X. Casas, G. Herrera, I. Coma, and M. Fernández. 2012. A Kinect-based augmented reality system for individuals with autism spectrum disorders. GRAPP 2012 IVAPP 2012 - Proc. Int. Conf. Comput. Graph. Theory Appl. Int. Conf. Inf. Vis. Theory Appl. pp. 440–446, 2012, DOI:
[28]
A. Hartholt et al. 2019. Virtual humans in augmented reality: A first step towards real-world embedded virtual roleplayers. HAI 2019 - Proc. 7th Int. Conf. Human-Agent Interact. pp. 205–207, 2019, DOI:
[30]
R. Liu, J. P. Salisbury, A. Vahabzadeh, and N. T. Sahin. 2017. Feasibility of an autism-focused augmented reality smartglasses system for social communication and behavioral coaching. Front. Pediatr. 5, June (2017), 1–8, DOI:
[31]
K. Khowaja et al. 2020. Augmented reality for learning of children and adolescents with autism spectrum disorder (ASD): A systematic review. IEEE Access 8 (2020), 78779–78807, DOI:
[32]
American Academy of Pediatric Dentistry. 2013. Guideline on caries-risk assessment and management for infants, children, and adolescents, no. 35, 5:E157. Pediatric Dentistry, 2013.
[33]
R. Y. Du, C. K. Y. Yiu, and N. M. King. 2019. Oral health behaviours of preschool children with autism spectrum disorders and their barriers to dental care. J. Autism Dev. Disord. 49, 2 (2019), 453–459, DOI:
[34]
P. Kaur et al. 2017. Impact of dental disorders and its influence on self esteem levels among adolescents. J. Clin. Diagnostic Res. 11, 4 (2017), ZC05–ZC08, DOI:
[35]
L. Mckeown. 2003. Social relations and breath odour. International Journal of Dental Hygiene 1, 4 (2003), 213--217.
[36]
F. Knott, A. W. Dunlop, and T. Mackay. 2006. Living with ASD: How do children and their parents assess their difficulties with social interaction and understanding? Autism 10, 6 (2006), 609–617, DOI:
[37]
B. Lai, M. Milano, M. W. Roberts, and S. R. Hooper. 2012. Unmet dental needs and barriers to dental care among children with autism spectrum disorders. J. Autism Dev. Disord. 42, 7 (2012), 1294–1303, DOI:
[38]
C. Lauren and B. Enrique. 2012. Preferences of parents of children with autism spectrum disorders concerning oral health and dental treatment. 34, December (2012), 480–484.
[39]
A. J. Cuvo, A. Godard, R. Huckfeldt, and R. Demattei. 2010. Training children with autism spectrum disorders to be compliant with an oral assessment. Res. Autism Spectr. Disord. 4, 4 (2010), 681–696, DOI:
[40]
MacDonald, Megan, Catherine Lord, and Dale A. Ulrich. 2014. Motor skills and calibrated autism severity in young children with autism spectrum disorder. Adapted Physical Activity Quarterly 31, 2 (2014), 95--105.
[41]
L. T. Chistol, L. G. Bandini, A. Must, S. Phillips, S. A. Cermak, and C. Curtin. 2018. Sensory sensitivity and food selectivity in children with autism spectrum disorder. J. Autism Dev. Disord. 48, 2 (2018), 583–591, DOI:
[42]
M. Teste, A. Broutin, M. Marty, M. C. Valéra, F. Soares Cunha, and E. Noirrit-Esclassan. 2021. Toothbrushing in children with autism spectrum disorders: Qualitative analysis of parental difficulties and solutions in France. Eur. Arch. Paediatr. Dent. no. 0123456789, 2021, DOI:
[43]
E. J. H. Jones, G. Dawson, J. Kelly, A. Estes, and S. Jane Webb. 2017. Parent-delivered early intervention in infants at risk for ASD: Effects on electrophysiological and habituation measures of social attention. Autism Res. 10, 5 (2017), 961–972, DOI:
[44]
R. R. Taylor et al. 2009. Volitional change in children with autism: A single-case design study of the impact of hippotherapy on motivation. Occup. Ther. Ment. Heal. 25, 2 (2009), 192–200, DOI:
[45]
G. Restall and J. Magill-Evans. 1994. Play and preschool children with autism. Am. J. Occup. Ther. Off. Publ. Am. Occup. Ther. Assoc. 48, 2 (1994), 113–120, DOI:
[46]
A. Rega, A. Mennitto, S. Vita, and L. Iovino. 2018. New technologies and autism: Can augmented reality (AR) increase the motivation in children with autism? INTED2018 Proc. 1, March (2018), 4904–4910, DOI:
[47]
S. Lopez Cazaux, G. Lefer, A. Rouches, and P. Bourdon. 2019. Toothbrushing training programme using an iPad® for children and adolescents with autism. Eur. Arch. Paediatr. Dent. 20, 3 (2019), 277–284, DOI:
[48]
D. F. Cihak, E. J. Moore, R. E. Wright, D. D. McMahon, M. M. Gibbons, and C. Smith. 2016. Evaluating augmented reality to complete a chain task for elementary students with autism. J. Spec. Educ. Technol. 31, 2 (2016), 99–108, DOI:
[49]
O. B. Al-Batayneh, T. S. Nazer, Y. S. Khader, and A. I. Owais. 2020. Effectiveness of a tooth-brushing programme using the picture exchange communication system (PECS) on gingival health of children with autism spectrum disorders. Eur. Arch. Paediatr. Dent. 21, 2 (2020), 277–283, DOI:
[50]
W. Cheung et al. 2018. Brush up to a healthy smile: developing and testing an oral health education kit for children with autism spectrum disorder. Community Heal. Proj. 2018.
[51]
D. Jacobson, J. Jacobson, T. Leong, S. Lourenco, L. Mancl, and D. L. Chi. 2019. Evaluating child toothbrushing behavior changes associated with a mobile game app: A single arm pre/post pilot study. Pediatr. Dent. 2019.
[52]
C. Chuko, F. L. Chao, and H. Y. Tsai. 2020. Design of interactive aids for children's teeth cleaning habits. Adv. Sci. Technol. Eng. Syst. 2020, DOI:
[53]
N. Fijačko et al. 2020. The effects of gamification and oral self-care on oral hygiene in children: Systematic search in app stores and evaluation of apps JMIR mHealth uHealth 2020, DOI:
[54]
M. Slater and M. V. Sanchez-Vives. 2016. Enhancing our lives with immersive virtual reality. Frontiers Robotics AI. 2016, DOI:
[55]
Unity3D, Unity Editor. https://unity.com/.
[56]
R. O. Kellems, C. Charlton, K. S. Kversøy, and M. Győri. 2020. Exploring the use of virtual characters (avatars), live animation, and augmented reality to teach social skills to individuals with autism. Multimodal Technol. Interact. 4, 3 (2020), 1–11, DOI:
[57]
J. F. Herrero and G. Lorenzo. 2020. An immersive virtual reality educational intervention on people with autism spectrum disorders (ASD) for the development of communication skills and problem solving. Educ. Inf. Technol. 25, 3 (2020), 1689–1722, DOI:
[58]
L. Bozgeyikli, A. Raij, S. Katkoori, and R. Alqasemi. 2018. A survey on virtual reality for individuals with autism spectrum disorder: Design considerations. IEEE Trans. Learn. Technol. 11, 2 (2018), 133–151, DOI:
[59]
Y. J. Lan, W. C. Fang, I. Y. T. Hsiao, and N. S. Chen. 2018. Real body versus 3D avatar: The effects of different embodied learning types on EFL listening comprehension. Educ. Technol. Res. Dev. 66, 3 (2018), 709–731, DOI:
[65]
N. Semiconductor, “nRF24L01.” https://www.sparkfun.com/products/691.
[67]
[68]
J. F. Thayer, F. Åhs, M. Fredrikson, J. J. Sollers, and T. D. Wager. 2012. A meta-analysis of heart rate variability and neuroimaging studies: Implications for heart rate variability as a marker of stress and health. Neuroscience and Biobehavioral Reviews. 2012, DOI:
[69]
A. C. Fletcher, C. Buehler, A. L. McCurdy, and B. B. Weymouth. 2019. Skin conductance reactivity as a moderator of associations between youth perceptions of neighborhood stress and depressive symptoms. J. Early Adolesc. 2019, DOI:
[70]
R. Baheti and H. Gill. Cyber-physical systems. 2011.
[71]
C. Lord, M. Rutter, P. C. DiLavore, S. Risi, K. Gotham, and S. Bishop. 2012. Autism diagnostic observation schedule, second edition. Torrance, CA West. Psychol. Serv. 2012.
[72]
V. Pterneas. 2015. How to use Kinect HD face. 2015. https://pterneas.com/2014/12/21/kinect-2-face-basics/.
[73]
M. Krzywinski and N. Altman. 2013. Points of significance: Significance, P values and t-tests. Nature Methods. 2013, DOI:
[74]
American Dental Association. 2019. Mouth healthy: Brushing your teeth. 2019.
[75]
Y. J. Lee et al. 2012. Toothbrushing region detection using three-axis accelerometer and magnetic sensor. IEEE Trans. Biomed. Eng. 2012, DOI:
[76]
C. Setz, B. Arnrich, J. Schumm, R. La Marca, G. Tröster, and U. Ehlert. 2010. Discriminating stress from cognitive load using a wearable EDA device. IEEE Trans. Inf. Technol. Biomed. 2010, DOI:
[77]
T. F. D. Farrow, N. K. Johnson, M. D. Hunter, A. T. Barker, I. D. Wilkinson, and P. W. R. Woodruff. 2013. Neural correlates of the behavioral-autonomic interaction response to potentially threatening stimuli. Front. Hum. Neurosci. 2013, DOI:
[78]
L. Zhou, J. Bao, I. M. A. Setiawan, A. Saptono, and B. Parmanto. 2019. The mHealth app usability questionnaire (MAUQ): Development and validation study. JMIR mHealth uHealth, 2019, DOI:
[79]
Pyramid Educational Consultants, Picture Exchange Communication System (PECS). https://pecsusa.com/pecs/.

Cited By

View all
  • (2024)Prediction Models of Collaborative Behaviors in Dyadic Interactions: An Application for Inclusive Teamwork Training in Virtual EnvironmentsSignals10.3390/signals50200195:2(382-401)Online publication date: 3-Jun-2024
  • (2024)The Use of Audiovisual Distraction Tools in the Dental Setting for Pediatric Subjects with Special Healthcare Needs: A Review and Proposal of a Multi-Session Model for Behavioral ManagementChildren10.3390/children1109107711:9(1077)Online publication date: 2-Sep-2024
  • (2024)Extended Reality–Based Mobile App Solutions for the Therapy of Children With Autism Spectrum Disorders: Systematic Literature ReviewJMIR Serious Games10.2196/4990612(e49906)Online publication date: 19-Feb-2024
  • Show More Cited By

Index Terms

  1. CheerBrush: A Novel Interactive Augmented Reality Coaching System for Toothbrushing Skills in Children with Autism Spectrum Disorder

        Recommendations

        Comments

        Information & Contributors

        Information

        Published In

        cover image ACM Transactions on Accessible Computing
        ACM Transactions on Accessible Computing  Volume 14, Issue 4
        December 2021
        171 pages
        ISSN:1936-7228
        EISSN:1936-7236
        DOI:10.1145/3485142
        Issue’s Table of Contents

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        Published: 15 October 2021
        Accepted: 01 August 2021
        Revised: 01 August 2021
        Received: 01 June 2021
        Published in TACCESS Volume 14, Issue 4

        Permissions

        Request permissions for this article.

        Check for updates

        Author Tags

        1. Augmented reality
        2. virtual reality
        3. virtual tasks
        4. behavioral coaching
        5. body gesture
        6. human-computer interaction
        7. autism spectrum disorder
        8. support system
        9. toothbrushing

        Qualifiers

        • Research-article
        • Refereed

        Contributors

        Other Metrics

        Bibliometrics & Citations

        Bibliometrics

        Article Metrics

        • Downloads (Last 12 months)243
        • Downloads (Last 6 weeks)37
        Reflects downloads up to 07 Mar 2025

        Other Metrics

        Citations

        Cited By

        View all
        • (2024)Prediction Models of Collaborative Behaviors in Dyadic Interactions: An Application for Inclusive Teamwork Training in Virtual EnvironmentsSignals10.3390/signals50200195:2(382-401)Online publication date: 3-Jun-2024
        • (2024)The Use of Audiovisual Distraction Tools in the Dental Setting for Pediatric Subjects with Special Healthcare Needs: A Review and Proposal of a Multi-Session Model for Behavioral ManagementChildren10.3390/children1109107711:9(1077)Online publication date: 2-Sep-2024
        • (2024)Extended Reality–Based Mobile App Solutions for the Therapy of Children With Autism Spectrum Disorders: Systematic Literature ReviewJMIR Serious Games10.2196/4990612(e49906)Online publication date: 19-Feb-2024
        • (2024)Enhancing daily living skills in autistic individuals through extended reality: a scoping reviewInternational Journal of Developmental Disabilities10.1080/20473869.2024.2410535(1-16)Online publication date: Oct-2024
        • (2024)Experience-Oriented Intervention Strategy for Children with Autism Spectrum Disorders and Their Families: A Framework of Design and EvaluationUniversal Access in Human-Computer Interaction10.1007/978-3-031-60881-0_13(198-212)Online publication date: 29-Jun-2024
        • (2023)Application of Augmented Reality Interventions for Children with Autism Spectrum Disorder (ASD): A Systematic ReviewComputers10.3390/computers1210021512:10(215)Online publication date: 23-Oct-2023
        • (2023)Investigating Sex-Based Neural Differences in Autism and Their Extended Reality Intervention ImplicationsBrain Sciences10.3390/brainsci1311157113:11(1571)Online publication date: 9-Nov-2023
        • (2023)Effectiveness of picture‐based interventions of toothbrush training on improvement of oral hygiene in children with autism spectrum disorders: A systematic review and meta‐analysisSpecial Care in Dentistry10.1111/scd.1295044:3(686-699)Online publication date: 21-Dec-2023
        • (2023)Brush Up with AR: Supporting Children’s Enjoyable Tooth-brushing through Augmented Reality Feedback2023 14th International Conference on Information and Communication Technology Convergence (ICTC)10.1109/ICTC58733.2023.10393125(1712-1717)Online publication date: 11-Oct-2023
        • (2023)Augmented Reality to Reinforce Working Memory in Children with ASD. A Case StudiesComputer Science – CACIC 202210.1007/978-3-031-34147-2_2(21-32)Online publication date: 27-May-2023
        • Show More Cited By

        View Options

        Login options

        Full Access

        View options

        PDF

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        Full Text

        View this article in Full Text.

        Full Text

        HTML Format

        View this article in HTML Format.

        HTML Format

        Figures

        Tables

        Media

        Share

        Share

        Share this Publication link

        Share on social media