skip to main content
10.1145/3613905.3651045acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
Work in Progress

Early Autism Screening in Children Using Facial Recognition

Published: 11 May 2024 Publication History

Abstract

Facial data of children aged 2 to 10 years was collected from three institutions in a large city; an autism rehabilitation center, a rehabilitation hospital, and an inclusive kindergarten. The dataset comprised facial data of 65 children diagnosed with autism, and 47 children with typical developmental. We employed the VGG-16 model to develop a facial feature recognition-based early screening system, which involves feature extraction and image processing of eyes, eyebrows, noses, and mouths. The data was processed and categorized using a Convolutional Neural Network (CNN) model, and the accuracy of this algorithm was validated. Cross-testing with the public database Kaggle and our dataset demonstrated an accuracy rate of up to 94% for the current training set. This indicates that the model trained by our system is proficient in classifying children’s facial data and maintains high precision on our database.

Supplemental Material

MP4 File
Talk Video
Transcript for: Talk Video

References

[1]
Josephine Barbaro and Cheryl Dissanayake. 2013. Early markers of autism spectrum disorders in infants and toddlers prospectively identified in the Social Attention and Communication Study. Autism 17, 1 (2013), 64–86.
[2]
Kellen Briot, Adrien Pizano, Manuel Bouvard, and Anouck Amestoy. 2021. New technologies as promising tools for assessing facial emotion expressions impairments in ASD: a systematic review. Frontiers in psychiatry 12 (2021), 634756.
[3]
Kimberly LH Carpenter, Jordan Hahemi, Kathleen Campbell, Steven J Lippmann, Jeffrey P Baker, Helen L Egger, Steven Espinosa, Saritha Vermeer, Guillermo Sapiro, and Geraldine Dawson. 2021. Digital behavioral phenotyping detects atypical pattern of facial expression in toddlers with autism. Autism Research 14, 3 (2021), 488–499.
[4]
Keshi Dai. 2007. Early diagnosis of autism through analysis of pre-speech vocalizations. SIGACCESS Access. Comput.89 (sep 2007), 42–46. https://doi.org/10.1145/1328567.1328575
[5]
Ryan Anthony Jalova de Belen, Tomasz Bednarz, and Arcot Sowmya. 2021. EyeXplain Autism: Interactive System for Eye Tracking Data Analysis and Deep Neural Network Interpretation for Autism Spectrum Disorder Diagnosis. In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI EA ’21). Association for Computing Machinery, New York, NY, USA, Article 364, 7 pages. https://doi.org/10.1145/3411763.3451784
[6]
Huiyu Duan, Guangtao Zhai, Xiongkuo Min, Zhaohui Che, Yi Fang, Xiaokang Yang, Jesús Gutiérrez, and Patrick Le Callet. 2019. A Dataset of Eye Movements for the Children with Autism Spectrum Disorder. In Proceedings of the 10th ACM Multimedia Systems Conference (Amherst, Massachusetts) (MMSys ’19). Association for Computing Machinery, New York, NY, USA, 255–260. https://doi.org/10.1145/3304109.3325818
[7]
Centers for Disease Control, Prevention, 2023. Autism prevalence higher, according to data from 11 ADDM communities.
[8]
Frances Page Glascoe. 2003. Parents’ evaluation of developmental status: how well do parents’ concerns identify children with behavioral and emotional problems?Clinical pediatrics 42, 2 (2003), 133–138.
[9]
Golijeh Golarai, Kalanit Grill-Spector, and Allan L Reiss. 2006. Autism and the development of face processing. Clinical neuroscience research 6, 3-4 (2006), 145–160.
[10]
Antonio Gulli and Sujit Pal. 2017. Deep learning with Keras. Packt Publishing Ltd.
[11]
Alex Krizhevsky, Ilya Sutskever, and Geoffrey E Hinton. 2012. Imagenet classification with deep convolutional neural networks. Advances in neural information processing systems 25 (2012).
[12]
Yann LeCun, Léon Bottou, Yoshua Bengio, and Patrick Haffner. 1998. Gradient-based learning applied to document recognition. Proc. IEEE 86, 11 (1998), 2278–2324.
[13]
Shuo Liu, Yue Wang, and Yongning Song. 2023. Atypical facial mimicry for basic emotions in children with autism spectrum disorder. Autism Research (2023).
[14]
Wenbo Liu, Ming Li, and Li Yi. 2016. Identifying children with autism spectrum disorder based on their face processing abnormality: A machine learning framework. Autism Research 9, 8 (2016), 888–898.
[15]
Catherine Lord, Mayada Elsabbagh, Gillian Baird, and Jeremy Veenstra-Vanderweele. 2018. Autism spectrum disorder. The lancet 392, 10146 (2018), 508–520.
[16]
Angelina Lu and Marek Perkowski. 2021. Deep Learning Approach for Screening Autism Spectrum Disorder in Children with Facial Images and Analysis of Ethnoracial Factors in Model Development and Application. Brain Sciences 11, 11 (2021). https://doi.org/10.3390/brainsci11111446
[17]
Rhiannon Luyster. 2012. Autism Diagnostic Observation Schedule, (ADOS-2) Manual (Part II): Toddler Module. (2012).
[18]
Natasha Malik-Soni, Andrew Shaker, Helen Luck, Anne E Mullin, Ryan E Wiley, ME Suzanne Lewis, Joaquin Fuentes, and Thomas W Frazier. 2022. Tackling healthcare access barriers for individuals with autism from diagnosis to adulthood. Pediatric Research 91, 5 (2022), 1028–1035.
[19]
Hiromi Nemoto, Pavel Korshunov, Philippe Hanhart, and Touradj Ebrahimi. 2015. Visual attention in LDR and HDR images. In 9th International Workshop on Video Processing and Quality Metrics for Consumer Electronics (VPQM).
[20]
Chiugo Okoye, Chidi M Obialo-Ibeawuchi, Omobolanle A Obajeun, Sarosh Sarwar, Christine Tawfik, Madeeha Subhan Waleed, Asad Ullah Wasim, Iman Mohamoud, Adebola Y Afolayan, and Rheiner N Mbaezue. 2023. Early diagnosis of autism spectrum disorder: A review and analysis of the risks and benefits. Cureus 15, 8 (2023).
[21]
Diana L Robins, Deborah Fein, and Marianne Barton. 2009. Modified checklist for autism in toddlers, revised, with follow-up (M-CHAT-R/F) TM. LineageN (2009).
[22]
Noah J Sasson and Emily W Touchstone. 2014. Visual attention to competing social and object images by preschool children with autism spectrum disorder. Journal of autism and developmental disorders 44 (2014), 584–592.
[23]
Eric Schopler, Mary E Van Bourgondien, Glenna Janette Wellman, and Steven R Love. 2010. Childhood Autism Rating Scale–Second Edition (CARS-2). Los Angeles, CA: Western Psychological Services (2010).
[24]
Da-Yea Song, So Yoon Kim, Guiyoung Bong, Jong Myeong Kim, and Hee Jeong Yoo. 2019. The use of artificial intelligence in screening and diagnosis of autism spectrum disorder: a literature review. Journal of the Korean Academy of Child and Adolescent Psychiatry 30, 4 (2019), 145.
[25]
Mark L Sundberg. 2008. VB-MAPP Verbal Behavior Milestones Assessment and Placement Program: a language and social skills assessment program for children with autism or other developmental disabilities: guide. Mark Sundberg.
[26]
Uzma Haque Syeda, Ziaul Zafar, Zishan Zahidul Islam, Syed Mahir Tazwar, Miftahul Jannat Rasna, Koichi Kise, and Md. Atiqur Rahman Ahad. 2017. Visual Face Scanning and Emotion Perception Analysis between Autistic and Typically Developing Children. In Proceedings of the 2017 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2017 ACM International Symposium on Wearable Computers (Maui, Hawaii) (UbiComp ’17). Association for Computing Machinery, New York, NY, USA, 844–853. https://doi.org/10.1145/3123024.3125618
[27]
Samy Tafasca, Anshul Gupta, Nada Kojovic, Mirko Gelsomini, Thomas Maillart, Michela Papandrea, Marie Schaer, and Jean-Marc Odobez. 2023. The AI4Autism Project: A Multimodal and Interdisciplinary Approach to Autism Diagnosis and Stratification. In Companion Publication of the 25th International Conference on Multimodal Interaction. 414–425.
[28]
Diana Weiting Tan, Murray T Maybery, Syed Zulqarnain Gilani, Gail A Alvares, Ajmal Mian, David Suter, and Andrew JO Whitehouse. 2020. A broad autism phenotype expressed in facial morphology. Translational psychiatry 10, 1 (2020), 7.
[29]
Saime Tek and Rebecca J Landa. 2012. Differences in autism symptoms between minority and non-minority toddlers. Journal of autism and developmental disorders 42 (2012), 1967–1973.
[30]
Haishuai Wang, Lianhua Chi, Chanfei Su, and Ziping Zhao. 2022. ASDFace: Face-Based Autism Diagnosis via Heterogeneous Domain Adaptation. In Proceedings of the 31st ACM International Conference on Information & Knowledge Management (Atlanta, GA, USA) (CIKM ’22). Association for Computing Machinery, New York, NY, USA, 4999–5003. https://doi.org/10.1145/3511808.3557170

Cited By

View all
  • (2025)Neural correlates of facial recognition deficits in autism spectrum disorder: a comprehensive reviewFrontiers in Psychiatry10.3389/fpsyt.2024.146414215Online publication date: 6-Jan-2025
  • (2024)Designing an Enhanced MobileNet Integrated Architecture with Optimization for Accurate Detection of ASD using Extracted Facial Features2024 4th International Conference on Sustainable Expert Systems (ICSES)10.1109/ICSES63445.2024.10763302(645-650)Online publication date: 15-Oct-2024

Index Terms

  1. Early Autism Screening in Children Using Facial Recognition

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    CHI EA '24: Extended Abstracts of the CHI Conference on Human Factors in Computing Systems
    May 2024
    4761 pages
    ISBN:9798400703317
    DOI:10.1145/3613905
    Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 11 May 2024

    Check for updates

    Author Tags

    1. Algorithm
    2. Assistive technology
    3. Children with autism
    4. Facial recognition
    5. Screening and earlier diagnosis

    Qualifiers

    • Work in progress
    • Research
    • Refereed limited

    Funding Sources

    Conference

    CHI '24

    Acceptance Rates

    Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

    Upcoming Conference

    CHI 2025
    ACM CHI Conference on Human Factors in Computing Systems
    April 26 - May 1, 2025
    Yokohama , Japan

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)301
    • Downloads (Last 6 weeks)29
    Reflects downloads up to 20 Jan 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2025)Neural correlates of facial recognition deficits in autism spectrum disorder: a comprehensive reviewFrontiers in Psychiatry10.3389/fpsyt.2024.146414215Online publication date: 6-Jan-2025
    • (2024)Designing an Enhanced MobileNet Integrated Architecture with Optimization for Accurate Detection of ASD using Extracted Facial Features2024 4th International Conference on Sustainable Expert Systems (ICSES)10.1109/ICSES63445.2024.10763302(645-650)Online publication date: 15-Oct-2024

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Full Text

    View this article in Full Text.

    Full Text

    HTML Format

    View this article in HTML Format.

    HTML Format

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media