Skip to main content
SpringerLink
Log in

Autism Spectrum Disorder Classification of Facial Images Using Xception Model and Transfer Learning with Image Augmentation

  • Conference paper
  • First Online:
Neural Information Processing (ICONIP 2022)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 13625))

Included in the following conference series:

  • 917 Accesses

Abstract

Autism spectrum disorder (ASD) is a neurodevelopmental disorder in which the neurology of an autistic person is severely hampered. A child with autism has difficulty answering his name, avoids eye contact, and cannot express his emotions. Early diagnosis can assist children with ASD enhance their intellectual abilities while reducing autistic symptoms. In computer vision, determining developmental disorder problems from facial image data is a significant but largely unexplored challenge. This paper proposed a method to classify autistic and non-autistic facial images using model 1 (Xception) and model 2 (Augmentation + Xception). Among Model 1 and Model 2, Model 2 achieved higher accuracy of 98% and a minimum loss of 0.08.

Financially Supported by IIIT Allahabad.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 89.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 119.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Arora, N.K., et al.: Neurodevelopmental disorders in children aged 2–9 years: population-based burden estimates across five regions in India. PLoS Med. 15(7), e1002615 (2018)

    Article  Google Scholar 

  2. Shukla, P., Gupta, T., Saini, A., Singh, P., Balasubramanian, R.: A deep learning frame-work for recognizing developmental disorders. In: 2017 IEEE Winter Conference on Applications of Computer Vision (WACV), pp. 705–714. IEEE (2017)

    Google Scholar 

  3. Li, B., et al.: A facial affect analysis system for autism spectrum disorder. In: 2019 IEEE International Conference on Image Processing (ICIP), pp. 4549–4553. IEEE (2019)

    Google Scholar 

  4. Rabbi, M.F., Hasan, S.M., Champa, A.I., Zaman, M.A.: A convolutional neural network model for early-stage detection of autism spectrum disorder. In: 2021 International Conference on Information and Communication Technology for Sustainable Development (ICICT4SD), pp. 110–114. IEEE (2021)

    Google Scholar 

  5. Arumugam, S.R., Karuppasamy, S.G., Gowr, S., Manoj, O., Kalaivani, K.: A deep convolutional neural network based detection system for autism spectrum disorder in facial images. In: 2021 5th International Conference on I-SMAC (IoT in Social, Mobile, Analytics and Cloud)(I-SMAC), pp. 1255–1259. IEEE (2021)

    Google Scholar 

  6. Mujeeb Rahman, K.K., Subashini, M.M.: Identification of autism in children using static facial features and deep neural networks. Brain Sci. 12(1), 94 (2022)

    Article  Google Scholar 

  7. Lu, A., Perkowski, M.: Deep learning approach for screening autism spectrum disorder in children with facial images and analysis of ethnoracial factors in model development and application. Brain Sci. 11(11), 1446 (2021)

    Article  Google Scholar 

  8. Khosla, Y., Ramachandra, P., Chaitra, N.: Detection of autistic individuals using facial images and deep learning. In: 2021 IEEE International Conference on Computation System and Information Technology for Sustainable Solutions (CSITSS), pp. 1–5. IEEE (2021)

    Google Scholar 

  9. Li, J., Bhat, A., Barmaki, R.: A two-stage multi-modal affect analysis framework for children with autism spectrum disorder. arXiv preprint arXiv:2106.09199 (2021)

  10. Akter, T., et al.: Improved transfer-learning-based facial recognition framework to detect autistic children at an early stage. Brain Sci. 11(6), 734 (2021)

    Article  Google Scholar 

  11. Ahmed, Z.A.T., et al.: Facial features detection system to identify children with autism spectrum disorder: deep learning models. Comput. Math. Methods Med. 2022 (2022)

    Google Scholar 

  12. Alsaade, F.W., Alzahrani, M.S.: Classification and detection of autism spectrum disorder based on deep learning algorithms. Comput. Intell. Neurosci. 2022 (2022)

    Google Scholar 

  13. Akter, T., et al.: Machine learning-based models for early stage detection of autism spectrum disorders. IEEE Access 7, 166509–166527 (2019)

    Article  Google Scholar 

  14. Kumar, C.J., Das, P.R.: The diagnosis of ASD using multiple machine learning techniques. Int. J. Dev. Disabil. 68(6), 1–11 (2021)

    Google Scholar 

  15. Mohan, P., Paramasivam, I.: Feature reduction using SVM-RFE technique to detect autism spectrum disorder. Evol. Intell. 14(2), 989–997 (2020). https://doi.org/10.1007/s12065-020-00498-2

    Article  Google Scholar 

  16. Mujeeb Rahman, K.K., Monica Subashini, M.: A deep neural network-based model for screening autism spectrum disorder using the quantitative checklist for autism in toddlers (QCHAT). J. Autism Dev. Disord. 52, 1–15 (2021). https://doi.org/10.1007/s10803-021-05141-2

    Article  Google Scholar 

  17. Eslami, T., Saeed, F.: Auto-ASD-network: a technique based on deep learning and support vector machines for diagnosing autism spectrum disorder using fMRI data. In: Proceedings of the 10th ACM International Conference on Bioinformatics, Computational Biology and Health Informatics, pp. 646–651 (2019)

    Google Scholar 

  18. Li, H., Parikh, N.A., He, L.: A novel transfer learning approach to enhance deep neural network classification of brain functional connectomes. Front. Neurosci. 12, 491 (2018)

    Article  Google Scholar 

  19. Crimi, A., Dodero, L., Murino, V., Sona, D.: Case-control discrimination through effective brain connectivity. In: 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017), pp. 970–973 (2017)

    Google Scholar 

  20. Zheng, W., et al.: Multi-feature based network revealing the structural abnormalities in autism spectrum disorder. IEEE Trans. Affect. Comput. 12(3), 732–742 (2019)

    Article  Google Scholar 

  21. Almuqhim, F., Saeed, F.: ASD-SAENet: a sparse autoencoder, and deep-neural network model for detecting autism spectrum disorder (ASD) using fMRI data. Frontiers Comput. Neurosci. 15, 27 (2021)

    Article  Google Scholar 

  22. Chen, S., Zhao, Q.: Attention-based autism spectrum disorder screening with privileged modality. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 1181–1190 (2019)

    Google Scholar 

  23. Kollias, K.F., Syriopoulou-Delli, C.K., Sarigiannidis, P., Fragulis, G.F.: The contribution of machine learning and eye-tracking technology in autism spectrum disorder research: a review study. In: 2021 10th International Conference on Modern Circuits and Systems Technologies (MOCAST), pp. 1–4 (2021)

    Google Scholar 

  24. Chong, E., et al.: Detecting gaze towards eyes in natural social interactions and its use in child assessment. In: Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, vol. 1, no. 3, pp. 1–20. ACM New York, NY, USA (2017)

    Google Scholar 

  25. Hashemi, J., et al.: A scalable app for measuring autism risk behaviors in young children: a technical validity and feasibility study. In: Proceedings of the 5th EAI International Conference on Wireless Mobile Communication and Healthcare, pp. 23–27 (2015)

    Google Scholar 

  26. Bovery, M., et al.: A scalable off-the-shelf framework for measuring patterns of attention in young children and its application in autism spectrum disorder. IEEE Trans. Affect. Comput. 12(3), 722–731 (2019)

    Article  Google Scholar 

  27. Wang, Z., Xu, K., Liu, H.: Screening early children with autism spectrum disorder via expressing needs with index finger pointing. In: Proceedings of the 13th International Conference on Distributed Smart Cameras, pp. 1–6 (2019)

    Google Scholar 

  28. Mehmood, F., Ayaz, Y., Ali, S., Amadeu, R.D.C., Sadia, H.: Dominance in visual space of ASD children using multi-robot joint attention integrated distributed imitation system. IEEE Access 7, 168815–168827 (2019)

    Article  Google Scholar 

  29. Marinoiu, E., Zanfir, M., Olaru, V., Sminchisescu, C.: 3d human sensing, action and emotion recognition in robot assisted therapy of children with autism. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2158–2167 (2018)

    Google Scholar 

  30. Lakshmi Praveena, T., Muthu Lakshmi, N.V.: A methodology for detecting ASD from facial images efficiently using artificial neural networks. In: Jyothi, S., Mamatha, D.M., Satapathy, S.C., Raju, K.S., Favorskaya, M.N. (eds.) CBE 2019. LAIS, vol. 15, pp. 365–373. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-46939-9_31

    Chapter  Google Scholar 

  31. Senol, C.: Autism image data (2020). Accepted 02 June 2022. https://www.kaggle.com/datasets/cihan063/autism-image-data

  32. Chollet, F.: Xception: deep learning with depth wise separable convolutions. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1251–1258 (2017)

    Google Scholar 

  33. Aldridge, K., et al.: Facial phenotypes in subgroups of prepubertal boys with autism spectrum disorders are correlated with clinical phenotypes. Mol. Autism 2(1), 1–12 (2011)

    Article  MathSciNet  Google Scholar 

  34. Kumar, S., Sharma, S.: A hybrid deep model with concatenating framework of convolutional neural networks for identification of autism spectrum disorder. In: Enabling Technology for Neurodevelopmental Disorders, pp. 230–239 (2022)

    Google Scholar 

  35. Kalaiselvi, A., Nagarathinam, S., Paul, T.D., Alagumeenaakshi, M.: Detection of autism spectrum disorder using transfer learning. Turkish J. Physiotherapy Rehabil. 32(2), 926–933 (2021)

    Google Scholar 

Download references

Acknowledgment

The authors are grateful to the Ministry of Education, Govt. of India and Indian Institute of Information Technology, Allahabad for providing all resources and financial support to complete this work.

Author information

Authors and Affiliations

  1. Department of Information Technology, Indian Institute of Information Technology, Allahabad, 211015, India

    Trapti Shrivastava, Vrijendra Singh & Anupam Agrawal

Authors
  1. Trapti Shrivastava
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Vrijendra Singh
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Anupam Agrawal
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Trapti Shrivastava .

Editor information

Editors and Affiliations

  1. Indian Institute of Technology Indore, Indore, India

    Mohammad Tanveer

  2. Indian Institute of Information Technology - Allahabad, Prayagraj, India

    Sonali Agarwal

  3. Kobe University, Kobe, Japan

    Seiichi Ozawa

  4. Indian Institute of Technology Patna, Patna, India

    Asif Ekbal

  5. University of Innsbruck, Innsbruck, Austria

    Adam Jatowt

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Shrivastava, T., Singh, V., Agrawal, A. (2023). Autism Spectrum Disorder Classification of Facial Images Using Xception Model and Transfer Learning with Image Augmentation. In: Tanveer, M., Agarwal, S., Ozawa, S., Ekbal, A., Jatowt, A. (eds) Neural Information Processing. ICONIP 2022. Lecture Notes in Computer Science, vol 13625. Springer, Cham. https://doi.org/10.1007/978-3-031-30111-7_15

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-30111-7_15

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-30110-0

  • Online ISBN: 978-3-031-30111-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation