Skip to main content
Log in

Enabling Technology Integrated Learning for Autistic Children Using Augmented Reality Based Cognitive Rehabilitation

  • Original Research
  • Published:
SN Computer Science Aims and scope Submit manuscript

Abstract

Augmented reality (AR)-based rehabilitation is an excellent teaching tool (ICT tool) for simulating daily activities for autistic children. Children with autism may become more mentally capable with this type of AR-based rehabilitation. It is intended to observe the children's performance in terms of concentration, attention, and identification. The observation has been done through placards as a target image to display the 3D objects on a mobile phone or tablet. In this project, observations are made for 21 autism children in the age group of 7–14, out of whom 17 are boys and 5 are girls. Those 21 children are given practice identifying 15 different objects in an augmented reality environment. Their performance was initially evaluated using conventional instructional techniques. The majority of the kids were having more difficulty identifying things during that observation. Then, with an Augmented Reality environment, the identical observation has been made once more. Using a mobile device or tablet, the 3D objects from the provided placard photos are produced in an augmented reality environment with animation and voice in the languages of English and Tamil. Children with autism are able to recognize and also grasp the behaviors of those objects while viewing them in 3D. Their efforts are measured using a two-point scale (0, 1, 2). The pre-assessment and post-assessment reports for the above observations are tabulated. All the observations are made in the presence of the special education teacher (therapist). However, the children observed in this project fall into three different categories: mild, moderate, and severe. In the Mild category, statistical significance is evident with p values of 0.002 in pre-assessment and 0.014 in post-assessment. Likewise, in the Moderate category, where p values are 0.023 in pre-assessment and 0.033 in post-assessment, significance is observed, as all p values fall below the chosen significance level of 0.05. This leads to rejecting the null hypothesis and concluding a significant difference. Children under the categories of mild and moderate are easily adaptable to the AR environment, and children under the category of severe are still in need of some practice in order to improve their performance.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

References

  1. Genovese A, Butler MG. Clinical assessment, genetics, and treatment approaches in autism spectrum disorder (ASD). Int J Mol Sci. 2020;21(13):4726.

    Article  Google Scholar 

  2. Al-Attar Z. Autism spectrum disorders and terrorism: how different features of autism can contextualise vulnerability and resilience. In: Violent extremism. NY: Routledge; 2021. p. 121–44.

    Chapter  Google Scholar 

  3. Lord C, Brugha TS, Charman T, Cusack J, Dumas G, Frazier T, Veenstra-VanderWeele J. Autism spectrum disorder. Nat Rev Dis Prim. 2020;6(1):1–23.

    Google Scholar 

  4. John RP, Knott FJ, Harvey KN. Myths about autism: an exploratory study using focus groups. Autism. 2018;22(7):845–54.

    Article  Google Scholar 

  5. Gillberg C, Soderstrom H. Learning disability. Lancet. 2003;362(9386):811–21.

    Article  Google Scholar 

  6. Ibrahim I. Specific learning disorder in children with autism spectrum disorder: current issues and future implications. Adv Neurodev Disord. 2020;4:103–12.

    Article  Google Scholar 

  7. Lovelace TS, Comis MP, Tabb JM, Oshokoya OE. Missing from the narrative: a seven-decade scoping review of the inclusion of black autistic women and girls in autism research. Behav Anal Pract. 2021;15:1093–105.

    Article  Google Scholar 

  8. Chen JL, Leader G, Sung C, Leahy M. Trends in employment for individuals with autism spectrum disorder: a review of the research literature. Rev J Autism Dev Disord. 2015;2:115–27.

    Article  Google Scholar 

  9. Walker S, Berthelsen D. Children with autistic spectrum disorder in early childhood education programs: a social constructivist perspective on inclusion. Int J Early Child. 2008;40:33–51.

    Article  Google Scholar 

  10. Díaz J. Virtual world as a complement to hybrid and mobile learning. Int J Emerg Technol Learn (iJET). 2020;15(22):267–74.

    Article  Google Scholar 

  11. Alam A. Possibilities and apprehensions in the landscape of artificial intelligence in education. In: 2021 International Conference on Computational Intelligence and Computing Applications (ICCICA). IEEE; 2021. p. 1–8.

  12. Kozinets RV. Immersive netnography: a novel method for service experience research in virtual reality, augmented reality and metaverse contexts. J Serv Manag. 2022;34(1):100–25.

    Article  Google Scholar 

  13. Turner C. Augmented reality, augmented epistemology, and the real-world web. Philos Technol. 2022;35(1):19.

    Article  Google Scholar 

  14. Olim SC, Nisi V. Augmented reality towards facilitating abstract concepts learning. In: Entertainment Computing–ICEC 2020: 19th IFIP TC 14 International Conference, ICEC 2020, Xi'an, China, November 10–13, 2020, Proceedings 19. Springer; 2020. p. 188–204.

  15. Gargrish S, Kaur DP, Mantri A, Singh G, Sharma B. Measuring effectiveness of augmented reality-based geometry learning assistant on memory retention abilities of the students in 3D geometry. Comput Appl Eng Educ. 2021;29(6):1811–24.

    Article  Google Scholar 

  16. Horváth I. An analysis of personalized learning opportunities in 3D VR. Front Comput Sci. 2021;3: 673826.

    Article  Google Scholar 

  17. Zhang M, Ding H, Naumceska M, Zhang Y. Virtual reality technology as an educational and intervention tool for children with autism spectrum disorder: current perspectives and future directions. Behav Sci. 2022;12(5):138.

    Article  Google Scholar 

  18. Makransky G, Petersen GB. The cognitive affective model of immersive learning (CAMIL): a theoretical research-based model of learning in immersive virtual reality. Educ Psychol Rev. 2021;33(3):937–58.

    Article  Google Scholar 

  19. Maddikunta PKR, Pham QV, Prabadevi B, Deepa N, Dev K, Gadekallu TR, Liyanage M. Industry 5.0: a survey on enabling technologies and potential applications. J Ind Inf Integr. 2022;26: 100257.

    Google Scholar 

  20. Asad MM, Naz A, Churi P, Tahanzadeh MM. Virtual reality as pedagogical tool to enhance experiential learning: a systematic literature review. Educ Res Int. 2021;2021:1–17.

    Google Scholar 

  21. Suhaila NA, Nordin NM. Assistive technology for autism spectrum disorder: systematic literature review. Int J Adv Res Educ Soc. 2022;4(2):25–39.

    Google Scholar 

  22. Liu R, Salisbury JP, Vahabzadeh A, Sahin NT. Feasibility of an autism-focused augmented reality smartglasses system for social communication and behavioral coaching. Front Pediatr. 2017;5:145.

    Article  Google Scholar 

  23. Krusche S, von Frankenberg N, Reimer LM, Bruegge B (2020) An interactive learning method to engage students in modeling. In: Proceedings of the ACM/IEEE 42nd International Conference on Software Engineering: Software Engineering Education and Training. 2020. p. 12–22.

  24. Lee IJ. Kinect-for-windows with augmented reality in an interactive roleplay system for children with an autism spectrum disorder. Interact Learn Environ. 2021;29(4):688–704.

    Article  Google Scholar 

  25. South M, Rodgers J. Sensory, emotional and cognitive contributions to anxiety in autism spectrum disorders. Front Hum Neurosci. 2017;11:20.

    Article  Google Scholar 

  26. Pellas N, Fotaris P, Kazanidis I, Wells D. Augmenting the learning experience in primary and secondary school education: a systematic review of recent trends in augmented reality game-based learning. Virtual Real. 2019;23(4):329–46.

    Article  Google Scholar 

  27. Buchner J, Buntins K, Kerres M. The impact of augmented reality on cognitive load and performance: a systematic review. J Comput Assist Learn. 2022;38(1):285–303.

    Article  Google Scholar 

  28. Osadchyi VV, Varina HB, Osadcha KP, Prokofieva OO, Kovalova OV, Kiv AE. Features of implementation of modern AR technologies in the process of psychological and pedagogical support of children with autism spectrum disorders. In: AREdu 2020-augmented reality in education. Ukraine: Kryvyi Rih; 2020. p. 263–82.

    Google Scholar 

  29. Akçayır M, Akçayır G. Advantages and challenges associated with augmented reality for education: a systematic review of the literature. Educ Res Rev. 2017;20:1–11.

    Article  Google Scholar 

  30. Schmidt M, Schmidt C, Glaser N, Beck D, Lim M, Palmer H. Evaluation of a spherical video-based virtual reality intervention designed to teach adaptive skills for adults with autism: a preliminary report. Interact Learn Environ. 2021;29(3):345–64.

    Article  Google Scholar 

  31. Hashim HU, Yunus MM, Norman H. ‘AReal-Vocab’: an augmented reality English vocabulary mobile application to cater to mild autism children in response towards sustainable education for children with disabilities. Sustainability. 2022;14(8):4831.

    Article  Google Scholar 

  32. Shaltout EH, Afifi A, Amin KM (2020) Augmented reality based learning environment for children with special needs. In: 2020 15th International Conference on Computer Engineering and Systems (ICCES). IEEE; 2020. p. 1–7.

  33. Khoirunnisa AN, Munir, Dewi L. Design and prototype development of augmented reality in reading learning for autism. Computers. 2023;12(3):55.

    Article  Google Scholar 

  34. Pérez-Fuster P, Herrera G, Kossyvaki L, Ferrer A. Enhancing joint attention skills in children on the autism spectrum through an augmented reality technology-mediated intervention. Children. 2022;9(2):258.

    Article  Google Scholar 

  35. Wang K, Zhang B, Cho Y (2020) Using mobile augmented reality to improve attention in adults with autism spectrum disorder. In: Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems. 2020. p. 1–9.

  36. Amores-Valencia A, Burgos D, Branch-Bedoya JW. Influence of motivation and academic performance in the use of augmented reality in education. A systematic review. Front Psychol. 2022. https://doi.org/10.3389/fpsyg.2022.1011409.

    Article  Google Scholar 

  37. Daniel VLT, Ting H, Photchara R, Haruo T. An AR puzzle application for improving emotion recognition for as children. In: Proceedings of the 3rd International Conference on Digital Technology in Education. 2019. p. 52–56.

  38. Mazon C, Fage C, Sauzéon H. Effectiveness and usability of technology-based interventions for children and adolescents with ASD: a systematic review of reliability, consistency, generalization and durability related to the effects of intervention. Comput Hum Behav. 2019;93:235–51.

    Article  Google Scholar 

  39. Charlton CT, Kellems RO, Black B, Bussey HC, Ferguson R, Goncalves B, Vallejo S. Effectiveness of avatar-delivered instruction on social initiations by children with autism spectrum disorder. Res Autism Spectr Disord. 2020;71: 101494.

    Article  Google Scholar 

  40. Chen CH, Lee IJ, Lin LY. Augmented reality-based video-modeling storybook of nonverbal facial cues for children with autism spectrum disorder to improve their perceptions and judgments of facial expressions and emotions. Comput Hum Behav. 2016;55:477–85.

    Article  Google Scholar 

  41. Ekin CC, Cagiltay K, Karasu N. Effectiveness of smart toy applications in teaching children with intellectual disability. J Syst Architect. 2018;89:41–8.

    Article  Google Scholar 

  42. Koldewyn K, Weigelt S, Kanwisher N, Jiang Y. Multiple object tracking in autism spectrum disorders. J Autism Dev Disord. 2013;43:1394–405.

    Article  Google Scholar 

  43. Watkins L, O’Reilly M, Kuhn M, Ledbetter-Cho K. An interest-based intervention package to increase peer social interaction in young children with autism spectrum disorder. J Appl Behav Anal. 2019;52(1):132–49.

    Article  Google Scholar 

  44. Eow SY, Gan WY, Lim PY, Awang H, Shariff ZM. Factors associated with autism severity among Malaysian children with autism spectrum disorder. Res Dev Disabil. 2020;100: 103632.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to A. Sheik Abdullah.

Ethics declarations

Conflict of Interest

The authors declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

This article is part of the topical collection “Security and Privacy 2020” guest edited by Pantelimon Stanica, Odelu Vanga and Sumit Kumar Debnath.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Abdullah, A.S., Karthikeyan, J., Gomathi, V. et al. Enabling Technology Integrated Learning for Autistic Children Using Augmented Reality Based Cognitive Rehabilitation. SN COMPUT. SCI. 5, 151 (2024). https://doi.org/10.1007/s42979-023-02495-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s42979-023-02495-5

Keywords

Navigation