Abstract
Augmented reality (AR)-based rehabilitation is an excellent teaching tool (ICT tool) for simulating daily activities for autistic children. Children with autism may become more mentally capable with this type of AR-based rehabilitation. It is intended to observe the children's performance in terms of concentration, attention, and identification. The observation has been done through placards as a target image to display the 3D objects on a mobile phone or tablet. In this project, observations are made for 21 autism children in the age group of 7–14, out of whom 17 are boys and 5 are girls. Those 21 children are given practice identifying 15 different objects in an augmented reality environment. Their performance was initially evaluated using conventional instructional techniques. The majority of the kids were having more difficulty identifying things during that observation. Then, with an Augmented Reality environment, the identical observation has been made once more. Using a mobile device or tablet, the 3D objects from the provided placard photos are produced in an augmented reality environment with animation and voice in the languages of English and Tamil. Children with autism are able to recognize and also grasp the behaviors of those objects while viewing them in 3D. Their efforts are measured using a two-point scale (0, 1, 2). The pre-assessment and post-assessment reports for the above observations are tabulated. All the observations are made in the presence of the special education teacher (therapist). However, the children observed in this project fall into three different categories: mild, moderate, and severe. In the Mild category, statistical significance is evident with p values of 0.002 in pre-assessment and 0.014 in post-assessment. Likewise, in the Moderate category, where p values are 0.023 in pre-assessment and 0.033 in post-assessment, significance is observed, as all p values fall below the chosen significance level of 0.05. This leads to rejecting the null hypothesis and concluding a significant difference. Children under the categories of mild and moderate are easily adaptable to the AR environment, and children under the category of severe are still in need of some practice in order to improve their performance.








Similar content being viewed by others
References
Genovese A, Butler MG. Clinical assessment, genetics, and treatment approaches in autism spectrum disorder (ASD). Int J Mol Sci. 2020;21(13):4726.
Al-Attar Z. Autism spectrum disorders and terrorism: how different features of autism can contextualise vulnerability and resilience. In: Violent extremism. NY: Routledge; 2021. p. 121–44.
Lord C, Brugha TS, Charman T, Cusack J, Dumas G, Frazier T, Veenstra-VanderWeele J. Autism spectrum disorder. Nat Rev Dis Prim. 2020;6(1):1–23.
John RP, Knott FJ, Harvey KN. Myths about autism: an exploratory study using focus groups. Autism. 2018;22(7):845–54.
Gillberg C, Soderstrom H. Learning disability. Lancet. 2003;362(9386):811–21.
Ibrahim I. Specific learning disorder in children with autism spectrum disorder: current issues and future implications. Adv Neurodev Disord. 2020;4:103–12.
Lovelace TS, Comis MP, Tabb JM, Oshokoya OE. Missing from the narrative: a seven-decade scoping review of the inclusion of black autistic women and girls in autism research. Behav Anal Pract. 2021;15:1093–105.
Chen JL, Leader G, Sung C, Leahy M. Trends in employment for individuals with autism spectrum disorder: a review of the research literature. Rev J Autism Dev Disord. 2015;2:115–27.
Walker S, Berthelsen D. Children with autistic spectrum disorder in early childhood education programs: a social constructivist perspective on inclusion. Int J Early Child. 2008;40:33–51.
Díaz J. Virtual world as a complement to hybrid and mobile learning. Int J Emerg Technol Learn (iJET). 2020;15(22):267–74.
Alam A. Possibilities and apprehensions in the landscape of artificial intelligence in education. In: 2021 International Conference on Computational Intelligence and Computing Applications (ICCICA). IEEE; 2021. p. 1–8.
Kozinets RV. Immersive netnography: a novel method for service experience research in virtual reality, augmented reality and metaverse contexts. J Serv Manag. 2022;34(1):100–25.
Turner C. Augmented reality, augmented epistemology, and the real-world web. Philos Technol. 2022;35(1):19.
Olim SC, Nisi V. Augmented reality towards facilitating abstract concepts learning. In: Entertainment Computing–ICEC 2020: 19th IFIP TC 14 International Conference, ICEC 2020, Xi'an, China, November 10–13, 2020, Proceedings 19. Springer; 2020. p. 188–204.
Gargrish S, Kaur DP, Mantri A, Singh G, Sharma B. Measuring effectiveness of augmented reality-based geometry learning assistant on memory retention abilities of the students in 3D geometry. Comput Appl Eng Educ. 2021;29(6):1811–24.
Horváth I. An analysis of personalized learning opportunities in 3D VR. Front Comput Sci. 2021;3: 673826.
Zhang M, Ding H, Naumceska M, Zhang Y. Virtual reality technology as an educational and intervention tool for children with autism spectrum disorder: current perspectives and future directions. Behav Sci. 2022;12(5):138.
Makransky G, Petersen GB. The cognitive affective model of immersive learning (CAMIL): a theoretical research-based model of learning in immersive virtual reality. Educ Psychol Rev. 2021;33(3):937–58.
Maddikunta PKR, Pham QV, Prabadevi B, Deepa N, Dev K, Gadekallu TR, Liyanage M. Industry 5.0: a survey on enabling technologies and potential applications. J Ind Inf Integr. 2022;26: 100257.
Asad MM, Naz A, Churi P, Tahanzadeh MM. Virtual reality as pedagogical tool to enhance experiential learning: a systematic literature review. Educ Res Int. 2021;2021:1–17.
Suhaila NA, Nordin NM. Assistive technology for autism spectrum disorder: systematic literature review. Int J Adv Res Educ Soc. 2022;4(2):25–39.
Liu R, Salisbury JP, Vahabzadeh A, Sahin NT. Feasibility of an autism-focused augmented reality smartglasses system for social communication and behavioral coaching. Front Pediatr. 2017;5:145.
Krusche S, von Frankenberg N, Reimer LM, Bruegge B (2020) An interactive learning method to engage students in modeling. In: Proceedings of the ACM/IEEE 42nd International Conference on Software Engineering: Software Engineering Education and Training. 2020. p. 12–22.
Lee IJ. Kinect-for-windows with augmented reality in an interactive roleplay system for children with an autism spectrum disorder. Interact Learn Environ. 2021;29(4):688–704.
South M, Rodgers J. Sensory, emotional and cognitive contributions to anxiety in autism spectrum disorders. Front Hum Neurosci. 2017;11:20.
Pellas N, Fotaris P, Kazanidis I, Wells D. Augmenting the learning experience in primary and secondary school education: a systematic review of recent trends in augmented reality game-based learning. Virtual Real. 2019;23(4):329–46.
Buchner J, Buntins K, Kerres M. The impact of augmented reality on cognitive load and performance: a systematic review. J Comput Assist Learn. 2022;38(1):285–303.
Osadchyi VV, Varina HB, Osadcha KP, Prokofieva OO, Kovalova OV, Kiv AE. Features of implementation of modern AR technologies in the process of psychological and pedagogical support of children with autism spectrum disorders. In: AREdu 2020-augmented reality in education. Ukraine: Kryvyi Rih; 2020. p. 263–82.
Akçayır M, Akçayır G. Advantages and challenges associated with augmented reality for education: a systematic review of the literature. Educ Res Rev. 2017;20:1–11.
Schmidt M, Schmidt C, Glaser N, Beck D, Lim M, Palmer H. Evaluation of a spherical video-based virtual reality intervention designed to teach adaptive skills for adults with autism: a preliminary report. Interact Learn Environ. 2021;29(3):345–64.
Hashim HU, Yunus MM, Norman H. ‘AReal-Vocab’: an augmented reality English vocabulary mobile application to cater to mild autism children in response towards sustainable education for children with disabilities. Sustainability. 2022;14(8):4831.
Shaltout EH, Afifi A, Amin KM (2020) Augmented reality based learning environment for children with special needs. In: 2020 15th International Conference on Computer Engineering and Systems (ICCES). IEEE; 2020. p. 1–7.
Khoirunnisa AN, Munir, Dewi L. Design and prototype development of augmented reality in reading learning for autism. Computers. 2023;12(3):55.
Pérez-Fuster P, Herrera G, Kossyvaki L, Ferrer A. Enhancing joint attention skills in children on the autism spectrum through an augmented reality technology-mediated intervention. Children. 2022;9(2):258.
Wang K, Zhang B, Cho Y (2020) Using mobile augmented reality to improve attention in adults with autism spectrum disorder. In: Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems. 2020. p. 1–9.
Amores-Valencia A, Burgos D, Branch-Bedoya JW. Influence of motivation and academic performance in the use of augmented reality in education. A systematic review. Front Psychol. 2022. https://doi.org/10.3389/fpsyg.2022.1011409.
Daniel VLT, Ting H, Photchara R, Haruo T. An AR puzzle application for improving emotion recognition for as children. In: Proceedings of the 3rd International Conference on Digital Technology in Education. 2019. p. 52–56.
Mazon C, Fage C, Sauzéon H. Effectiveness and usability of technology-based interventions for children and adolescents with ASD: a systematic review of reliability, consistency, generalization and durability related to the effects of intervention. Comput Hum Behav. 2019;93:235–51.
Charlton CT, Kellems RO, Black B, Bussey HC, Ferguson R, Goncalves B, Vallejo S. Effectiveness of avatar-delivered instruction on social initiations by children with autism spectrum disorder. Res Autism Spectr Disord. 2020;71: 101494.
Chen CH, Lee IJ, Lin LY. Augmented reality-based video-modeling storybook of nonverbal facial cues for children with autism spectrum disorder to improve their perceptions and judgments of facial expressions and emotions. Comput Hum Behav. 2016;55:477–85.
Ekin CC, Cagiltay K, Karasu N. Effectiveness of smart toy applications in teaching children with intellectual disability. J Syst Architect. 2018;89:41–8.
Koldewyn K, Weigelt S, Kanwisher N, Jiang Y. Multiple object tracking in autism spectrum disorders. J Autism Dev Disord. 2013;43:1394–405.
Watkins L, O’Reilly M, Kuhn M, Ledbetter-Cho K. An interest-based intervention package to increase peer social interaction in young children with autism spectrum disorder. J Appl Behav Anal. 2019;52(1):132–49.
Eow SY, Gan WY, Lim PY, Awang H, Shariff ZM. Factors associated with autism severity among Malaysian children with autism spectrum disorder. Res Dev Disabil. 2020;100: 103632.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interest
The authors declare that they have no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
This article is part of the topical collection “Security and Privacy 2020” guest edited by Pantelimon Stanica, Odelu Vanga and Sumit Kumar Debnath.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Abdullah, A.S., Karthikeyan, J., Gomathi, V. et al. Enabling Technology Integrated Learning for Autistic Children Using Augmented Reality Based Cognitive Rehabilitation. SN COMPUT. SCI. 5, 151 (2024). https://doi.org/10.1007/s42979-023-02495-5
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s42979-023-02495-5