skip to main content
10.1145/3359997.3365703acmconferencesArticle/Chapter ViewAbstractPublication PagessiggraphConference Proceedingsconference-collections
research-article

Augmented Reality-Based Procedural Task Training Application for Less Privileged Children and Autistic Individuals

Published: 14 November 2019 Publication History

Abstract

In this work, we evaluate the applicability of using Augmented Reality applications in for enhanced learning experiences for children from less privileged backgrounds, with a focus on autistic population. Such an intervention can prove to be very useful to children with reduced cognitive development. In our evaluation, we compare the AR mode of instruction for a procedural task training, using tangram puzzles, with live demonstration and a desktop-based application. First, we performed a within-subjects user study on neurotypical children in the age group of 9 - 12 years. We asked the children to independently solve a tangram puzzle after being trained through different modes of instruction. Second, we used the same instruction modes to train autistic participants. Our findings indicate that during training, children took the longest time to interact with Desktop-based instruction, and took the shortest time to interact with the live demonstration mode. Children also took the longest time to independently solve the tangram puzzle in the Desktop mode. We also found that autistic participants could use AR-based instructions but required more time to go through the training.

References

[1]
Zhen Bai, Alan F Blackwell, and George Coulouris. 2012. Making Pretense Visible and Graspable: An augmented reality approach to promote pretend play. In Mixed and Augmented Reality (ISMAR), 2012 IEEE International Symposium on. IEEE, 267–268.
[2]
Zhen Bai, Alan F Blackwell, and George Coulouris. 2013. Through the looking glass: Pretend play for children with autism. In Mixed and Augmented Reality (ISMAR), 2013 IEEE International Symposium on. IEEE, 49–58.
[3]
Beatriz Bernardo, Patrícia Alves-Oliveira, Maria Graça Santos, Francisco S Melo, and Ana Paiva. 2016. An Interactive Tangram Game for Children with Autism. In International Conference on Intelligent Virtual Agents. Springer, 500–504.
[4]
Mark Billinghurst. 2002. Augmented reality in education. New horizons for learning 12, 5 (2002).
[5]
Gerry Bohning and Jody Kosack Althouse. 1997. Using tangrams to teach geometry to young children. Early childhood education journal 24, 4 (1997), 239–242.
[6]
Emily C Bouck, Rajiv Satsangi, Teresa Taber Doughty, and William T Courtney. 2014. Virtual and concrete manipulatives: A comparison of approaches for solving mathematics problems for students with autism spectrum disorder. Journal of Autism and developmental disorders 44, 1 (2014), 180–193.
[7]
Yiyu Cai, Noel KH Chia, Daniel Thalmann, Norman KN Kee, Jianmin Zheng, and Nadia M Thalmann. 2013. Design and development of a virtual dolphinarium for children with autism. IEEE transactions on neural systems and rehabilitation engineering 21, 2(2013), 208–217.
[8]
Sandra Chan, Yiyu Cai, Andrew Lu, Nay Zin Tun, Lihui Huang, and Indhumathi Chandrasekaran. 2016. Virtual Reality Enhanced Pink Dolphin Game for Children with ASD. In Proceedings of the 3rd Asia-Europe Symposium on Simulation & Serious Gaming(VRCAI ’16). ACM, New York, NY, USA, 215–218. https://doi.org/10.1145/3014033.3014039
[9]
C.-Y. Chou, C.-C. Yang, and Z.-H. Chen. 2013. Applying augmented reality to assisting children in solving Tangram puzzle. Proceedings of the 21st International Conference on Computers in Education, ICCE 2013 (2013), 139–144.
[10]
Arindam Dey, Mark Billinghurst, Robert W. Lindeman, and J. Edward Swan. 2018. A Systematic Review of 10 Years of Augmented Reality Usability Studies: 2005 to 2014. Frontiers in Robotics and AI 5 (2018), 37. https://doi.org/10.3389/frobt.2018.00037
[11]
Arindam Dey, Alex Chatburn, and Mark Billinghurst. 2019. Exploration of an EEG-Based Cognitively Adaptive Training System in Virtual Reality. In Virtual Reality (VR), 2011 IEEE International Conference on. IEEE, 1–7.
[12]
Edgar A Doll. 1953. The measurement of social competence: A manual for the Vineland Social Maturity Scale.(1953).
[13]
Matt Dunleavy, Chris Dede, and Rebecca Mitchell. 2009. Affordances and limitations of immersive participatory augmented reality simulations for teaching and learning. Journal of science Education and Technology 18, 1 (2009), 7–22.
[14]
Andreas Dünser, Karin Steinbügl, Hannes Kaufmann, and Judith Glück. 2006. Virtual and augmented reality as spatial ability training tools. In Proceedings of the 7th ACM SIGCHI New Zealand chapter’s international conference on Computer-human interaction: design centered HCI. ACM, 125–132.
[15]
Lizbeth Escobedo, Monica Tentori, Eduardo Quintana, Jesus Favela, and Daniel Garcia-Rosas. 2014. Using augmented reality to help children with autism stay focused. IEEE Pervasive Computing 13, 1 (2014), 38–46.
[16]
M Frutos-Pascual, B García-Zapirain, and A Méndez-Zorrilla. 2012. Improvement in cognitive therapies aimed at the elderly using a mixed-reality tool based on tangram game. In Computer Applications for Graphics, Grid Computing, and Industrial Environment. Springer, 68–75.
[17]
Daniel H Geschwind and Pat Levitt. 2007. Autism spectrum disorders: developmental disconnection syndromes. Current opinion in neurobiology 17, 1 (2007), 103–111.
[18]
Steven J Henderson and Steven K Feiner. 2011. Augmented reality in the psychomotor phase of a procedural task. In Mixed and Augmented Reality (ISMAR), 2011 10th IEEE International Symposium on. IEEE, 191–200.
[19]
Y-H Hung, C-H Chen, and S-W Huang. 2017. Applying augmented reality to enhance learning: a study of different teaching materials. Journal of Computer Assisted Learning 33, 3 (2017), 252–266.
[20]
NS Lakshmiprabha, Alexandre Santos, Dimitar Mladenov, and Olga Beltramello. 2014. [Poster] An augmented and virtual reality system for training autistic children. In Mixed and Augmented Reality (ISMAR), 2014 IEEE International Symposium on. IEEE, 277–278.
[21]
Kangdon Lee. 2012. Augmented reality in education and training. TechTrends 56, 2 (2012), 13–21.
[22]
Chien-Yu Lin, Hua-Chen Chai, Jui-ying Wang, Chien-Jung Chen, Yu-Hung Liu, Ching-Wen Chen, Cheng-Wei Lin, and Yu-Mei Huang. 2016. Augmented reality in educational activities for children with disabilities. Displays 42(2016), 51–54.
[23]
AJ Malin. 1969. Malin’s intelligence scale for Indian children. Nagpur (India): Child Guidance Center(1969).
[24]
Katerina Malisova, Katerina Mania, S Moysiadou, and Elias Kourkoutas. 2015. Tangram quests: a tablet adventure game assisting children with high functioning autism to enhance their communicative and social skills. EDULEARN15 Proceedings(2015), 481–487.
[25]
Éric Marchand, Fabien Spindler, and François Chaumette. 2005. ViSP for visual servoing: a generic software platform with a wide class of robot control skills. IEEE Robotics & Automation Magazine 12, 4 (2005), 40–52.
[26]
Michael R Marner, Andrew Irlitti, and Bruce H Thomas. 2013. Improving procedural task performance with Augmented Reality annotations. In Mixed and Augmented Reality (ISMAR), 2013 IEEE International Symposium on. IEEE, 39–48.
[27]
Don D McMahon, David F Cihak, Rachel E Wright, and Sherry Mee Bell. 2016. Augmented reality for teaching science vocabulary to postsecondary education students with intellectual disabilities and autism. Journal of Research on Technology in Education 48, 1 (2016), 38–56.
[28]
Reema Muneer, Tanushree Saxena, and Prathibha Karanth. 2015. Virtual Reality Games as an Intervention for Children: A Pilot Study. Disability, CBR & Inclusive Development 26, 3 (2015), 77–96.
[29]
Nigel Newbutt, Connie Sung, Hung Jen Kuo, and Michael J Leahy. 2016a. The potential of virtual reality technologies to support people with an autism condition: A case study of acceptance, presence and negative effects. Annual Review of Cyber Therapy and Telemedicine (ARCTT) 14 (2016), 149–154.
[30]
Nigel Newbutt, Connie Sung, Hung-Jen Kuo, Michael J Leahy, Chien-Chun Lin, and Boyang Tong. 2016b. Brief report: A pilot study of the use of a virtual reality headset in autism populations. Journal of autism and developmental disorders 46, 9 (2016), 3166–3176.
[31]
Rincon M Nubia, Garay R Fabian, Rodriguez A Wilson, and Perez B Wilmer. 2015. Development of a mobile application in augmented reality to improve the communication field of autistic children at a Neurorehabilitar Clinic. In Engineering Applications-International Congress on Engineering (WEA), 2015 Workshop on. IEEE, 1–6.
[32]
Masataka Ohta. 1987. Cognitive disorders of infantile autism: A study employing the WISC, spatial relationship conceptualization, and gesture imitations. Journal of Autism and Developmental Disorders 17, 1 (1987), 45–62.
[33]
Edwin Olson. 2011. AprilTag: A robust and flexible visual fiducial system. In Robotics and Automation (ICRA), 2011 IEEE International Conference on. IEEE, 3400–3407.
[34]
Zhigeng Pan, Adrian David Cheok, Hongwei Yang, Jiejie Zhu, and Jiaoying Shi. 2006. Virtual reality and mixed reality for virtual learning environments. Computers & graphics 30, 1 (2006), 20–28.
[35]
Jacqui Rodgers, Sarah Wigham, Helen McConachie, Mark Freeston, Emma Honey, and Jeremy R Parr. 2016. Development of the anxiety scale for children with autism spectrum disorder (ASC-ASD). Autism Research 9, 11 (2016), 1205–1215.
[36]
Barnabas Takacs. 2005. Special education and rehabilitation: teaching and healing with interactive graphics. IEEE Computer Graphics and Applications 25, 5 (2005), 40–48.
[37]
Monica Tentori, Lizbeth Escobedo, and Gabriela Balderas. 2015. A smart environment for children with autism. IEEE Pervasive Computing 14, 2 (2015), 42–50.
[38]
Alessandro Trivilini, Licia Sbattella, and Roberto Tedesco. 2011. Multimodal Interaction for Users with Autism in a 3D Educational Environment. In IADIS International Conference on Interfaces and Human Computer Interaction 2011. 1–9.
[39]
Annie Joyce Vullamparthi, Sarat Chandra Babu Nelaturu, Dakshayani D Mallaya, and S Chandrasekhar. 2013. Assistive learning for children with autism using augmented reality. In Technology for Education (T4E), 2013 IEEE Fifth International Conference on. IEEE, 43–46.
[40]
Michelle Wang and Denise Reid. 2013. Using the virtual reality-cognitive rehabilitation approach to improve contextual processing in children with autism. The Scientific World Journal 2013 (2013).
[41]
Hsin-Kai Wu, Silvia Wen-Yu Lee, Hsin-Yi Chang, and Jyh-Chong Liang. 2013. Current status, opportunities and challenges of augmented reality in education. Computers & education 62 (2013), 41–49.
[42]
Begoña García Zapirain, Amaia Méndez Zorrilla, and Sabin Larrañaga. 2010. Psycho-stimulation for elderly people using puzzle game. In Games Innovations Conference (ICE-GIC), 2010 International IEEE Consumer Electronics Society’s. IEEE, 1–8.

Cited By

View all
  • (2024)Autistic Expression Beyond the Verbal - Studying Minimally-Verbal Autistic Indian Children's Embodied Interactions with Screen-Based TechnologyProceedings of the 23rd Annual ACM Interaction Design and Children Conference10.1145/3628516.3655792(612-624)Online publication date: 17-Jun-2024
  • (2024)Augmented reality-enhanced language learning for children with autism spectrum disorder: a systematic literature reviewBehaviour & Information Technology10.1080/0144929X.2024.230460743:16(4097-4124)Online publication date: 19-Jan-2024
  • (2023)Application of Augmented Reality Interventions for Children with Autism Spectrum Disorder (ASD): A Systematic ReviewComputers10.3390/computers1210021512:10(215)Online publication date: 23-Oct-2023
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
VRCAI '19: Proceedings of the 17th International Conference on Virtual-Reality Continuum and its Applications in Industry
November 2019
354 pages
ISBN:9781450370028
DOI:10.1145/3359997
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 November 2019

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. augmented reality
  2. autism
  3. children
  4. instruction
  5. less privileged
  6. training

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

VRCAI '19
Sponsor:

Acceptance Rates

Overall Acceptance Rate 51 of 107 submissions, 48%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)59
  • Downloads (Last 6 weeks)2
Reflects downloads up to 16 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Autistic Expression Beyond the Verbal - Studying Minimally-Verbal Autistic Indian Children's Embodied Interactions with Screen-Based TechnologyProceedings of the 23rd Annual ACM Interaction Design and Children Conference10.1145/3628516.3655792(612-624)Online publication date: 17-Jun-2024
  • (2024)Augmented reality-enhanced language learning for children with autism spectrum disorder: a systematic literature reviewBehaviour & Information Technology10.1080/0144929X.2024.230460743:16(4097-4124)Online publication date: 19-Jan-2024
  • (2023)Application of Augmented Reality Interventions for Children with Autism Spectrum Disorder (ASD): A Systematic ReviewComputers10.3390/computers1210021512:10(215)Online publication date: 23-Oct-2023
  • (2023)Extended Reality-Based Mobile Application Solutions for the Therapy of Children with Autism Spectrum Disorders: A Systematic Literature Review (Preprint)JMIR Serious Games10.2196/49906Online publication date: 13-Jun-2023
  • (2023)Evaluating user interface of a mobile augmented reality coloring application for children with autismInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2023.103085178:COnline publication date: 1-Oct-2023
  • (2023)Augmented Reality to Reinforce Working Memory in Children with ASD. A Case StudiesComputer Science – CACIC 202210.1007/978-3-031-34147-2_2(21-32)Online publication date: 27-May-2023
  • (2022)Attention-Based Applications in Extended Reality to Support Autistic Users: A Systematic ReviewIEEE Access10.1109/ACCESS.2022.314772610(15574-15593)Online publication date: 2022
  • (2022)The application of augmented reality in the learning of autistic students: a systematic and thematic review in 1996–2020Journal of Enabling Technologies10.1108/JET-12-2021-006816:2(75-90)Online publication date: 6-Jun-2022
  • (2021)TrainAR: A Scalable Interaction Concept and Didactic Framework for Procedural Trainings Using Handheld Augmented RealityMultimodal Technologies and Interaction10.3390/mti50700305:7(30)Online publication date: 22-Jun-2021
  • (2021)Mobile Augmented Reality Technologies for Autism Spectrum Disorder Interventions: A Systematic Literature ReviewApplied Sciences10.3390/app1110455011:10(4550)Online publication date: 17-May-2021
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media