skip to main content
research-article

C-Hg: A Collaborative Haptic-Gripper Fine Motor Skill Training System for Children with Autism Spectrum Disorder

Published: 21 July 2021 Publication History

Abstract

Computer-assisted systems can provide efficient and engaging ASD intervention environments for children with Autism Spectrum Disorder (ASD). However, most existing computer-assisted systems target only one skill deficit (e.g., social conversation skills) and ignore the importance of other areas, such as motor skills, that could also impact social interaction. This focus on a single domain may hinder the generalizability of learned skills to real-world scenarios, because the targeted teaching strategies do not reflect that real-world tasks often involve more than one skill domain. The work presented in this article seeks to bridge this gap by developing a Collaborative Haptic-gripper virtual skill training system (C-Hg). This system includes individual and collaborative games that provide opportunities for simultaneously practicing both fine motor skills (hand movement and grip control skills) as well as social skills (communication and collaboration) and investigating how they relate to each other. We conducted a usability study with 10 children with ASD and 10 Typically Developing (TD) children (8–12 years), who used C-Hg to play a series of individual and collaborative games requiring differing levels of motor and communication skill. Results revealed that participant performance significantly improved in both individual and collaborative fine motor skill training tasks, including significant improvements in collaborative manipulations between partners. Participants with ASD were found to conduct more collaborative manipulations and initiate more conversations with their partners in the post collaborative tasks, suggesting more active collaboration and communication of participants with ASD in the collaborative tasks. Results support the potential of our C-Hg system for simultaneously improving fine motor and social skills, with implications for impacts of improved fine motor skills on social outcomes.

References

[1]
E. L. Hill. 2004. Evaluating the theory of executive dysfunction in autism. Develop. Rev. 24, 2 (2004), 189–233.
[2]
S. Ozonoff and J. Jensen. 1999. Brief report: Specific executive function profiles In three neurodevelopmental disorders. J. Autism Develop. Disord. 29, 2 (1999), 171–177.
[3]
S. Ozonoff et al. 1994. Executive function abilities in autism and Tourette syndrome: An information processing approach. J. Child Psychol. Psych. 35, 6 (1994), 1015–1032.
[4]
R. L. McLean et al. 2014. Executive function in probands with autism with average IQ and their unaffected first-degree relatives. J. Amer. Acad. Child Adolescent Psych. 53, 9 (2014), 1001–1009.
[5]
J. Biederman et al. 2006. Impact of psychometrically defined deficits of executive functioning in adults with attention deficit hyperactivity disorder. Amer. J. Psychiatry 163, 10 (2006), 1730–1738.
[6]
A. S. Law et al. 2013. The impact of working memory load on task execution and online plan adjustment during multitasking in a virtual environment. Quart. J. Exp. Psychol. 66, 6 (2013), 1241–1258.
[7]
R. Mackinlay, T. Charman, and A. Karmiloff-Smith. 2006. High functioning children with autism spectrum disorder: A novel test of multitasking. Brain Cogn. 61, 1 (2006), 14–24.
[8]
G. Rajendran et al. 2011. Investigating multitasking in high-functioning adolescents with autism spectrum disorders using the virtual errands task. J. Autism Develop. Disord. 41, 11 (2011), 1445–1454.
[9]
S. J. White, P. W. Burgess, and E. L. Hill. 2009. Impairments on “open-ended” executive function tests in autism. Autism Res. 2, 3 (2009), 138–147.
[10]
P. W. Burgess et al. 2000. The cognitive and neuroanatomical correlates of multitasking. Neuropsychologia 38, 6 (2000), 848–863.
[11]
P. McGeorge et al. 2001. Using Virtual Environments in the Assessment of Executive Dysfunction. Presence: Teleoper. Virtual Environ. 10, 4 (2001), 375–383.
[12]
S. M. Hutchison, U. Müller, and G. Iarocci. 2019. Parent reports of executive function associated with functional communication and conversational skills among school age children with and without autism spectrum disorder. J. Autism Develop. Disord. 2019, 1–11.
[13]
P. A. Rao, D. C. Beidel, and M. J. Murray. 2008. Social skills interventions for children with Asperger's syndrome or high-functioning autism: A review and recommendations. J. Autism Develop. Disord. 38, 2 (2008), 353–361.
[14]
E. Gowen and A. Hamilton. 2013. Motor abilities in autism: A review using a computational context. J. Autism Develop. Disord. 43, 2 (2013), 323–344.
[15]
X. Ming, M. Brimacombe, and G. C. Wagner. 2007. Prevalence of motor impairment in autism spectrum disorders. Brain Dev. 29, 9 (2007), 565–570.
[16]
E. M. Jansiewicz et al. 2006. Motor signs distinguish children with high functioning autism and Asperger's syndrome from controls. J. Autism Develop. Disord. 36, 5 (2006), 613–621.
[17]
S. Forti et al. 2011. Motor planning and control in autism. A kinematic analysis of preschool children. Res. Autism Spectrum Disord. 5, 2. (2011), 834–842.
[18]
M. MacDonald, C. Lord, and D. A. Ulrich. 2013. The relationship of motor skills and social communicative skills in school-aged children with autism spectrum disorder. Adapt. Phys. Activ. Quart. 30, 3 (2013), 271–282.
[19]
F. J. David et al. 2012. Coordination of precision grip in 2–6 years-old children with autism spectrum disorders compared to children developing typically and children with developmental disabilities.
[20]
A. Crippa et al. 2013. Eye-hand coordination in children with high functioning autism and Asperger's disorder using a gap-overlap paradigm. J. Autism Develop. Disord. 43, 4 (2013), 841–850.
[21]
B. P. Johnson et al. 2013. A quantitative comparison of handwriting in children with high-functioning autism and attention deficit hyperactivity disorder. Res. Autism Spectrum Disord. 7, 12 (2013), 1638–1646.
[22]
L. Chetcuti et al. 2019. Object-directed imitation in autism spectrum disorder is differentially influenced by motoric task complexity, but not social contextual cues. Autism 23, 1 (2019), 199–211.
[23]
S. M. Srinivasan et al. 2015. The effects of rhythm and robotic interventions on the imitation/praxis, interpersonal synchrony, and motor performance of children with autism spectrum disorder (ASD): A pilot randomized controlled trial. Autism Res. Treat. 2015 (2015).
[24]
F. Fulceri et al. 2018. Motor skills as moderators of core symptoms in autism spectrum disorders: Preliminary data from an exploratory analysis with Artificial Neural Networks. Front. Psychol. 9 (2018), 2683.
[25]
H. Zhao et al. 2018. Hand-in-hand: A communication-enhancement collaborative virtual reality system for promoting social interaction in children with autism spectrum disorders. IEEE Trans. Hum.-Mach. Syst. 48, 2 (2018), 136–148.
[26]
Z. Zheng et al. 2017. Design, development, and evaluation of a noninvasive autonomous robot-mediated joint attention intervention system for young children with ASD. IEEE Trans. Hum.-Mach. Syst. 48, 2 (2017), 125–135.
[27]
A. Battocchi et al. 2009. Collaborative puzzle game: A tabletop interactive game for fostering collaboration in children with Autism Spectrum Disorders (ASD). In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces. ACM.
[28]
E.-L. Sallnäs. 2010. Haptic feedback increases perceived social presence. In Proceedings of the International Conference on Human Haptic Sensing and Touch Enabled Computer Applications. Springer.
[29]
C. Basdogan et al. 2000. An experimental study on the role of touch in shared virtual environments. ACM Trans. Comput.-Hum. Interact. 7, 4 (2000), 443–460.
[30]
S. Rosenblum, H. A. B. Simhon, and E. Gal. 2016. Unique handwriting performance characteristics of children with high-functioning autism spectrum disorder. Res. Autism Spectrum Disord. 23, (2016) 235–244.
[31]
S. E. Palsbo and P. Hood-Szivek. 2012. Effect of robotic-assisted three-dimensional repetitive motion to improve hand motor function and control in children with handwriting deficits: A nonrandomized phase 2 device trial. Amer. J. Occupation. Ther. 66, 6 (2012), 682–690.
[32]
Y.-S. Kim et al. 2013. Haptics assisted training (HAT) system for children's handwriting. In Proceedings of the World Haptics Conference (WHC’13). IEEE.
[33]
H. Zhao et al. 2018. Understanding fine motor patterns in children with autism using a haptic-gripper virtual reality system. In Proceedings of the International Conference on Universal Access in Human-Computer Interaction. Springer.
[34]
H. Zhao et al. 2018. Design of a haptic-gripper virtual reality system (Hg) for analyzing fine motor behaviors in children with autism. ACM Trans. Access. Comput. 11, 4 (2018), 19.
[35]
The Geomagic Touch Haptic Device. Retrieved from http://www.geomagic.com/en/products/phantom-omni/overview.
[36]
J. E. Colgate, M. C. Stanley, and J. M. Brown. 1995. Issues in the haptic display of tool use. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems: “Human Robot Interaction and Cooperative Robots.” IEEE.
[37]
R. J. Adams and B. Hannaford. 1999. Stable haptic interaction with virtual environments. IEEE Trans. Robot. Autom. 15, 3 (1999), 465–474.
[38]
G. Sankaranarayanan and B. Hannaford. 2006. Virtual coupling schemes for position coherency in networked haptic environments. In The Proceedings of the 1st IEEE/RAS-EMBS International Conference on Biomedical Robotics and Biomechatronics (BioRob’06). IEEE.
[39]
G. Niemeyer and J.-J. E. Slotine. 2004. Telemanipulation with time delays. Int. J. Robot. Res. 23, 9 (2004), 873–890.
[40]
G. Niemeyer and J.-J. Slotine. 1991. Stable adaptive teleoperation. IEEE J. Ocean. Eng. 16, 1 (1991), 152–162.
[41]
C. Yang et al. 2017. Teleoperation control based on combination of wave variable and neural networks. IEEE Trans. Syst., Man, Cybernet.: Syst. 47, 8 (2017), 2125–2136.
[42]
Z. Wang et al. 2015. Individuals with autism spectrum disorder show abnormalities during initial and subsequent phases of precision gripping. J. Neurophysiol. 113, 7 (2015), 1989–2001.
[43]
A. Anzulewicz, K. Sobota, and J. T. Delafield-Butt. 2016. Toward the autism motor signature: Gesture patterns during smart tablet gameplay identify children with autism. Sci. Rep. (2016). 6 31107.
[44]
J. L. Cook, S.-J. Blakemore, and C. Press. 2013. Atypical basic movement kinematics in autism spectrum conditions. Brain 136, 9 (2013), 2816–2824.
[45]
C. Lord et al. 2000. The autism diagnostic observation schedule-generic: A standard measure of social and communication deficits associated with the spectrum of autism, (in English). J. Autism Develop. Disord. 30, 3 (2000), 205–223.
[46]
J. N. Constantino and C. P. Gruber. 2007. Social Responsiveness Scale (SRS). Western Psychological Services, Los Angeles, CA.
[47]
M. Rutter, A. Bailey, and C. Lord. 2003. The social communication questionnaire: Manual. Western Psychological Services, Los Angeles, CA.
[48]
Keith E. Beery and N. A. B. Natasha Beery. 2010. The Beery-Buktenica Developmental Test of Visual-Motor Integration: Beery VMI with Supplemental Developmental Tests of Visual Perception and Motor Coordination: Administration, Scoring and Teaching Manual (6th ed.). NSC Pearson, Minneapolis, MN.
[49]
F. Wilcoxon. 1945. Individual comparisons by ranking methods. Biometr. Bull. 1, 6 (1945), 80–83.
[50]
J. Cohen. 1988. Statistical Power Analysis for the Behavioral Sciences. L. Erlbaum Associates, Hillsdale, NJ.
[51]
G. T. Baranek, L. Wakeford, and F. David. 2008. Understanding, assessing, and treating sensory–motor issues. Autism Spectrum Disord. Infants Toddlers: Diagnos. Assess. Treat. 2008: 104–140.
[52]
M. Sowa and R. Meulenbroek. 2012. Effects of physical exercise on autism spectrum disorders: A meta-analysis. Res. Autism Spectrum Disord. 6, 1 (2012), 46–57.
[53]
J. Wainer et al. 2010. The effectiveness of using a robotics class to foster collaboration among groups of children with autism in an exploratory study. Personal Ubiq. Comput. 14, 5 (2010), 445–455.
[54]
B. Huskens et al. 2015. Improving collaborative play between children with autism spectrum disorders and their siblings: The effectiveness of a robot-mediated intervention based on Lego therapy. J. Autism Develop. Disord. 45, 11 (2015), 3746–3755.
[55]
H. Zhao. 2021. Modeling and analysis of multimodal collaborative virtual interaction for autism spectrum disorder Intervention [Unpublished doctoral thesis]. Vanderbilt University
[56]
L. Zhang, Z. Warren, A. Swanson, A. Weitlauf, and N. Sarkar. 2018. Understanding performance and verbal-communication of children with ASD in a collaborative virtual environment. J. Autism Develop. Disord. 48, 8 (2018), 2779–2789.
[57]
J. S. Owen-DeSchryver, E. G. Carr, S. I. Cale, and A. Blakeley-Smith. 2008. Promoting social interactions between students with autism spectrum disorders and their peers in inclusive school settings. Focus Autism Develop. Disabil. 23, 1 (2008), 15–28.

Cited By

View all
  • (2025)How technology augments Dance Movement Therapy for Autism Spectrum Disorder: A systematic review for 2017–2022Entertainment Computing10.1016/j.entcom.2024.10086152(100861)Online publication date: Jan-2025
  • (2024)Wearable Technology for Signal Acquisition and Interactive Feedback in Autism Spectrum Disorder Intervention: A ReviewIEEE Sensors Journal10.1109/JSEN.2024.337476224:9(13797-13815)Online publication date: 1-May-2024
  • (2023)Requirements Gathering Regarding Fine Motor Skills, Adaptive Difficulty and Executive Functions for a Game in Development for Therapy Sessions with Autistic Children to Encourage CollaborationProceedings of the 2023 ACM International Conference on Interactive Media Experiences Workshops10.1145/3604321.3604345(32-37)Online publication date: 12-Jun-2023
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Accessible Computing
ACM Transactions on Accessible Computing  Volume 14, Issue 2
June 2021
174 pages
ISSN:1936-7228
EISSN:1936-7236
DOI:10.1145/3477222
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 July 2021
Accepted: 01 March 2021
Revised: 01 January 2021
Received: 01 July 2020
Published in TACCESS Volume 14, Issue 2

Permissions

Request permissions for this article.

Check for updates

Qualifiers

  • Research-article
  • Research
  • Refereed

Funding Sources

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)116
  • Downloads (Last 6 weeks)26
Reflects downloads up to 07 Mar 2025

Other Metrics

Citations

Cited By

View all
  • (2025)How technology augments Dance Movement Therapy for Autism Spectrum Disorder: A systematic review for 2017–2022Entertainment Computing10.1016/j.entcom.2024.10086152(100861)Online publication date: Jan-2025
  • (2024)Wearable Technology for Signal Acquisition and Interactive Feedback in Autism Spectrum Disorder Intervention: A ReviewIEEE Sensors Journal10.1109/JSEN.2024.337476224:9(13797-13815)Online publication date: 1-May-2024
  • (2023)Requirements Gathering Regarding Fine Motor Skills, Adaptive Difficulty and Executive Functions for a Game in Development for Therapy Sessions with Autistic Children to Encourage CollaborationProceedings of the 2023 ACM International Conference on Interactive Media Experiences Workshops10.1145/3604321.3604345(32-37)Online publication date: 12-Jun-2023
  • (2023)AI Coach: A Motor Skill Training System using Motion Discrepancy DetectionProceedings of the Augmented Humans International Conference 202310.1145/3582700.3582710(179-189)Online publication date: 12-Mar-2023
  • (2023)Exploring Earables to Monitor Temporal Lack of Focus during Online Meetings to Identify Onset of Neurological DisordersProceedings of the 8th ACM/IEEE International Conference on Connected Health: Applications, Systems and Engineering Technologies10.1145/3580252.3586981(126-137)Online publication date: 21-Jun-2023
  • (2023)Towards Embodying Emotions in Play with Neurodivergent Children using Haptic TechnologiesExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3585613(1-7)Online publication date: 19-Apr-2023
  • (2022)INC-Hg: An Intelligent Collaborative Haptic-Gripper Virtual Reality SystemACM Transactions on Accessible Computing10.1145/348760615:1(1-23)Online publication date: 4-Mar-2022

View Options

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media