research-article

Design of a Haptic-Gripper Virtual Reality System (Hg) for Analyzing Fine Motor Behaviors in Children with Autism

Authors:

Zachary Warren,

Nilanjan SarkarAuthors Info & Claims

ACM Transactions on Accessible Computing (TACCESS), Volume 11, Issue 4

Article No.: 19, Pages 1 - 21

https://doi.org/10.1145/3231938

Published: 16 November 2018 Publication History

Abstract

Fine motor skills, including grasping, manipulating, and reaching for objects, are a documented weakness for many children with Autism Spectrum Disorders (ASD). However, relatively less research has attempted to address these motor deficits, especially by taking advantage of advanced technology. To explore potential mechanisms for expanding accessibility to fine motor intervention for people with ASD, we present the design and implementation of a feasibility study of a novel Haptic-Gripper Virtual Reality System (Hg). Hg is capable of providing analysis and practice opportunities of fine motor skills in an adaptive and low-cost virtual environment with real-time auditory, visual, and haptic feedback. The Haptic Gripper in Hg can detect a user's grip force and hand location and provide haptic feedback to guide hand movement and grip control while completing several simple and engaging virtual fine motor tasks. We conducted a feasibility study with six children with ASD and six typically developing (TD) children and found that participants were interested in using the Haptic Gripper and could quickly get used to the system. Although the results are preliminary and limited, we observed medium to strong correlations between the proposed fine motor skill metrics and the scores achieved with a standardized fine motor skill test and improvements of participants in accuracy and steadiness of movement and force control. This study provides important guidance for future investigations of the Hg's potential for assessing and improving fine motor manipulation skills.

References

[1]

J. Biao. 2012. Prevalence of autism spectrum disorders: autism and developmental disabilities monitoring network, 14 sites, united states, 2008. Morbidity and Mortality Weekly Report. Surveillance Summaries 61, 3 (2012). Centers for Disease Control and Prevention.

[2]

C. P. Johnson and S. M. Myers. 2007. Identification and evaluation of children with autism spectrum disorders. Pediatrics 120, 5 (2007), 1183--1215.

[3]

M. Wingate et al. 2014. Prevalence of autism spectrum disorder among children aged 8 years-autism and developmental disabilities monitoring network, 11 sites, united states, 2010. MMWR Surveillance Summaries 63, 2.

[4]

E. Gowen and A. Hamilton. 2013. Motor abilities in autism: A review using a computational context. Journal of Autism and Developmental Disorders 43, 2 (2013), 323--344.

[5]

X. Ming, M. Brimacombe, and G. C. Wagner. 2007. Prevalence of motor impairment in autism spectrum disorders. Brain and Development 29, 9 (2007), 565--570.

[6]

E. M. Jansiewicz et al. 2006. Motor signs distinguish children with high functioning autism and Asperger's syndrome from controls. Journal of Autism and Developmental Disorders 36, 5 (2006), 613--621.

[7]

S. Forti et al. 2011. Motor planning and control in autism. A kinematic analysis of preschool children. Research in Autism Spectrum Disorders 5, 2 (2011), 834--842.

[8]

B. Provost, B. R. Lopez, and S. Heimerl. 2007. A comparison of motor delays in young children: Autism spectrum disorder, developmental delay, and developmental concerns. Journal of Autism and Developmental Disorders 37, 2 (2007), 321--328.

[9]

K. A. Fournier et al. 2010. Motor coordination in autism spectrum disorders: A synthesis and meta-analysis. Journal of Autism and Developmental Disorders 40, 10 (2010), 1227--1240.

[10]

F. J. David et al. 2012. Coordination of precision grip in 2-6 year-old children with autism spectrum disorders compared to children developing typically and children with developmental disabilities. Frontiers in Integrative Neuroscience 6 (2012), 122.

[11]

M. A. Cuffaro. 2011. Fine motor skills. In Encyclopedia of Child Behavior and Development, Sam Goldstein and Jack A. Naglieri (Eds.). Springer. 657--657. https://link.springer.com/referenceworkentry/10.1007%2F978-0-387-79061-9_1141.

[12]

J. Case-Smith. 2013. Fine motor development. In Encyclopedia of Autism Spectrum Disorders, Fred R. Volkmar (Ed.). 1290--1296. https://link.springer.com/referenceworkentry/10.1007/978-1-4419-1698-3_619.

[13]

A. Crippa et al. 2013. Eye-hand coordination in children with high functioning autism and Asperger's disorder using a gap-overlap paradigm. Journal of Autism and Developmental Disorders 43, 4 (2013), 841--850.

[14]

B. P. Johnson et al. 2013. A quantitative comparison of handwriting in children with high-functioning autism and attention deficit hyperactivity disorder. Research in Autism Spectrum Disorders 7, 12 (2013), 1638--1646.

[15]

C. Glazebrook et al. 2009. The role of vision for online control of manual aiming movements in persons with autism spectrum disorders. Autism 13, 4 (2009), 411--433.

[16]

G. T. Baranek et al. 2012. Coordination of precision grip in 2--6 years-old children with autism spectrum disorders compared to children developing typically and children with developmental disabilities. Frontiers in Integrative Neuroscience 6 (2012), 122.

[17]

D. Grissmer et al. 2010. Fine motor skills and early comprehension of the world: Two new school readiness indicators. Developmental Psychology 46, 5 (2010), 1008.

[18]

C. E. Cameron et al. 2012. Fine motor skills and executive function both contribute to kindergarten achievement. Child Development 83, 4 (2012), 1229--1244.

[19]

E. Jasmin et al. 2009. Sensori-motor and daily living skills of preschool children with autism spectrum disorders. Journal of Autism and Developmental Disorders 39, 2 (2009), 231--241.

[20]

J. P. Piek, G. B. Baynam, and N. C. Barrett. 2006. The relationship between fine and gross motor ability, self-perceptions and self-worth in children and adolescents. Human Movement Science 25, 1 (2006), 65--75.

[21]

A. Cummins, J. P. Piek, and M. J. Dyck. 2005. Motor coordination, empathy, and social behaviour in school-aged children. Developmental Medicine 8 Child Neurology 47, 7 (2005), 437--442.

[22]

Keith E. Beery and N. A. B. Natasha Beery. 2010. The Beery-Buktenica Developmental Test of Visual-Motor Integration: Beery VMI with Supplemental Developmental Tests of Visual Perception and Motor Coordination: Administration, Scoring and Teaching Manual (6th ed.). Minneapolis, MN: NSC Pearson.

[23]

H. Zhao et al. 2017. Design of a haptic virtual system for improving fine motor skills in children with autism. In Proceedings of the International Conference on Applied Human Factors and Ergonomics. Springer, Los Angeles, California, 204--216.

[24]

I. A. C. Committee. 2014. IACC Strategic Plan for Autism Spectrum Disorder (ASD) Research-2013 Update. April 2014. Retrieved from the US Department of Health and Human Services Interagency Autism Coordinating Committee website: http://iacc.hhs.gov/strategic-plan/2013/index.shtml.plan/2013/index.shtml, 2014.

[25]

B. O. Ploog et al. 2013. Use of computer-assisted technologies (CAT) to enhance social, communicative, and language development in children with autism spectrum disorders. Journal of Autism and Developmental Disorders 43, 2 (2013), 301--322.

[26]

J. Wade et al. 2014. Design of a virtual reality driving environment to assess performance of teenagers with ASD. In Proceedings of the International Conference on Universal Access in Human-Computer Interaction. Springer.

[27]

Z. Zheng et al. 2017. Design of an autonomous social orienting training system (ASOTS) for young children with autism. IEEE Transactions on Neural Systems and Rehabilitation Engineering 25, 6 (2017), 668--678.

[28]

H. Zhao et al. 2018. Hand-in-hand: A communication-enhancement collaborative virtual reality system for promoting social interaction in children with autism spectrum disorders. IEEE Transactions on Human-Machine Systems 48, 2 (2018), 136--148.

[29]

H. Zhao et al. 2017. Design of a tablet game to assess the hand movement in children with autism. In Proceedings of the International Conference on Universal Access in Human-Computer Interaction. Springer.

[30]

J. A. Kientz et al. 2013. Interactive technologies for autism. Synthesis Lectures on Assistive, Rehabilitative, and Health-Preserving Technologies 2, 2 (2013), 1--177.

[31]

Y.-S. Kim et al. 2013. Haptics assisted training (HAT) system for children's handwriting. In Proceedings of the World Haptics Conference (WHC’13). IEEE, Daejeon, 559--564.

[32]

R. P. Khurshid et al. 2017. Effects of grip-force, contact, and acceleration feedback on a teleoperated pick-and-place task. IEEE Transactions on Haptics 10, 1 (2017), 40--53.

Digital Library

[33]

C. Sutherland et al. 2013. An augmented reality haptic training simulator for spinal needle procedures. IEEE Transactions on Biomedical Engineering 60, 11 (2013), 3009--3018.

[34]

D. Morris et al. 2007. Haptic feedback enhances force skill learning. In Proceedings of the EuroHaptics Conference, 2007 and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. IEEE.

Digital Library

[35]

A. Gupta and M. K. O'Malley. 2006. Design of a haptic arm exoskeleton for training and rehabilitation. IEEE/ASME Transactions on Mechatronics 11, 3 (2006), 280--289.

[36]

J. L. Patton, M. Kovic, and F. A. Mussa-Ivaldi. 2006. Custom-designed haptic training for restoring reaching ability to individuals with poststroke hemiparesis. Journal of Rehabilitation Research and Development 43, 5 (2006), 643.

[37]

S. Patomäki et al. 2004. Experiences on haptic interfaces for visually impaired young children. In Proceedings of the 6th International Conference on Multimodal Interfaces. ACM, State College, PA, 281--288.

Digital Library

[38]

S. Rosenblum, H. A. B. Simhon, and E. Gal. 2016. Unique handwriting performance characteristics of children with high-functioning autism spectrum disorder. Research in Autism Spectrum Disorders 23, 235--244.

[39]

S. E. Palsbo and P. Hood-Szivek. 2012. Effect of robotic-assisted three-dimensional repetitive motion to improve hand motor function and control in children with handwriting deficits: A nonrandomized phase 2 device trial. American Journal of Occupational Therapy 66, 6 (2012), 682--690.

[40]

B. P. Johnson et al. 2013. Understanding macrographia in children with autism spectrum disorders. Research in Developmental Disabilities 34, 9 (2013), 2917--2926.

[41]

R. Palluel-Germain et al. 2007. A visuo-haptic device-telemaque-increases kindergarten children's handwriting acquisition. In Proceedings of the EuroHaptics Conference, 2007 and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. IEEE.

Digital Library

[42]

N. Pernalete et al. 2005. Eye-hand coordination assessment/therapy using a robotic haptic device. In Proceedings of the 9th International Conference on Rehabilitation Robotics (ICORR’05). IEEE.

[43]

Z. Wang et al. 2015. Individuals with autism spectrum disorder show abnormalities during initial and subsequent phases of precision gripping. Journal of Neurophysiology 113, 7 (2015), 1989--2001.

[44]

F. J. David et al. 2009. A pilot study: Coordination of precision grip in children and adolescents with high functioning autism. Pediatric Physical Therapy 21, 2 (2009), 205.

[45]

T. H. Falk et al. 2011. On the development of a computer-based handwriting assessment tool to objectively quantify handwriting proficiency in children. Computer Methods and Programs in Biomedicine 104, 3 (2011), e102--e111.

Digital Library

[46]

S. M. Abu-Dahab et al. 2013. Motor and tactile-perceptual skill differences between individuals with high-functioning autism and typically developing individuals ages 5--21. Journal of Autism and Developmental Disorders 43, 10 (2013), 2241--2248.

[47]

The Geomagic Touch Haptic Device. Available from: http://www.geomagic.com/en/products/phantom-omni/overview.

[48]

M. Poyade, M. Kargas, and V. Portela. 2014. Haptic plug-in for unity. In Digital Design Studio (DDS), Glasgow School of Art, Glasgow, United Kingdom. https://core.ac.uk/download/pdf/28875009.pdf.

[49]

B. Hohendorff et al. 2010. Lengths, girths, and diameters of children's fingers from 3 to 10 years of age. Annals of Anatomy-Anatomischer Anzeiger 192, 3 (2010), 156--161.

[50]

H. Schwellnus et al. 2013. Writing forces associated with four pencil grasp patterns in grade 4 children. American Journal of Occupational Therapy 67, 2 (2013), 218--227.

[51]

Interlink Electronics. Available from: http://www.interlinkelectronics.com/FSR402.php.

[52]

Arduino. Available from: http://store-usa.arduino.cc/products/a000066.

[53]

Unity. Available from: https://unity3d.com/.

[54]

C. Hatzfeld and A. Thorsten. Engineering haptic device. Springer Series on Touch and Haptic Systems. Springer London Limited. https://link.springer.com/content/pdf/10.1007/978-1-4471-6518-7.pdf.

[55]

C. T. Fuentes, S. H. Mostofsky, and A. J. Bastian. 2009. Children with autism show specific handwriting impairments. Neurology 73, 19 (2009), 1532--1537.

[56]

Geomagic OpenHaptics Toolkit. Available from: https://www.3dsystems.com/haptics-devices/openhaptics.

[57]

C. Lord, M. Rutter, P. C. DiLavore, S. Risi, K. Gotham, and S. Bishop. 2012. Autism Diagnostic Observation Schedule-2 (ADOS-2). Western Psychological Services, Torrance, CA.

[58]

G. H. Roid. 2003. Stanford-Binet Intelligence Scales. Itasca, IL: Riverside Publishing.

[59]

J. N. Constantino and C. P. Gruber. 2007. Social Responsiveness Scale (SRS) 2007. Los Angeles, CA: Western Psychological Services.

[60]

F. Wilcoxon. 1945. Individual comparisons by ranking methods. Biometrics Bulletin 1, 6 (1945), 80--83.

[61]

J. Cohen. Statistical Power Analysis for the Behavioral Sciences. Hillsdale, NJ: L. Erlbaum Associates.

[62]

A. Y. Hardan et al. 2003. Motor performance and anatomic magnetic resonance imaging (MRI) of the basal ganglia in autism. Journal of Child Neurology 18, 5 (2003), 317--324.

Cited By

Maddalon LMinissi MParsons THervas AAlcaniz M(2024)Exploring Adaptive Virtual Reality Systems Used in Interventions for Children With Autism Spectrum Disorder: Systematic ReviewJournal of Medical Internet Research10.2196/5709326(e57093)Online publication date: 18-Sep-2024
https://doi.org/10.2196/57093
Monarca ICibrian FHurtado ITentori M(2024)Smartphone Haptics Can Uncover Differences in Touch Interactions Between ASD and NeurotypicalsProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36997498:4(1-34)Online publication date: 21-Nov-2024
https://dl.acm.org/doi/10.1145/3699749
Verma PPatel NSharma PKanetkar MSingh MLahiri U(2024)Assessment of Kinematic and Kinetic Attributes of Graphic Execution of Children With Autism and Typically Developing Children Using a Digitized PlatformIEEE Transactions on Learning Technologies10.1109/TLT.2024.335579317(1082-1092)Online publication date: 1-Jan-2024
https://dl.acm.org/doi/10.1109/TLT.2024.3355793
Show More Cited By

Index Terms

Design of a Haptic-Gripper Virtual Reality System (Hg) for Analyzing Fine Motor Behaviors in Children with Autism
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods
    2. Interaction devices
      1. Haptic devices

Recommendations

CheerBrush: A Novel Interactive Augmented Reality Coaching System for Toothbrushing Skills in Children with Autism Spectrum Disorder
Autism Spectrum Disorder (ASD) is a common neurodevelopmental disorder that impacts one in every 54 children in the United States. Some children with ASD have learning and fine motor skill challenges that contribute to difficulties completing daily living ...
Understanding Fine Motor Patterns in Children with Autism Using a Haptic-Gripper Virtual Reality System
Universal Access in Human-Computer Interaction. Methods, Technologies, and Users
Abstract
Many children with Autism Spectrum Disorders (ASD) experience deficits in fine motor skills as compared to their typically developing (TD) peers. It is possible that the differences in fine motor patterns of children with ASD may provide useful ...
Smart Toys Design Opportunities for Measuring Children's Fine Motor Skills Development
TEI '18: Proceedings of the Twelfth International Conference on Tangible, Embedded, and Embodied Interaction

Smart tangible toys, designed for hand manipulation, can transform fine motor skills assessment into enjoyable activities which are engaging for children to play (partially) unsupervised. Such toys can support school teachers and parents for early ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Accessible Computing

ACM Transactions on Accessible Computing Volume 11, Issue 4

December 2018

124 pages

ISSN:1936-7228

EISSN:1936-7236

DOI:10.1145/3292527

Editors:
Matt Huenerfauth
Rochester Institute of Technology, USA
,
Kathleen F. McCoy
University of Delaware, USA

Issue’s Table of Contents

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 16 November 2018

Accepted: 01 June 2018

Revised: 01 April 2018

Received: 01 November 2017

Published in TACCESS Volume 11, Issue 4

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Funding Sources

National Institutes of Health

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

20
Total Citations
View Citations
760
Total Downloads

Downloads (Last 12 months)117
Downloads (Last 6 weeks)29

Reflects downloads up to 07 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Maddalon LMinissi MParsons THervas AAlcaniz M(2024)Exploring Adaptive Virtual Reality Systems Used in Interventions for Children With Autism Spectrum Disorder: Systematic ReviewJournal of Medical Internet Research10.2196/5709326(e57093)Online publication date: 18-Sep-2024
https://doi.org/10.2196/57093
Monarca ICibrian FHurtado ITentori M(2024)Smartphone Haptics Can Uncover Differences in Touch Interactions Between ASD and NeurotypicalsProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36997498:4(1-34)Online publication date: 21-Nov-2024
https://dl.acm.org/doi/10.1145/3699749
Verma PPatel NSharma PKanetkar MSingh MLahiri U(2024)Assessment of Kinematic and Kinetic Attributes of Graphic Execution of Children With Autism and Typically Developing Children Using a Digitized PlatformIEEE Transactions on Learning Technologies10.1109/TLT.2024.335579317(1082-1092)Online publication date: 1-Jan-2024
https://dl.acm.org/doi/10.1109/TLT.2024.3355793
Gao XYin LTian SHuang YJi Q(2024)Wearable Technology for Signal Acquisition and Interactive Feedback in Autism Spectrum Disorder Intervention: A ReviewIEEE Sensors Journal10.1109/JSEN.2024.337476224:9(13797-13815)Online publication date: 1-May-2024
https://doi.org/10.1109/JSEN.2024.3374762
Krishnan KJomhari NKumar Ayyasamy RAbdul Kareem SKrishnan S(2024)Haptic Feedback: An Experimental Evaluation of Vibrations as Tactile Sense in Autistic PeopleIEEE Access10.1109/ACCESS.2024.341084512(81088-81104)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3410845
Kim SKo JShin CLim RSuh D(2023)Haptic Glove with Haptic Feedback for Elastic Objects at a Low CostAcademic Society for Appropriate Technology10.37675/jat.2023.004379:3(102-118)Online publication date: 30-Dec-2023
https://doi.org/10.37675/jat.2023.00437
Azevedo GGunsch MLacerda MPeixoto HBorges LNunes E(2023)Requirements Gathering Regarding Fine Motor Skills, Adaptive Difficulty and Executive Functions for a Game in Development for Therapy Sessions with Autistic Children to Encourage CollaborationProceedings of the 2023 ACM International Conference on Interactive Media Experiences Workshops10.1145/3604321.3604345(32-37)Online publication date: 12-Jun-2023
https://dl.acm.org/doi/10.1145/3604321.3604345
Minissi MLandini GMaddalon LTorres SGiglioli ISirera MAbad LGómez-García SAlcañiz M(2023)Virtual Reality-Based Serious Games to Improve Motor Learning in Children with Autism Spectrum Disorder: An Exploratory Study2023 IEEE 11th International Conference on Serious Games and Applications for Health (SeGAH)10.1109/SeGAH57547.2023.10253792(1-6)Online publication date: 28-Aug-2023
https://doi.org/10.1109/SeGAH57547.2023.10253792
Bossavit BArnedillo-Sánchez I(2023)Motion-based technology to support motor skills screening in developing childrenComputer Methods and Programs in Biomedicine10.1016/j.cmpb.2023.107715240:COnline publication date: 1-Oct-2023
https://dl.acm.org/doi/10.1016/j.cmpb.2023.107715
Miri PArora MMalhotra AFlory RHu SLowber AGoyal INguyen JHegarty JKohn MSchneider DCulbertson HYamins DFung LHardan AGross JMarzullo K(2022)FAR: End-to-End Vibrotactile Distributed System Designed to Facilitate Affect Regulation in Children Diagnosed with Autism Spectrum Disorder Through Slow BreathingProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3517619(1-20)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3517619
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Figures

Tables

Media

View Issue’s Table of Contents