Article

Human computer interfaces for autism: assessing the influence of task assignment and output modalities

Authors:

Ouriel Grynszpan,

Jean-Claude Martin,

Jacqueline NadelAuthors Info & Claims

CHI EA '05: CHI '05 Extended Abstracts on Human Factors in Computing Systems

Pages 1419 - 1422

https://doi.org/10.1145/1056808.1056931

Published: 02 April 2005 Publication History

Get Access

Abstract

Several experimental studies have shown the usefulness of computers for autism, but software design remains poorly documented. Our multidisciplinary research focuses on educational HCI for autism. We compared two domains of learning: social dialogue understanding and spatial planning, our hypothesis being that people with autism will be less skilful in the first than in the second domain. Two sets of exercises were designed for each domain: one for training purposes and the other for performance assessment before and after training. We also tested the influence of the following output modalities: text, images, speech synthesis, visual and auditory feedback. Each exercise produced log files informing on duration, number of trials and successes. So far, eight teenagers with autism have completed a 13 week training program with one session a week. First analysis of log files suggests a significant progression in dialogic understanding but not in spatial planning; nor was significant influence of output modalities found.

References

[1]

American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders - Fourth Edition (DSM-IV). American Psychiatric Association, Washington D.C., USA, 1994.

Google Scholar

[2]

Bernard-Opitz, V., Sriram, N. and Nakhoda-Sapuan, S. Enhancing Social Problem Solving in Children with Autism and Normal Children Through Computer-Assisted Instruction. Journal of Autism and Developmental Disorders 31 (4), (2001), 377--384.

Crossref

Google Scholar

[3]

Bosseler, A. and Massaro, D.W. Development and evaluation of a computer-animated tutor for vocabulary and language learning in children with autism. Journal of Autism Developmental Disorders 33 (6), (2003), 653--672, http://mambo.ucsc.edu/pdf/autism.pdf.

Crossref

Google Scholar

[4]

Frith, U. Autism Explaining the Enigma. Basic Blackwell, Oxford, UK, 1989.

Google Scholar

[5]

Howlin, P. Children with Autism and Asperger Syndrome: a guide for practitioners and carers. John Wiley & Sons Ltd, Chichester, UK, 1998.

Google Scholar

[6]

Minshew, N. and Goldstein, G. Autism as a disorder of complex information processing. Mental Retardation and Developmental Disabilities Research Reviews 4 (2), (1998), 129--136.

Crossref

Google Scholar

[7]

Moore, M. and Calvert, S. Brief Report: Vocabulary Acquisition for Children with Autism: Teacher or Computer Instruction. Journal of Autism and Developmental Disorders 30 (4), (2000), 359--362.

Crossref

Google Scholar

[8]

Moore, D.J., McGrath, P. and Thorpe, J. Computer aided learning for people with autism -- a framework for research and development, Innovations on Education and Training International 37 (3), (2000), 218--228.

Crossref

Google Scholar

[9]

Murray, D.K.C. Autism and information technology: therapy with computers. In Autism and Learning, David Fulton Publishers, London, UK, 1997.

Google Scholar

[10]

Panyan, M.V. Computer Technology for Autistic Students. Journal of Autism and Developmental Disorders 14 (4), (1984), 375--382.

Crossref

Google Scholar

[11]

Rajendran, G., and Mitchell, P. Computer mediated interaction in Asperger's syndrome: the Bubble Dialogue program. Computers and Education 35, (2000), 187--207.

Digital Library

Google Scholar

[12]

World Health Organization International Classification of Diseases Tenth Version (ICD-10). World Health Organisation, Geneva, Switzerland, 1992.

Google Scholar

[13]

Tjus, T., Heimann, M. and Lundälv, M. Multimedia Enhancement of Language and Reading Skills, In Proc. of International Congress Autism-Europe, APPDA (2003), 278--280.

Google Scholar

Cited By

View all

Haroon RDogar F(2024)TwIPS: A Large Language Model Powered Texting Application to Simplify Conversational Nuances for Autistic UsersProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3675633(1-18)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3663548.3675633
Zolyomi ASnyder J(2021)Social-Emotional-Sensory Design Map for Affective Computing Informed by Neurodivergent ExperiencesProceedings of the ACM on Human-Computer Interaction10.1145/34491515:CSCW1(1-37)Online publication date: 22-Apr-2021
https://dl.acm.org/doi/10.1145/3449151
Magrini MCurzio OCarboni AMoroni DSalvetti OMelani A(2019)Augmented Interaction Systems for Supporting Autistic Children. Evolution of a Multichannel Expressive Tool: The SEMI Project Feasibility StudyApplied Sciences10.3390/app91530819:15(3081)Online publication date: 31-Jul-2019
https://doi.org/10.3390/app9153081
Show More Cited By

Index Terms

Human computer interfaces for autism: assessing the influence of task assignment and output modalities

Recommendations

Technology-enhanced ABA intervention in children with autism: a pilot study

This study investigates whether ICT technology can enhance applied behavior analysis (ABA) rehabilitation therapy for children with autism. A technology-enhanced rehabilitation system to support the daily work of ABA tutors, parents and teachers was ...
Multimedia interfaces for users with high functioning autism: An empirical investigation

This article focuses on issues relevant to human-computer interaction in the case of autism. We designed training software that target specific communicative disorders attributed to autism and defined an empirical protocol to test this software. The ...
Computer mediated imaginative storytelling in children with autism

The imaginative abilities of children on the autistic spectrum are reportedly impaired compared to typically developing children. This study explored computer mediated story construction in children with autism and typically developing peers. The ...

Comments

Information & Contributors

Information

Published In

CHI EA '05: CHI '05 Extended Abstracts on Human Factors in Computing Systems

April 2005

1358 pages

ISBN:1595930027

DOI:10.1145/1056808

Conference Chair:
Gerrit van der Veer
Vrije Universiteit, The Netherlands
,
Program Chair:
Carolyn Gale
Stanford University, Stanford, CA

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 April 2005

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

CHI05

Sponsor:

CHI05: CHI 2005 Conference on Human Factors in Computing Systems

April 2 - 7, 2005

OR, Portland, USA

Acceptance Rates

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

12
Total Citations
View Citations
1,174
Total Downloads

Downloads (Last 12 months)9
Downloads (Last 6 weeks)1

Reflects downloads up to 03 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Haroon RDogar F(2024)TwIPS: A Large Language Model Powered Texting Application to Simplify Conversational Nuances for Autistic UsersProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3675633(1-18)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3663548.3675633
Zolyomi ASnyder J(2021)Social-Emotional-Sensory Design Map for Affective Computing Informed by Neurodivergent ExperiencesProceedings of the ACM on Human-Computer Interaction10.1145/34491515:CSCW1(1-37)Online publication date: 22-Apr-2021
https://dl.acm.org/doi/10.1145/3449151
Magrini MCurzio OCarboni AMoroni DSalvetti OMelani A(2019)Augmented Interaction Systems for Supporting Autistic Children. Evolution of a Multichannel Expressive Tool: The SEMI Project Feasibility StudyApplied Sciences10.3390/app91530819:15(3081)Online publication date: 31-Jul-2019
https://doi.org/10.3390/app9153081
De Los Rios Perez CMcMeekin DFalkmer MTan T(2018)Adaptable maps for people with autismProceedings of the 15th International Web for All Conference10.1145/3192714.3210349(1-2)Online publication date: 23-Apr-2018
https://dl.acm.org/doi/10.1145/3192714.3210349
De Los Rios Perez C(2018)Adaptable user interfaces for people with autismProceedings of the 15th International Web for All Conference10.1145/3192714.3196318(1-2)Online publication date: 23-Apr-2018
https://dl.acm.org/doi/10.1145/3192714.3196318
Dang TStasak BHuang ZJayawardena SAtcheson MHayat MLe PSethu VGoecke REpps JRingeval FSchuller BValstar MGratch JCowie RPantic M(2017)Investigating Word Affect Features and Fusion of Probabilistic Predictions Incorporating Uncertainty in AVEC 2017Proceedings of the 7th Annual Workshop on Audio/Visual Emotion Challenge10.1145/3133944.3133952(27-35)Online publication date: 23-Oct-2017
https://dl.acm.org/doi/10.1145/3133944.3133952
Tan JDay DWamsley K(2015)Designing an interactive personal assistant web application systemJournal of Computing Sciences in Colleges10.5555/2675327.267534730:3(126-133)Online publication date: 1-Jan-2015
https://dl.acm.org/doi/10.5555/2675327.2675347
Georgescu AKuzmanovic BRoth DBente GVogeley K(2014)The Use of Virtual Characters to Assess and Train Non-Verbal Communication in High-Functioning AutismFrontiers in Human Neuroscience10.3389/fnhum.2014.008078Online publication date: 15-Oct-2014
https://doi.org/10.3389/fnhum.2014.00807
Bauminger-Zviely NEden SZancanaro MWeiss PGal E(2013)Increasing social engagement in children with high-functioning autism spectrum disorder using collaborative technologies in the school environmentAutism10.1177/136236131247298917:3(317-339)Online publication date: 24-Apr-2013
https://doi.org/10.1177/1362361312472989
Konstantinidis EHitoglou-Antoniadou MLuneski ABamidis PNikolaidou M(2009)Using affective avatars and rich multimedia content for education of children with autismProceedings of the 2nd International Conference on PErvasive Technologies Related to Assistive Environments10.1145/1579114.1579172(1-6)Online publication date: 9-Jun-2009
https://dl.acm.org/doi/10.1145/1579114.1579172
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Technology-enhanced ABA intervention in children with autism: a pilot study

Multimedia interfaces for users with high functioning autism: An empirical investigation

Computer mediated imaginative storytelling in children with autism

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Upcoming Conference

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations