skip to main content
10.1145/3649902.3653943acmconferencesArticle/Chapter ViewAbstractPublication PagesetraConference Proceedingsconference-collections
research-article
Open access

Towards More Accurate Help: Informing Teachers how to Support NDD Children by Serious Games and Eye Tracking Technologies

Published: 04 June 2024 Publication History

Abstract

The vision behind this research is to develop a platform that supports children with neurodevelopmental disorders (NDD) in handling their difficulties. This will be done by informing their teachers about each child's NDD specificity, personal ability, and learning progress through standardized tasks that allow tailoring the tasks to personalized requirements. The aim of this work in progress is to 1) examine the role of using eye tracking (ET) technologies to inform teachers to support NDD children through a platform, 2) provide an example for using ET data, and 3) show how ET data can be combined with Serious Games (SG) output in a pipeline. The results show the necessary requirements for the experimental setup with a focus on informing the teachers, the influence of inherent limitations of the participant pool, and illustrate how the ET and SG results can be used to communicate status for sustained attention.

References

[1]
World Health Organization. Global report on children with developmental disabilities: from the margins to the mainstream. 2023.
[2]
World Health Organization. International Classification of Diseases, Eleventh Revision (ICD-11): Neurodevelopmental disorders. 2019/2021.
[3]
Halfon N., Houtrow A., Larson K. and Newacheck P. W. The changing landscape of disability in childhood. The Future of Children, 13-42. 2012.
[4]
Scrivens, C., Logan, J. and Reid, N. Navigating the barriers to supporting neurodevelopmental disorders in children in out-of-home care. Children and Youth Services Review, 153 (2023), 107090.
[5]
Danniels, E. and Pyle, A. Teacher perspectives and approaches toward promoting inclusion in play-based learning for children with developmental disabilities. Journal of Early Childhood Research, 21, 3 (2023), 288-302.
[6]
Valentine, A. Z., Brown, B. J., Groom, M. J., Young, E., Hollis, C. and Hall, C. L. A systematic review evaluating the implementation of technologies to assess, monitor and treat neurodevelopmental disorders: A map of the current evidence. Clinical Psychology Review, 80 (2020/08/01/ 2020), 101870.
[7]
Dawson, C. Neurodiversity is Human Diversity, an Equity Imperative for Education. International Journal for Talent Development and Creativity, 10, 1-2 (2022), 217-229.
[8]
Ciarmoli, D. and Stasolla, F. New Technologies to Support People with Neurodevelopmental Disorders: A Selective Review. OBM Neurobiology, 07, 01 (2023/03/13 2023), 163.
[9]
Chan, A. S., Lee, T.-L., Sze, S. L., Yang, N. S. and Han, Y. M. Eye-tracking training improves the learning and memory of children with learning difficulty. Scientific Reports, 12, 1 (2022), 13974.
[10]
Vacas Ruiz, J. Early Differential Diagnosis in Infant Population with Neurodevelopmental Disorders. Psychophysiological Markers Based on Eye Tracking Methodology (2022).
[11]
Ambati, V. N. P., Reimer, J. F., Escalante, G. and Saucedo, F. Atypical Gaze Behavior in Children with High Functioning Autism During an Active Balance Task. Annals of Applied Sport Science, 11, 2 (2023), 0-0.
[12]
Aminoleslami, S., Maghooli, K., Sammaknejad, N., Haghipour, S. and Sadeghi-Firoozabadi, V. Classification of autistic and normal children using analysis of eye-tracking data from computer games. Signal, Image and Video Processing, 17, 8 (2023/11/01 2023), 4357-4365.
[13]
Finke, E. H., Wilkinson, K. M. and Hickerson, B. D. Social Referencing Gaze Behavior During a Videogame Task: Eye Tracking Evidence from Children With and Without ASD. Journal of Autism and Developmental Disorders, 47, 2 (2017/02/01 2017), 415-423.
[14]
Putra, P. U., Shima, K., Alvarez, S. A. and Shimatani, K. Identifying autism spectrum disorder symptoms using response and gaze behavior during the Go/NoGo game CatChicken. Scientific Reports, 11, 1 (2021/11/10 2021), 22012.
[15]
Arellano, D., Rauh, R., Krautheim, B., Spicker, M., Schaller, U. M., Helzle, V. and Deussen, O. Interactive testbed for research in autism—the SARA project. Universal Access in the Information Society, 17, 1 (2018/03/01 2018), 21-36.
[16]
Amat, A. Z., Zhao, H., Swanson, A., Weitlauf, A. S., Warren, Z. and Sarkar, N. Design of an Interactive Virtual Reality System, InViRS, for Joint Attention Practice in Autistic Children. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 29 (2021), 1866-1876.
[17]
Sosnowski, D. W., Stough, C. O., Weiss, M. J., Cessna, T., Casale, A., Foran, A., Erwinski, M., Wilson, J., Farber, S. A. and Farber, M. A. Brief Report: A Novel Digital Therapeutic that Combines Applied Behavior Analysis with Gaze-Contingent Eye Tracking to Improve Emotion Recognition in Children with Autism Spectrum Disorder. Journal of Autism and Developmental Disorders, 52, 5 (2022/05/01 2022), 2357-2366.
[18]
Delvigne, V., Wannous, H., Dutoit, T., Ris, L. and Vandeborre, J. P. PhyDAA: Physiological Dataset Assessing Attention. IEEE Transactions on Circuits and Systems for Video Technology, 32, 5 (2022), 2612-2623.
[19]
Jangard, S., Lindström, B., Khemiri, L., Pärnamets, P., Jayaram-Lindström, N. and Olsson, A. Alcohol Use Disorder Displays Trait-Related Reductions in Prosocial Decision Making. Biological Psychiatry: Cognitive Neuroscience and Neuroimaging, 7, 9 (2022/09/01/ 2022), 925-934.
[20]
Lee, T. L., Yeung, M. K., Sze, S. L. and Chan, A. S. Computerized Eye-Tracking Training Improves the Saccadic Eye Movements of Children with Attention-Deficit/Hyperactivity Disorder. Brain Sciences, 10, 12 (2020), 1016.
[21]
Vivanti, G., Fanning, P. A. J., Hocking, D. R., Sievers, S. and Dissanayake, C. Social Attention, Joint Attention and Sustained Attention in Autism Spectrum Disorder and Williams Syndrome: Convergences and Divergences. Journal of Autism and Developmental Disorders, 47, 6 (2017/06/01 2017), 1866-1877.
[22]
Alvares, G. A., Chen, N. T. M., Notebaert, L., Granich, J., Mitchell, C. and Whitehouse, A. J. O. Brief social attention bias modification for children with autism spectrum disorder. Autism Research, 12, 3 (2019), 527-535.
[23]
Denham, S. A., Ji, P. and Hamre, B. Compendium of Preschool through Elementary School Social-Emotional Learning and Associated Assessment Measures. Collaborative for Academic, Social, and Emotional Learning (2010).
[24]
Bandeira de Mello, V., Bohrnstedt, G., Blankenship, C. and Sherman, D. Mapping State Proficiency Standards onto NAEP Scales: Results from the 2013 NAEP Reading and Mathematics Assessments. NCES 2015-046. National Center for Education Statistics (2015).
[25]
Preece, D. A., Becerra, R., Robinson, K., Dandy, J. and Allan, A. Measuring emotion regulation ability across negative and positive emotions: The Perth Emotion Regulation Competency Inventory (PERCI). Personality and Individual Differences, 135 (2018/12/01/ 2018), 229-241.
[26]
Posner, M. I. and Petersen, S. E. The attention system of the human brain. Annual review of neuroscience, 13, 1 (1990), 25-42.
[27]
Rosvold, H. E., Mirsky, A. F., Sarason, I., Bransome Jr, E. D. and Beck, L. H. A continuous performance test of brain damage. Journal of consulting psychology, 20, 5 (1956), 343.
[28]
Santhosh, J., Dzsotjan, D. and Ishimaru, S. Multimodal Assessment of Interest Levels in Reading: Integrating Eye-Tracking and Physiological Sensing. IEEE Access, 11 (2023), 93994-94008.
[29]
Marlow, M., Servili, C. and Tomlinson, M. A review of screening tools for the identification of autism spectrum disorders and developmental delay in infants and young children: recommendations for use in low- and middle-income countries. Autism Research, 12, 2 (2019), 176-199.
[30]
Ribas, M. O., Micai, M., Caruso, A., Fulceri, F., Fazio, M. and Scattoni, M. L. Technologies to support the diagnosis and/or treatment of neurodevelopmental disorders: A systematic review. Neuroscience & Biobehavioral Reviews, 145 (2023/02/01/ 2023), 105021.
[31]
Gautam, A. Towards Modern-Age Advanced Sensors for the Management of Neurodegenerative Disorders: Current Status, Challenges and Prospects. ECS Sensors Plus, 1, 4 (2022/10/17 2022), 042401.

Cited By

View all
  • (2025)Gaze Inputs for Targeting: The Eyes Have It, Not With a CursorInternational Journal of Human–Computer Interaction10.1080/10447318.2025.2453966(1-19)Online publication date: 5-Feb-2025
  • (2024)Towards a Supporting Framework for Neuro-Developmental Disorder: Considering Artificial Intelligence, Serious Games and Eye Tracking2024 IEEE International Conference on Big Data (BigData)10.1109/BigData62323.2024.10825158(8238-8240)Online publication date: 15-Dec-2024

Index Terms

  1. Towards More Accurate Help: Informing Teachers how to Support NDD Children by Serious Games and Eye Tracking Technologies

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      ETRA '24: Proceedings of the 2024 Symposium on Eye Tracking Research and Applications
      June 2024
      525 pages
      ISBN:9798400706073
      DOI:10.1145/3649902
      This work is licensed under a Creative Commons Attribution International 4.0 License.

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 04 June 2024

      Check for updates

      Author Tags

      1. eye tracking
      2. neurodevelopmental disorder
      3. serious games
      4. teaching

      Qualifiers

      • Research-article
      • Research
      • Refereed limited

      Funding Sources

      • European Union's Horizon Europe programme

      Conference

      ETRA '24

      Acceptance Rates

      Overall Acceptance Rate 69 of 137 submissions, 50%

      Upcoming Conference

      ETRA '25

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)201
      • Downloads (Last 6 weeks)28
      Reflects downloads up to 14 Feb 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2025)Gaze Inputs for Targeting: The Eyes Have It, Not With a CursorInternational Journal of Human–Computer Interaction10.1080/10447318.2025.2453966(1-19)Online publication date: 5-Feb-2025
      • (2024)Towards a Supporting Framework for Neuro-Developmental Disorder: Considering Artificial Intelligence, Serious Games and Eye Tracking2024 IEEE International Conference on Big Data (BigData)10.1109/BigData62323.2024.10825158(8238-8240)Online publication date: 15-Dec-2024

      View Options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      HTML Format

      View this article in HTML Format.

      HTML Format

      Login options

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media