skip to main content
10.1145/3371382.3378390acmconferencesArticle/Chapter ViewAbstractPublication PageshriConference Proceedingsconference-collections
abstract

Automatic Engagement Recognition of Children within Robot-Mediated Autism Therapy

Published:01 April 2020Publication History

ABSTRACT

This paper describes a work in progress that aims to design automatic engagement recognition of Robot-Mediated Therapy (RMT) tailored for children with a diverse form of Autism Spectrum Disorder (ASD) in co-occurrence with Attention Deficit Hyperactivity Disorder (ADHD) or Delayed Speech Development (DSD). To this end, we utilized videos obtained from RMT sessions of 36 children aged 4-12 years old. The videos were pre-processed to be used for machine learning approaches. Also, by using the OpenPose tool the datapoints of the facial features and body joints were extracted. Based on these results, automatic engagement recognition model is going to be designed.

References

  1. leubayev, B., Zhexenova, Z., Zhakenova, A., & Sandygulova, A. (2019, March). Robot-Assisted Therapy for Children with ADHD and ASD: a Pilot Study. In Proceedings of the 2019 2nd International Conference on Service Robotics Technologies (pp. 58--62). ACM.Google ScholarGoogle Scholar
  2. hanatkyzy, A., Turarova, A., Telisheva, Z., Abylkasymova, G., & Sandygulova, A. (2019, October). Robot-Assisted Therapy for Children with Delayed Speech Development: a Pilot Study. In 2019 28th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN) (pp. 1--5). IEEE.Chicago.Google ScholarGoogle Scholar
  3. gnjen (Oggi) Rudovic, Jaeryoung Lee, Lea Mascarell-Maricic, Björn W. Schuller and Rosalind W. Picard. Measuring Engagement in Robot-Assisted Autism Therapy: A Cross-Cultural Study, Front. Robot. AI, 4, 36 (July, 2017). doi: 10.3389/frobt.2017.00036Google ScholarGoogle ScholarCross RefCross Ref
  4. ai, H., Fang, Y., Ju, Z., Costescu, C., David, D., Billing, E., ... & Vernon, D. (2018). Sensing-enhanced therapy system for assessing children with autism spectrum disorders: a feasibility study. IEEE Sensors Journal, 19(4), 1508--1518.Google ScholarGoogle Scholar
  5. subalew T, Bekele, Uttama Lahiri, Amy R. Swanson, Julie A. Crittendon, Zachary E. Warren, and Nilanjan Sakar. 2013. A Step Towards Developing Adaptive Robot-Mediated Intervention Architecture (ARIA) for Children With Autism, IEEE Transactions on Neural Systems and Rehabilitation Engineering, 21, 2 (March, 2013). doi: 0.1109/TNSRE.2012.2230188Google ScholarGoogle ScholarCross RefCross Ref
  6. eb Keen. 2012. Engagement of Children With Autism in Learning, Australasian Journal of Special Education, 33, 2 (March, 2012). https://doi.org/10.1375/ajse.33.2.130Google ScholarGoogle Scholar
  7. andygulova, Anara, Zhanel Zhexenova, Bolat Tleubayev, Aidana Nurakhmetova, Dana Zhumabekova, Ilyas Assylgali, Yerzhan Rzagaliyev, and Aliya Zhakenova. "Interaction design and methodology of robot-assisted therapy for children with severe ASD and ADHD." Paladyn, Journal of Behavioral Robotics 10, no. 1 (2019): 330--345.Google ScholarGoogle Scholar
  8. hansaule Telisheva, Aizada Turarova, Aida Zhanatkyzy, Galiya Abylkasymova, and Anara Sandygulova. (2019) Robot-Assisted Therapy for the Severe Form of Autism: Challenges and Recommendations. In: Salichs M. et al. (eds) Social Robotics. ICSR 2019. Lecture Notes in Computer Science, vol 11876. Springer, Cham. https://doi.org/10.1007/978--3-030--35888--4_44Google ScholarGoogle Scholar
  9. he Cao, Tomas Simon, Shih-En Wei, Yaser Sheikh. 2017. Realtime multi-person 2d pose estimation using part affinity fields. The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), (July, 2017), 8 pages.Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. Automatic Engagement Recognition of Children within Robot-Mediated Autism Therapy

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in
        • Published in

          cover image ACM Conferences
          HRI '20: Companion of the 2020 ACM/IEEE International Conference on Human-Robot Interaction
          March 2020
          702 pages
          ISBN:9781450370578
          DOI:10.1145/3371382

          Copyright © 2020 Owner/Author

          Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 1 April 2020

          Check for updates

          Qualifiers

          • abstract

          Acceptance Rates

          Overall Acceptance Rate192of519submissions,37%

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader