Abstract
Autism spectrum disorder (ASD) is a group of complex neurodevelopmental disorders characterized by difficulties with social communication and interaction as well as restrictive interest and stereotyped behavior. Despite the behavioral symptoms of ASD often appear early in infancy, the ASD diagnosis is often cumbersome even for expert clinicians owing to characteristic heterogeneity in the symptoms and severity. Early diagnosis and intervention can help children with ASD to achieve more improvement, particularly in their social communication. Here, the study designs an interactive robotic agent and an intelligent image analysis system to assist in the ASD diagnosis of children. The children’s facial expression images and body pose movement images are collected during the human-robot interaction, which three computational models are used for further data analysis. The stored database is presented as a reference for diagnosis in a visual interface. Furthermore, we incorporate multiple AI models in facial emotion recognition and eye tracking detection to automatically analyze images and visualize data, assisting clinicians in diagnostic decision making.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
American Psychiatric Association and American Psychiatric Association (eds.). Diagnostic and statistical manual of mental disorders: DSM-5, 5th ed. American Psychiatric Association, Washington, D.C (2013)
Lord, C., et al.: Autism spectrum disorder. Nat. Rev. Dis. Primer 6(1), 5 (2020). https://doi.org/10.1038/s41572-019-0138-4
Al-Dewik, N., et al.: Overview and introduction to autism spectrum disorder (ASD). In: Essa, M.M., Qoronfleh, M.W. (eds.) Personalized Food Intervention and Therapy for Autism Spectrum Disorder Management. AN, vol. 24, pp. 3–42. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-30402-7_1
Emanuel, R., Weir, S.: Catalysing communication in an autistic child in a LOGO-like learning environment. In: Proceedings of the 2nd Summer Conference on Artificial Intelligence and Simulation of Behaviour, pp. 118–129 (1976)
Shamsuddin, S., Yussof, H., Ismail, L.I., Mohamed, S., Hanapiah, F.A., Zahari, N.I.: Initial response in HRI- a case study on evaluation of child with autism spectrum disorders interacting with a humanoid robot NAO. Procedia Eng. 41, 1448–1455 (2012). https://doi.org/10.1016/j.proeng.2012.07.334
Silvera-Tawil, D., Bradford, D., Roberts-Yates, C.: Talk to Me: The role of human-robot interaction in improving verbal communication skills in students with autism or intellectual disability. In: 2018 27th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), Nanjing, Aug., pp. 1–6 (2018). https://doi.org/10.1109/ROMAN.2018.8525698
Petric, F., et al.: Four tasks of a robot-assisted autism spectrum disorder diagnostic protocol: first clinical tests. In: IEEE Global Humanitarian Technology Conference (GHTC 2014), pp. 510–517 (2014)
Petric, F., Kovačić, Z.: Hierarchical POMDP framework for a robot-assisted ASD diagnostic protocol. In: 2019 14th ACM/IEEE International Conference on Human-Robot Interaction (HRI), pp. 286–293 (2019)
Moghadas, M., Moradi, H.: Analyzing human-robot interaction using machine vision for autism screening. In: 2018 6th RSI International Conference on Robotics and Mechatronics (IcRoM), Tehran, Iran, Oct., pp. 572–576 (2018). https://doi.org/10.1109/ICRoM.2018.8657569
Javed, H., Park, C.H.: Behavior-based risk detection of autism spectrum disorder through child-robot interaction. In: Companion of the 2020 ACM/IEEE International Conference on Human-Robot Interaction, Cambridge United Kingdom, Mar., pp. 275–277 (2020). https://doi.org/10.1145/3371382.3378382
Pruette, J.R.: Autism diagnostic observation schedule-2 (ADOS-2). Google Sch., pp. 1–3 (2013)
McCrimmon, A., Rostad, K.: Test review: autism diagnostic observation schedule, second edition (ADOS-2) manual (Part II): toddler module. J. Psychoeduc. Assess., 32(1), 88–92 (2014). https://doi.org/10.1177/0734282913490916
Zahara, L., Musa, P., Prasetyo Wibowo, E., Karim, I., Bahri Musa, S.: The facial emotion recognition (FER-2013) dataset for prediction system of micro-expressions face using the convolutional neural network (CNN) algorithm based raspberry Pi. In: 2020 Fifth International Conference on Informatics and Computing (ICIC), pp. 1–9 (2020). https://doi.org/10.1109/ICIC50835.2020.9288560
FER-2013. https://www.kaggle.com/datasets/msambare/fer2013. Accessed 29 June 2022
Florea, L., Florea, C., Vrânceanu, R., Vertan, C.: Can Your Eyes Tell Me How You Think? A Gaze Directed Estimation of the Mental Activity (2013)
Vrânceanu, R., Florea, C., Florea, L., Vertan, C.: NLP EAC recognition by component separation in the eye region. In: International Conference on Computer Analysis of Images and Patterns, pp. 225–232 (2013)
Pedregosa, F., et al.: Scikit-learn: machine learning in python. J. Mach. Learn. Res. 12(85), 2825–2830 (2011)
Cao, Z., Simon, T., Wei, S.-E., Sheikh, Y.: Realtime multi-person 2d pose estimation using part affinity fields. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 7291–7299 (2017)
Cao, Z., Hidalgo, G., Simon, T., Wei, S.-E., Sheikh, Y.: OpenPose: realtime multi-person 2D pose estimation using part affinity fields. IEEE Trans. Pattern Anal. Mach. Intell. 43(1), 172–186 (2019)
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., Fei-Fei, L.: ImageNet: A large-scale hierarchical image database. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition, pp. 248–255 (2009). https://doi.org/10.1109/CVPR.2009.5206848
Acknowledgement
This research was supported by the National Science and Technology Council, Taiwan, under Grant 109-2410-H-197-002-MY3 and 112-2410-H-197-002-MY2.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 Springer Nature Switzerland AG
About this paper
Cite this paper
Lin, SY., Lai, YP., Chiang, HC., Cheng, Y., Chien, SY. (2023). Interactive Robot-Aided Diagnosis System for Children with Autism Spectrum Disorder. In: Nah, F., Siau, K. (eds) HCI in Business, Government and Organizations. HCII 2023. Lecture Notes in Computer Science, vol 14039. Springer, Cham. https://doi.org/10.1007/978-3-031-36049-7_4
Download citation
DOI: https://doi.org/10.1007/978-3-031-36049-7_4
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-36048-0
Online ISBN: 978-3-031-36049-7
eBook Packages: Computer ScienceComputer Science (R0)