Skip to main content

Vision-Based Pointing Estimation and Evaluation in Toddlers for Autism Screening

  • Conference paper
  • First Online:
Intelligent Robotics and Applications (ICIRA 2021)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 13015))

Included in the following conference series:

Abstract

Early screening of autism spectrum disorder is essential since early intervention can enhance the functional social behavior of autistic children. Among the behavior characteristics of autism, pointing is strongly related to human communicative interaction and cognitive development. To improve the efficiency and accuracy of autism screening, this paper presents a novel vision-based evaluation method for pointing behavior in the screening scenario: expressing needs with pointing (ENP). During the protocol process, a series of features such as hand position, gesture, the pointing direction can be detected, and the pointing behavior can be assessed by the evaluation method. In order to verify the effectiveness of the protocol and evaluation method, 19 toddlers (8 ASD toddlers and 11 non-ASD toddlers) between the ages of 16 and 32 months participate in this study. The accuracy of the automatic evaluation method for pointing behavior is 17/19. It shows that the ENP protocol and the proposed method based on computer vision are feasible in the early screening of autism.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Bailey, A., et al.: A clinicopathological study of autism. Brain J. Neurol. 121(5), 889–905 (1998)

    Article  Google Scholar 

  2. Eikeseth, S.: Outcome of comprehensive psycho-educational interventions for young children with autism. Res. Dev. Disabil. 30(1), 158–178 (2009)

    Article  Google Scholar 

  3. Geschwind, D.H.: Advances in autism. Annu. Rev. Med. 60, 367–380 (2009)

    Article  Google Scholar 

  4. Wang, Z., Liu, J., He, K., Xu, Q., Xu, X., Liu, H.: Screening early children with autism spectrum disorder via response-to-name protocol. IEEE Trans. Industr. Inf. 17, 587–595 (2019)

    Article  Google Scholar 

  5. Liu, J., et al.: Early screening of autism in toddlers via response-to-instructions protocol. IEEE Trans. Cybern. (2020)

    Google Scholar 

  6. Cook, A., Mandal, B., Berry, D., Johnson, M.: Towards automatic screening of typical and atypical behaviors in children with autism. arXiv preprint arXiv:1907.12537 (2019)

  7. Carpenter, M., Pennington, B.F., Rogers, S.J.: Interrelations among social-cognitive skills in young children with autism. J. Autism Dev. Disord. 32(2), 91–106 (2002)

    Article  Google Scholar 

  8. Wang, Z., Xu, K., Liu, H.: Screening early children with autism spectrum disorder via expressing needs with index finger pointing. In: Proceedings of the 13th International Conference on Distributed Smart Cameras, pp. 1–6 (2019)

    Google Scholar 

  9. Redmon, J., Farhadi, A.: Yolov3: an incremental improvement. arXiv preprint arXiv:1804.02767 (2018)

  10. Everingham, M., Van Gool, L., Williams, C.K.I., Winn, J., Zisserman, A.: The PASCAL visual object classes challenge 2007 (VOC 2007) results. http://www.pascal-network.org/challenges/VOC/voc2007/workshop/index.html

  11. Szegedy, C., Ioffe, S., Vanhoucke, V., Alemi, A.A.: Inception-v4, inception-resnet and the impact of residual connections on learning. In: Thirty-First AAAI Conference on Artificial Intelligence (2017)

    Google Scholar 

  12. Cao, Z., Simon, T., Wei, S.-E., Sheikh, Y.: Realtime multi-person 2D pose estimation using part affinity fields. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 7291–7299 (2017)

    Google Scholar 

  13. Krizhevsky, A., Sutskever, I., Hinton, G.E.: ImageNet classification with deep convolutional neural networks. In: Advances in Neural Information Processing Systems, pp. 1097–1105 (2012)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Xiu Xu .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Qin, H. et al. (2021). Vision-Based Pointing Estimation and Evaluation in Toddlers for Autism Screening. In: Liu, XJ., Nie, Z., Yu, J., Xie, F., Song, R. (eds) Intelligent Robotics and Applications. ICIRA 2021. Lecture Notes in Computer Science(), vol 13015. Springer, Cham. https://doi.org/10.1007/978-3-030-89134-3_17

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-89134-3_17

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-89133-6

  • Online ISBN: 978-3-030-89134-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics