skip to main content
10.1145/3610661.3616239acmconferencesArticle/Chapter ViewAbstractPublication Pagesicmi-mlmiConference Proceedingsconference-collections
research-article

The AI4Autism Project: A Multimodal and Interdisciplinary Approach to Autism Diagnosis and Stratification

Authors Info & Claims
Published:09 October 2023Publication History

ABSTRACT

Nowadays, 1 in 36 children is diagnosed with autism spectrum disorder (ASD) according to the Centers for Disease Control and Prevention (CDC) [52], which makes this condition one of the most prevalent neurodevelopmental disorders. For children on the autism spectrum who face substantial developmental delays, the trajectory of their cognitive growth can be markedly improved by interventions if the condition is identified early. Therefore, there is a critical need for more scalable screening and diagnostic tools, as well as the need to improve phenotyping to refine estimates of ASD symptoms in children. Here, we introduce AI4Autism: a 4-year project funded by the Swiss National Science Foundation, which aims to address the needs outlined above. In this project, we examine the potential of digital sensing to provide automated measures of the extended autism phenotype. This is accomplished using multimodal techniques based on computer vision and Internet of Things sensing, for the purpose of stratifying autism subtypes in ways that would allow for precision medicine. We present an overview of our main results so far, introducing datasets and annotations that we intend to make publicly available, as well as methods and algorithms for analyzing children’s behaviors and producing an ASD diagnosis.

References

  1. DS American Psychiatric Association, American Psychiatric Association, 2013. Diagnostic and statistical manual of mental disorders: DSM-5. Vol. 5. American psychiatric association Washington, DC.Google ScholarGoogle Scholar
  2. Salvatore Maria Anzalone, Jean Xavier, Sofiane Boucenna, Lucia Billeci, Antonio Narzisi, Filippo Muratori, David Cohen, and Mohamed Chetouani. 2019. Quantifying patterns of joint attention during human-robot interactions: An application for autism spectrum disorder assessment. Pattern Recognition Letters 118 (2019), 42–50.Google ScholarGoogle ScholarCross RefCross Ref
  3. Chongyang Bai, Srijan Kumar, Jure Leskovec, Miriam Metzger, Jay Nunamaker, and V. S. Subrahmanian. 2019. Predicting the Visual Focus of Attention in Multi-Person Discussion Videos. In Proceedings of the International Joint Conference on Artificial Intelligence. International Joint Conferences on Artificial Intelligence Organization, 4504–4510.Google ScholarGoogle ScholarCross RefCross Ref
  4. Jun Bao, Buyu Liu, and Jun Yu. 2022. ESCNet: Gaze Target Detection With the Understanding of 3D Scenes. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 14126–14135.Google ScholarGoogle ScholarCross RefCross Ref
  5. Emma Baumgartner. 2002. Il gioco dei bambini. Carocci.Google ScholarGoogle Scholar
  6. David Q. Beversdorf and Missouri Autism Summit Consortium*. 2016. Phenotyping, Etiological Factors, and Biomarkers: Toward Precision Medicine in Autism Spectrum Disorders. Journal of Developmental & Behavioral Pediatrics 37, 8 (Oct. 2016), 659–673. https://doi.org/10.1097/DBP.0000000000000351Google ScholarGoogle ScholarCross RefCross Ref
  7. David Q Beversdorf and Missouri Autism Summit Consortium. 2016. Phenotyping, etiological factors, and biomarkers: toward precision medicine in autism spectrum disorders. Journal of Developmental and Behavioral Pediatrics 37, 8 (2016), 659.Google ScholarGoogle ScholarCross RefCross Ref
  8. Erik Billing, Tony Belpaeme, Haibin Cai, Hoang-Long Cao, Anamaria Ciocan, Cristina Costescu, Daniel David, Robert Homewood, Daniel Hernandez Garcia, Pablo Gómez Esteban, 2020. The DREAM Dataset: Supporting a data-driven study of autism spectrum disorder and robot enhanced therapy. PloS one 15, 8 (2020), e0236939.Google ScholarGoogle ScholarCross RefCross Ref
  9. Niko Bonomi and Michela Papandrea. 2021. Non-intrusive and Privacy Preserving Activity Recognition System for Infants Exploiting Smart Toys. In EAI International Conference on IoT Technologies for HealthCare. Springer, 3–18.Google ScholarGoogle Scholar
  10. Sarabeth Broder-Fingert, Emily Feinberg, and Michael Silverstein. 2018. Improving Screening for Autism Spectrum Disorder: Is It Time for Something New?Pediatrics 141, 6 (June 2018). https://doi.org/10.1542/peds.2018-0965 Publisher: American Academy of Pediatrics Section: Commentary.Google ScholarGoogle ScholarCross RefCross Ref
  11. Ian Budman, Gal Meiri, Michal Ilan, Michal Faroy, Allison Langer, Doron Reboh, Analya Michaelovski, Hagit Flusser, Idan Menashe, Opher Donchin, 2019. Quantifying the social symptoms of autism using motion capture. Scientific Reports 9, 1 (2019), 7712.Google ScholarGoogle ScholarCross RefCross Ref
  12. Giorgio Cantarini, Federico Figari Tomenotti, Nicoletta Noceti, and Francesca Odone. 2022. HHP-Net: A light Heteroscedastic neural network for Head Pose estimation with uncertainty. In Proceedings of the IEEE/CVF Winter Conference on applications of computer vision. 3521–3530.Google ScholarGoogle ScholarCross RefCross Ref
  13. Zhe Cao, Gines Hidalgo, Tomas Simon, Shih-En Wei, and Yaser Sheikh. 2019. OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields. arXiv:1812.08008 [cs] (May 2019). http://arxiv.org/abs/1812.08008 arXiv:1812.08008.Google ScholarGoogle Scholar
  14. Kimberly LH Carpenter, Jordan Hahemi, Kathleen Campbell, Steven J Lippmann, Jeffrey P Baker, Helen L Egger, Steven Espinosa, Saritha Vermeer, Guillermo Sapiro, and Geraldine Dawson. 2021. Digital behavioral phenotyping detects atypical pattern of facial expression in toddlers with autism. Autism Research 14, 3 (2021), 488–499.Google ScholarGoogle ScholarCross RefCross Ref
  15. Eunji Chong, Katha Chanda, Zhefan Ye, Audrey Southerland, Nataniel Ruiz, Rebecca M. Jones, Agata Rozga, and James M. Rehg. 2017. Detecting Gaze Towards Eyes in Natural Social Interactions and Its Use in Child Assessment. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 3 (2017), 1–20. https://doi.org/10.1145/3131902 arxiv:arXiv:1902.00607v1Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Eunji Chong, Katha Chanda, Zhefan Ye, Audrey Southerland, Nataniel Ruiz, Rebecca M Jones, Agata Rozga, and James M Rehg. 2017. Detecting gaze towards eyes in natural social interactions and its use in child assessment. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 3 (2017), 1–20.Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Eunji Chong, Nataniel Ruiz, Yongxin Wang, Yun Zhang, Agata Rozga, and James M Rehg. 2018. Connecting gaze, scene, and attention: Generalized attention estimation via joint modeling of gaze and scene saliency. In Proceedings of the European conference on computer vision (ECCV). 383–398.Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Eunji Chong, Audrey Southerland, Abhijit Kundu, Rebecca M Jones, Agata Rozga, and James M Rehg. 2017. Visual 3d tracking of child-adult social interactions. In 2017 Joint IEEE International Conference on Development and Learning and Epigenetic Robotics (ICDL-EpiRob). IEEE, 399–406.Google ScholarGoogle ScholarCross RefCross Ref
  19. Eunji Chong, Yongxin Wang, Nataniel Ruiz, and James M Rehg. 2020. Detecting Attended Visual Targets in Video. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 5396–5406.Google ScholarGoogle ScholarCross RefCross Ref
  20. National Research Council 2011. Toward precision medicine: building a knowledge network for biomedical research and a new taxonomy of disease. (2011).Google ScholarGoogle Scholar
  21. Geraldine Dawson and Guillermo Sapiro. 2019. Potential for Digital Behavioral Measurement Tools to Transform the Detection and Diagnosis of Autism Spectrum Disorder. JAMA pediatrics 173, 4 (2019), 305–306. https://doi.org/10.1001/jamapediatrics.2018.5269Google ScholarGoogle ScholarCross RefCross Ref
  22. Cathryn M Delude. 2015. Deep phenotyping: the details of disease. Nature 527, 7576 (2015), S14–S15.Google ScholarGoogle Scholar
  23. Mieke Dereu, Petra Warreyn, Ruth Raymaekers, Mieke Meirsschaut, Griet Pattyn, Inge Schietecatte, and Herbert Roeyers. 2010. Screening for Autism Spectrum Disorders in Flemish Day-Care Centres with the Checklist for Early Signs of Developmental Disorders. Journal of Autism and Developmental Disorders 40, 10 (Oct. 2010), 1247–1258. https://doi.org/10.1007/s10803-010-0984-0Google ScholarGoogle ScholarCross RefCross Ref
  24. Bardia Doosti, Ching-Hui Chen, Raviteja Vemulapalli, Xuhui Jia, Yukun Zhu, and Bradley Green. 2021. Boosting Image-based Mutual Gaze Detection using Pseudo 3D Gaze. Proceedings of the AAAI Conference on Artificial Intelligence 35, 2 (May 2021), 1273–1281. https://doi.org/10.1609/aaai.v35i2.16215Google ScholarGoogle ScholarCross RefCross Ref
  25. Susan Dosreis, Courtney L. Weiner, Lakeshia Johnson, and Craig J. Newschaffer. 2006. Autism spectrum disorder screening and management practices among general pediatric providers. Journal of developmental and behavioral pediatrics: JDBP 27, 2 Suppl (April 2006), S88–94. https://doi.org/10.1097/00004703-200604002-00006Google ScholarGoogle ScholarCross RefCross Ref
  26. Amy N. Esler, Vanessa Hus Bal, Whitney Guthrie, Amy Wetherby, Susan Ellis Weismer, and Catherine Lord. 2015. The Autism Diagnostic Observation Schedule, Toddler Module: Standardized Severity Scores. Journal of Autism and Developmental Disorders 45, 9 (2015), 2704–2720. https://doi.org/10.1007/s10803-015-2432-7 Publisher: Springer US ISBN: 0162-3257.Google ScholarGoogle ScholarCross RefCross Ref
  27. Annette Estes, Jeffrey Munson, Sally J Rogers, Jessica Greenson, Jamie Winter, and Geraldine Dawson. 2015. Long-term outcomes of early intervention in 6-year-old children with autism spectrum disorder. Journal of the American Academy of Child & Adolescent Psychiatry 54, 7 (2015), 580–587.Google ScholarGoogle ScholarCross RefCross Ref
  28. Lifeng Fan, Yixin Chen, Ping Wei, Wenguan Wang, and Song-Chun Zhu. 2018. Inferring shared attention in social scene videos. In Proceedings of the IEEE conference on computer vision and pattern recognition. 6460–6468.Google ScholarGoogle ScholarCross RefCross Ref
  29. Yi Fang, Jiapeng Tang, Wang Shen, Wei Shen, Xiao Gu, Li Song, and Guangtao Zhai. 2021. Dual Attention Guided Gaze Target Detection in the Wild. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 11390–11399.Google ScholarGoogle ScholarCross RefCross Ref
  30. Francesca D Faraci, Michela Papandrea, Alessandro Puiatti, Stefania Agustoni, Sara Giulivi, Vincenzo D’Apuzzo, Silvia Giordano, Flavio Righi, Olmo Barberis, Evelyne Thommen, 2018. AutoPlay: a smart toys-kit for an objective analysis of children ludic behavior and development. In 2018 IEEE International Symposium on Medical Measurements and Applications (MeMeA). IEEE, 1–6.Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Martina Franchini, Daniela Zöller, Edouard Gentaz, Bronwyn Glaser, Hilary Wood de Wilde, Nada Kojovic, Stephan Eliez, and Marie Schaer. 2018. Early adaptive functioning trajectories in preschoolers with autism spectrum disorders. Journal of pediatric psychology 43, 7 (2018), 800–813.Google ScholarGoogle ScholarCross RefCross Ref
  32. Olivier Friard and Marco Gamba. 2016. BORIS: a free, versatile open-source event-logging software for video/audio coding and live observations. Methods in ecology and evolution 7, 11 (2016), 1325–1330.Google ScholarGoogle Scholar
  33. K. Funes, L. Nguyen, D. Gatica-Perez, and J.-M. Odobez. 2013. A Semi-Automated System for Accurate Gaze Coding in Natural Dyadic Interactions. In Proc. Int. Conf. on Multimodal Interfaces (ICMI), Sydney.Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. K. Funes and J.-M Odobez. 2016. Gaze Estimation in the 3D Space Using RGB-D sensors: Towards Head-Pose And User Invariance. Int. Journal of Computer Vision 118, 2 (june 2016), 194–216.Google ScholarGoogle Scholar
  35. Rebecca Grzadzinski, Themba Carr, Costanza Colombi, Kelly McGuire, Sarah Dufek, Andrew Pickles, and Catherine Lord. 2016. Measuring Changes in Social Communication Behaviors: Preliminary Development of the Brief Observation of Social Communication Change (BOSCC). Journal of Autism and Developmental Disorders 46, 7 (July 2016), 2464–2479. https://doi.org/10.1007/s10803-016-2782-9Google ScholarGoogle ScholarCross RefCross Ref
  36. Jian Guan, Liming Yin, Jianguo Sun, Shuhan Qi, Xuan Wang, and Qing Liao. 2020. Enhanced gaze following via object detection and human pose estimation. In International Conference on Multimedia Modeling. Springer, 502–513.Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. Hang Guo, Zhengxi Hu, and Jingtai Liu. 2022. MGTR: End-to-End Mutual Gaze Detection with Transformer. In Proceedings of the Asian Conference on Computer Vision. 1590–1605.Google ScholarGoogle Scholar
  38. Anshul Gupta, Samy Tafasca, and Jean-Marc Odobez. 2022. A Modular Multimodal Architecture for Gaze Target Prediction: Application to Privacy-Sensitive Settings. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops. 5041–5050.Google ScholarGoogle ScholarCross RefCross Ref
  39. Jordan Hashemi, Geraldine Dawson, Kimberly LH Carpenter, Kathleen Campbell, Qiang Qiu, Steven Espinosa, Samuel Marsan, Jeffrey P Baker, Helen L Egger, and Guillermo Sapiro. 2018. Computer vision analysis for quantification of autism risk behaviors. IEEE Transactions on Affective Computing 12, 1 (2018), 215–226.Google ScholarGoogle ScholarCross RefCross Ref
  40. Angie WS Ip, Lonnie Zwaigenbaum, David Nicholas, and Raphael Sharon. 2015. Factors influencing autism spectrum disorder screening by community paediatricians. Paediatrics & Child Health 20, 5 (June 2015), e20–e24. https://doi.org/10.1093/pch/20.5.e20 Publisher: Oxford Academic.Google ScholarGoogle ScholarCross RefCross Ref
  41. Yvette M. Janvier, Jill F. Harris, Caroline N. Coffield, Barbara Louis, Ming Xie, Zuleyha Cidav, and David S. Mandell. 2016. Screening for autism spectrum disorder in underserved communities: Early childcare providers as reporters. Autism: The International Journal of Research and Practice 20, 3 (April 2016), 364–373. https://doi.org/10.1177/1362361315585055Google ScholarGoogle ScholarCross RefCross Ref
  42. Tianlei Jin, Zheyuan Lin, Shiqiang Zhu, Wen Wang, and Shunda Hu. 2021. Multi-person gaze-following with numerical coordinate regression. In 2021 16th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2021). IEEE, 01–08.Google ScholarGoogle ScholarDigital LibraryDigital Library
  43. Ami Klin. 2008. In the eye of the beholden: tracking developmental psychopathology. Journal of the American Academy of Child & Adolescent Psychiatry 47, 4 (2008), 362–363.Google ScholarGoogle ScholarCross RefCross Ref
  44. Ami Klin, David J Lin, Phillip Gorrindo, Gordon Ramsay, and Warren Jones. 2009. Two-year-olds with autism orient to non-social contingencies rather than biological motion. Nature 459, 7244 (2009), 257–261.Google ScholarGoogle Scholar
  45. Nada Kojovic, Shreyasvi Natraj, Sharada Prasanna Mohanty, Thomas Maillart, and Marie Schaer. 2021. Using 2D video-based pose estimation for automated prediction of autism spectrum disorders in young children. Scientific Reports 11, 1 (2021), 15069.Google ScholarGoogle ScholarCross RefCross Ref
  46. Kenneth Larsen, Astrid Aasland, and Trond H. Diseth. 2018. Identification of Symptoms of Autism Spectrum Disorders in the Second Year of Life at Day-Care Centres by Day-Care Staff: Step One in the Development of a Short Observation List. Journal of Autism and Developmental Disorders 48, 7 (July 2018), 2267–2277. https://doi.org/10.1007/s10803-018-3489-xGoogle ScholarGoogle ScholarCross RefCross Ref
  47. Kenza Latreche, Nada Kojovic, Martina Franchini, and Marie Schaer. 2021. Attention to face as a predictor of developmental change and treatment outcome in young children with autism spectrum disorder. Biomedicines 9, 8 (2021), 942.Google ScholarGoogle ScholarCross RefCross Ref
  48. Dongze Lian, Zehao Yu, and Shenghua Gao. 2018. Believe It or Not, We Know What You Are Looking At!. In Asian Conference on Computer Vision. Springer, 35–50.Google ScholarGoogle Scholar
  49. Gang Liu, Yu Yu, Kenneth Alberto Funes Mora, and Jean-Marc Odobez. 2018. A Differential Approach for Gaze Estimation with Calibration. In British Machine Vision Conference 2018, BMVC 2018.Google ScholarGoogle Scholar
  50. Catherine Lord, Pamela C DiLavore, Katherine Gotham, Whitney Guthrie, Rhiannon J Luyster, Susan Risi, Michael Rutter, and Western Psychological Services (Firm). 2012. Autism diagnostic observation schedule: ADOS-2. Western Psychological Services, Los Angeles, Calif.OCLC: 851410387.Google ScholarGoogle Scholar
  51. C. Lord, S. Risi, L. Lambrecht, E. H. Cook, B. L. Leventhal, P. C. DiLavore, A. Pickles, and M. Rutter. 2000. The autism diagnostic observation schedule-generic: a standard measure of social and communication deficits associated with the spectrum of autism. Journal of Autism and Developmental Disorders 30, 3 (June 2000), 205–223.Google ScholarGoogle ScholarCross RefCross Ref
  52. Mathew Maenner and et al.2023. Prevalence and Characteristics of Autism Spectrum Disorder Among Children Aged 8 Years - Autism and Developmental Disabilities Monitoring Network, 11 Sites, United States, 2020. Morbidity and mortality weekly report. CDC surveillance summaries / Centers for Disease Control 72, 2 (2023).Google ScholarGoogle Scholar
  53. Manuel J. Marin-Jimenez, Vicky Kalogeiton, Pablo Medina-Suarez, and Andrew Zisserman. 2019. LAEO-Net: Revisiting People Looking at Each Other in Videos. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).Google ScholarGoogle ScholarCross RefCross Ref
  54. Manuel J. Marin-Jimenez, Vicky Kalogeiton, Pablo Medina-Suarez, and Andrew Zisserman. 2021. LAEO-Net++: revisiting people Looking At Each Other in videos. IEEE Transactions on Pattern Analysis and Machine Intelligence (2021). https://doi.org/10.1109/TPAMI.2020.3048482Google ScholarGoogle ScholarCross RefCross Ref
  55. Manuel Jesús Marin-Jimenez, Andrew Zisserman, Marcin Eichner, and Vittorio Ferrari. 2014. Detecting people looking at each other in videos. International Journal of Computer Vision 106 (2014), 282–296.Google ScholarGoogle ScholarDigital LibraryDigital Library
  56. Shelley Mulligan and Barbara Prudhomme White. 2012. Sensory and motor behaviors of infant siblings of children with and without autism. The American Journal of Occupational Therapy 66, 5 (2012), 556–566.Google ScholarGoogle ScholarCross RefCross Ref
  57. Zhixiong Nan, Jingjing Jiang, Xiaofeng Gao, Sanping Zhou, Weiliang Zuo, Ping Wei, and Nanning Zheng. 2021. Predicting Task-Driven Attention via Integrating Bottom-Up Stimulus and Top-Down Guidance. IEEE Transactions on Image Processing 30 (2021), 8293–8305.Google ScholarGoogle ScholarCross RefCross Ref
  58. Basilio Noris, Jacqueline Nadel, Mandy Barker, Nouchine Hadjikhani, and Aude Billard. 2012. Investigating gaze of children with ASD in naturalistic settings. (2012).Google ScholarGoogle Scholar
  59. Alyssa J. Orinstein, Molly Helt, Eva Troyb, Katherine E. Tyson, Marianne L. Barton, Inge-Marie Eigsti, Letitia Naigles, and Deborah A. Fein. 2014. Intervention for optimal outcome in children and adolescents with a history of autism. Journal of developmental and behavioral pediatrics: JDBP 35, 4 (May 2014), 247–256. https://doi.org/10.1097/DBP.0000000000000037Google ScholarGoogle ScholarCross RefCross Ref
  60. Kazuhiro Otsuka, Keisuke Kasuga, and Martina Kohler. 2018. Estimating visual focus of attention in multiparty meetings using deep convolutional neural networks. In Proceedings of the 20th ACM International Conference on Multimodal Interaction. 191–199.Google ScholarGoogle ScholarDigital LibraryDigital Library
  61. Jools Page, Cathy Nutbrown, and Ann Clare. 2013. Working with babies and children: From birth to three. Sage.Google ScholarGoogle Scholar
  62. Shalini Pandurangan, Michela Papandrea, and Mirko Gelsomini. 2022. Fine-Grained Human Activity Recognition-A new paradigm. In Proceedings of the 7th International Workshop on Sensor-based Activity Recognition and Artificial Intelligence. 1–8.Google ScholarGoogle ScholarDigital LibraryDigital Library
  63. Nikolay Patakin, Anna Vorontsova, Mikhail Artemyev, and Anton Konushin. 2022. Single-Stage 3D Geometry-Preserving Depth Estimation Model Training on Dataset Mixtures With Uncalibrated Stereo Data. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 1705–1714.Google ScholarGoogle ScholarCross RefCross Ref
  64. Adrienne Perry, Julie Koudys, Alice Prichard, and Hilda Ho. 2019. Follow-up study of youth who received EIBI as young children. Behavior Modification 43, 2 (2019), 181–201.Google ScholarGoogle ScholarCross RefCross Ref
  65. Rosalind W Picard. 2009. Future affective technology for autism and emotion communication. Philosophical Transactions of the Royal Society B: Biological Sciences 364, 1535 (2009), 3575–3584.Google ScholarGoogle ScholarCross RefCross Ref
  66. H Kathleen Pierce. 2009. Exploratory, functional, and symbolic play behaviors of toddlers with autism spectrum disorders. The Florida State University.Google ScholarGoogle Scholar
  67. Karen Pierce, David Conant, Roxana Hazin, Richard Stoner, and Jamie Desmond. 2011. Preference for geometric patterns early in life as a risk factor for autism. Archives of general psychiatry 68, 1 (2011), 101–109.Google ScholarGoogle Scholar
  68. Irène Pittet, Nada Kojovic, Martina Franchini, and Marie Schaer. 2022. Trajectories of imitation skills in preschoolers with autism spectrum disorders. Journal of Neurodevelopmental Disorders 14 (2022), 1–13.Google ScholarGoogle ScholarCross RefCross Ref
  69. Shyam Rajagopalan, Abhinav Dhall, and Roland Goecke. 2013. Self-stimulatory behaviours in the wild for autism diagnosis. In Proceedings of the IEEE International Conference on Computer Vision Workshops. 755–761.Google ScholarGoogle ScholarDigital LibraryDigital Library
  70. René Ranftl, Katrin Lasinger, David Hafner, Konrad Schindler, and Vladlen Koltun. 2020. Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfer. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) (2020).Google ScholarGoogle Scholar
  71. Adria Recasens, Carl Vondrick, Aditya Khosla, and Antonio Torralba. 2017. Following gaze in video. In Proceedings of the IEEE International Conference on Computer Vision. 1435–1443.Google ScholarGoogle ScholarCross RefCross Ref
  72. James Rehg, Gregory Abowd, Agata Rozga, Mario Romero, Mark Clements, Stan Sclaroff, Irfan Essa, O Ousley, Yin Li, Chanho Kim, 2013. Decoding children’s social behavior. In Proceedings of the IEEE conference on computer vision and pattern recognition. 3414–3421.Google ScholarGoogle ScholarDigital LibraryDigital Library
  73. Katherine Rice, Jennifer M Moriuchi, Warren Jones, and Ami Klin. 2012. Parsing heterogeneity in autism spectrum disorders: visual scanning of dynamic social scenes in school-aged children. Journal of the American Academy of Child & Adolescent Psychiatry 51, 3 (2012), 238–248.Google ScholarGoogle ScholarCross RefCross Ref
  74. Omar Rihawi, Djamal Merad, and Jean-Luc Damoiseaux. 2017. 3D-AD: 3D-autism dataset for repetitive behaviours with kinect sensor. In 2017 14th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS). IEEE, 1–6.Google ScholarGoogle ScholarCross RefCross Ref
  75. Guillermo Sapiro, Jordan Hashemi, and Geraldine Dawson. 2019. Computer vision and behavioral phenotyping: an autism case study. Current Opinion in Biomedical Engineering 9 (2019), 14–20. https://doi.org/10.1016/j.cobme.2018.12.002Google ScholarGoogle ScholarCross RefCross Ref
  76. Samira Sheikhi and Jean-Marc Odobez. 2015. Combining dynamic head pose–gaze mapping with the robot conversational state for attention recognition in human–robot interactions. Pattern Recognition Letters 66 (2015), 81–90.Google ScholarGoogle ScholarDigital LibraryDigital Library
  77. Dean P. Smith, Diane W. Hayward, Catherine M. Gale, Svein Eikeseth, and Lars Klintwall. 2019. Treatment Gains from Early and Intensive Behavioral Intervention (EIBI) are Maintained 10 Years Later. Behavior Modification (Oct. 2019), 145445519882895. https://doi.org/10.1177/0145445519882895Google ScholarGoogle ScholarCross RefCross Ref
  78. Dean P Smith, Diane W Hayward, Catherine M Gale, Svein Eikeseth, and Lars Klintwall. 2021. Treatment gains from early and intensive behavioral intervention (EIBI) are maintained 10 years later. Behavior modification 45, 4 (2021), 581–601.Google ScholarGoogle Scholar
  79. Omer Sumer, Peter Gerjets, Ulrich Trautwein, and Enkelejda Kasneci. 2020. Attention flow: End-to-end joint attention estimation. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision. 3327–3336.Google ScholarGoogle ScholarCross RefCross Ref
  80. Satoshi Suzuki, Yukie Amemiya, and Maiko Sato. 2019. Enhancement of gross-motor action recognition for children by CNN with OpenPose. In IECON 2019-45th Annual Conference of the IEEE Industrial Electronics Society, Vol. 1. IEEE, 5382–5387.Google ScholarGoogle ScholarDigital LibraryDigital Library
  81. Samy Tafasca, Anshul Gupta, and Jean-Marc Odobez. 2023. ChildPlay: A New Benchmark for Understanding Children’s Gaze Behaviour. In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV).Google ScholarGoogle Scholar
  82. Cora M. Taylor, Alison Vehorn, Hylan Noble, Amy S. Weitlauf, and Zachary E. Warren. 2014. Brief Report: Can Metrics of Reporting Bias Enhance Early Autism Screening Measures?Journal of Autism and Developmental Disorders 44, 9 (Sept. 2014), 2375–2380. https://doi.org/10.1007/s10803-014-2099-5Google ScholarGoogle ScholarCross RefCross Ref
  83. Danyang Tu, Xiongkuo Min, Huiyu Duan, Guodong Guo, Guangtao Zhai, and Wei Shen. 2022. End-to-end human-gaze-target detection with transformers. In 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, 2192–2200.Google ScholarGoogle ScholarCross RefCross Ref
  84. Giacomo Vivanti, Margot Prior, Katrina Williams, and Cheryl Dissanayake. 2014. Predictors of outcomes in autism early intervention: why don’t we know more?Frontiers in pediatrics 2 (2014), 58.Google ScholarGoogle Scholar
  85. Zachary Warren, Melissa L McPheeters, Nila Sathe, Jennifer H Foss-Feig, Allison Glasser, and Jeremy Veenstra-VanderWeele. 2011. A systematic review of early intensive intervention for autism spectrum disorders. Pediatrics 127, 5 (2011), e1303–e1311.Google ScholarGoogle ScholarCross RefCross Ref
  86. Peter Washington, Catalin Voss, Aaron Kline, Nick Haber, Jena Daniels, Azar Fazel, Titas De, Carl Feinstein, Terry Winograd, and Dennis Wall. 2017. SuperpowerGlass: a wearable aid for the at-home therapy of children with autism. Proceedings of the ACM on interactive, mobile, wearable and ubiquitous technologies 1, 3 (2017), 1–22.Google ScholarGoogle ScholarDigital LibraryDigital Library
  87. Chunhua Weng, Nigam H Shah, and George Hripcsak. 2020. Deep phenotyping: embracing complexity and temporality—towards scalability, portability, and interoperability. Journal of biomedical informatics 105 (2020), 103433.Google ScholarGoogle ScholarCross RefCross Ref
  88. Wei Yin, Xinlong Wang, Chunhua Shen, Yifan Liu, Zhi Tian, Songcen Xu, Changming Sun, and Dou Renyin. 2020. Diversedepth: Affine-invariant depth prediction using diverse data. arXiv preprint arXiv:2002.00569 (2020).Google ScholarGoogle Scholar
  89. Dajie Zhang, Iris Krieber-Tomantschger, Luise Poustka, Herbert Roeyers, Jeff Sigafoos, Sven Bölte, Peter B. Marschik, and Christa Einspieler. 2019. Identifying Atypical Development: A Role of Day-Care Workers?Journal of Autism and Developmental Disorders 49, 9 (Sept. 2019), 3685–3694. https://doi.org/10.1007/s10803-019-04056-3Google ScholarGoogle ScholarCross RefCross Ref
  90. Hao Zhao, Ming Lu, Anbang Yao, Yurong Chen, and Li Zhang. 2020. Learning to draw sight lines. International Journal of Computer Vision 128, 5 (2020), 1076–1100.Google ScholarGoogle ScholarDigital LibraryDigital Library
  91. Andrea Zunino, Pietro Morerio, Andrea Cavallo, Caterina Ansuini, and Jessica Podda. 2018. Video Gesture Analysis for Autism Spectrum Disorder Detection. In ICPR.Google ScholarGoogle Scholar
  92. Andrea Zunino, Pietro Morerio, Andrea Cavallo, Caterina Ansuini, Jessica Podda, Francesca Battaglia, Edvige Veneselli, Cristina Becchio, and Vittorio Murino. 2018. Video gesture analysis for autism spectrum disorder detection. In 2018 24th international conference on pattern recognition (ICPR). IEEE, 3421–3426.Google ScholarGoogle ScholarCross RefCross Ref
  93. Lonnie Zwaigenbaum, Margaret L. Bauman, Roula Choueiri, Connie Kasari, Alice Carter, Doreen Granpeesheh, Zoe Mailloux, Susanne Smith Roley, Sheldon Wagner, Deborah Fein, Karen Pierce, Timothy Buie, Patricia A. Davis, Craig Newschaffer, Diana Robins, Amy Wetherby, Wendy L. Stone, Nurit Yirmiya, Annette Estes, Robin L. Hansen, James C. McPartland, and Marvin R. Natowicz. 2015. Early Intervention for Children With Autism Spectrum Disorder Under 3 Years of Age: Recommendations for Practice and Research. Pediatrics 136, Supplement 1 (Oct. 2015), S60–S81. https://doi.org/10.1542/peds.2014-3667EGoogle ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. The AI4Autism Project: A Multimodal and Interdisciplinary Approach to Autism Diagnosis and Stratification
      Index terms have been assigned to the content through auto-classification.

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Conferences
        ICMI '23 Companion: Companion Publication of the 25th International Conference on Multimodal Interaction
        October 2023
        434 pages
        ISBN:9798400703218
        DOI:10.1145/3610661

        Copyright © 2023 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 9 October 2023

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article
        • Research
        • Refereed limited

        Acceptance Rates

        Overall Acceptance Rate453of1,080submissions,42%

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      HTML Format

      View this article in HTML Format .

      View HTML Format