Abstract
Neurodevelopment is exceptionally dynamic and critical during infancy, as many neurodevelopmental disorders emerge from abnormal brain development during this stage. Obtaining a full trajectory of neurodevelopment from existing incomplete longitudinal data can enrich our limited understanding of normal early brain development and help identify neurodevelopmental disorders. Although many regression models and deep learning methods have been proposed for longitudinal prediction based on incomplete datasets, they have two major drawbacks. First, regression models suffered from the strict requirements of input and output time points, which is less useful in practical scenarios. Second, although existing deep learning methods could predict cortical development at multiple ages, they predicted missing data independently with each available scan, yielding inconsistent predictions for a target time point given multiple inputs, which ignores longitudinal dependencies and introduces ambiguity in practical applications. To this end, we emphasize temporal consistency and develop a novel, flexible framework named longitudinally consistent triplet disentanglement autoencoder to predict an individualized longitudinal cortical developmental trajectory based on each available input by encouraging the similarity among trajectories with a dynamic time-warping loss. Specifically, to achieve individualized prediction, we employ a surfaced-based autoencoder, which decomposes the encoded latent features into identity-related and age-related features with an age estimation task and identity similarity loss as supervisions. These identity-related features are further combined with age conditions in the latent space to generate longitudinal developmental trajectories with the decoder. Experiments on predicting longitudinal infant cortical property maps validate the superior longitudinal consistency and exactness of our results compared to baselines’.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Adeli, E., Meng, Y., Li, G., Lin, W., Shen, D.: Joint sparse and low-rank regularized multi-task multi-linear regression for prediction of infant brain development with incomplete data. In: International Conference on Medical Image Computing and Computer-Assisted Intervention. pp. 40–48. Springer (2017)
Adeli, E., Meng, Y., Li, G., Lin, W., Shen, D.: Multi-task prediction of infant cognitive scores from longitudinal incomplete neuroimaging data. NeuroImage 185, 783–792 (2019)
Bass, C., da Silva, M., Sudre, C., Tudosiu, P.D., Smith, S., Robinson, E.: Icam: interpretable classification via disentangled representations and feature attribution mapping. Advances in Neural Information Processing Systems 33, 7697–7709 (2020)
Cheng, J., Zhang, X., Ni, H., Li, C., Xu, X., Wu, Z., Wang, L., Lin, W., Li, G.: Path signature neural network of cortical features for prediction of infant cognitive scores. IEEE Transactions on Medical Imaging 41(7), 1665–1676 (2022)
Cheng, J., Zhang, X., Zhao, F., Wu, Z., Yuan, X., Wang, L., Lin, W., Li, G.: Prediction of infant cognitive development with cortical surface-based multimodal learning. In: International Conference on Medical Image Computing and Computer-Assisted Intervention. pp. 618–627. Springer (2023)
Cuturi, M., Blondel, M.: Soft-dtw: a differentiable loss function for time-series. In: International Conference on Machine Learning. pp. 894–903. PMLR (2017)
Fawaz, A., Williams, L.Z.J., Dahan, S., Edwards, A.D., Robinson, E.C.: Continuous gcn-gans for modelling neonatal cortical surface development. In: Geometric Deep Learning in Medical Image Analysis (Extended abstracts) (2022)
Fawaz, A., Williams, L.Z., Edwards, A.D., Robinson, E.C.: A deep generative model of neonatal cortical surface development. In: Annual Conference on Medical Image Understanding and Analysis. pp. 469–481. Springer (2022)
Fischl, B.: Freesurfer. Neuroimage 62(2), 774–781 (2012)
Hong, Y., Kim, J., Chen, G., Lin, W., Yap, P.T., Shen, D.: Longitudinal prediction of infant diffusion mri data via graph convolutional adversarial networks. IEEE Transactions on Medical Imaging 38(12), 2717–2725 (2019)
Howell, B.R., Styner, M.A., Gao, W., Yap, P.T., Wang, L., Baluyot, K., Yacoub, E., Chen, G., Potts, T., Salzwedel, A., et al.: The unc/umn baby connectome project (bcp): An overview of the study design and protocol development. NeuroImage 185, 891–905 (2019)
Hu, D., Wang, F., Zhang, H., Wu, Z., Wang, L., Lin, W., Li, G., Shen, D., Consortium, U.B.C.P.: Disentangled intensive triplet autoencoder for infant functional connectome fingerprinting. In: Medical Image Computing and Computer Assisted Intervention–MICCAI 2020: 23rd International Conference, Lima, Peru, October 4–8, 2020, Proceedings, Part VII 23. pp. 72–82. Springer (2020)
Hu, D., Zhang, H., Wu, Z., Wang, F., Wang, L., Smith, J.K., Lin, W., Li, G., Shen, D.: Disentangled-multimodal adversarial autoencoder: Application to infant age prediction with incomplete multimodal neuroimages. IEEE Transactions on Medical Imaging 39(12), 4137–4149 (2020)
Huang, Z., Zhang, J., Shan, H.: When age-invariant face recognition meets face age synthesis: A multi-task learning framework and a new benchmark. IEEE Transactions on Pattern Analysis and Machine Intelligence 45(6), 7917–7932 (2023)
Meng, Y., Li, G., Rekik, I., Zhang, H., Gao, Y., Lin, W., Shen, D.: Can we predict subject-specific dynamic cortical thickness maps during infancy from birth? Human Brain Mapping 38(6), 2865–2874 (2017)
Pinaya, W.H., Tudosiu, P.D., Dafflon, J., Da Costa, P.F., Fernandez, V., Nachev, P., Ourselin, S., Cardoso, M.J.: Brain imaging generation with latent diffusion models. In: MICCAI Workshop on Deep Generative Models. pp. 117–126. Springer (2022)
Ravi, D., Alexander, D.C., Oxtoby, N.P., Initiative, A.D.N.: Degenerative adversarial neuroimage nets: generating images that mimic disease progression. In: International Conference on Medical Image Computing and Computer-Assisted Intervention. pp. 164–172. Springer (2019)
Rekik, I., Li, G., Lin, W., Shen, D.: Prediction of longitudinal development of infant cortical surface shape using a 4d current-based learning framework. In: Information Processing in Medical Imaging: 24th International Conference, IPMI 2015, Sabhal Mor Ostaig, Isle of Skye, UK, June 28-July 3, 2015, Proceedings 24. pp. 576–587. Springer (2015)
Tavenard, R., Faouzi, J., Vandewiele, G., Divo, F., Androz, G., Holtz, C., Payne, M., Yurchak, R., Rußwurm, M., Kolar, K., Woods, E.: Tslearn, a machine learning toolkit for time series data. Journal of Machine Learning Research 21(118), 1–6 (2020)
Lee, K.: Soft-dtw-loss. bluehttps://github.com/keonlee9420/Soft-DTW-Loss, (2021)
Wang, L., Wu, Z., Chen, L., Sun, Y., Lin, W., Li, G.: ibeat v2. 0: a multisite-applicable, deep learning-based pipeline for infant cerebral cortical surface reconstruction. Nature Protocols 18(5), 1488–1509 (2023)
Woo, S., Park, J., Lee, J.Y., Kweon, I.S.: Cbam: Convolutional block attention module. In: Proceedings of the European conference on computer vision (ECCV). pp. 3–19 (2018)
Xia, T., Chartsias, A., Tsaftaris, S.A., Initiative, A.D.N.: Consistent brain ageing synthesis. In: Medical Image Computing and Computer Assisted Intervention–MICCAI 2019: 22nd International Conference, Shenzhen, China, October 13–17, 2019, Proceedings, Part IV 22. pp. 750–758. Springer (2019)
Yuan, X., Cheng, J., Zhao, F., Wu, Z., Wang, L., Lin, W., Zhang, Y., Li, G.: Multi-task joint prediction of infant cortical morphological and cognitive development. In: International Conference on Medical Image Computing and Computer-Assisted Intervention. pp. 545–554. Springer (2023)
Zhao, F., Wu, Z., Wang, L., Lin, W., Gilmore, J.H., Xia, S., Shen, D., Li, G.: Spherical deformable u-net: Application to cortical surface parcellation and development prediction. IEEE Transactions on Medical Imaging 40(4), 1217–1228 (2021)
Zhao, F., Xia, S., Wu, Z., Duan, D., Wang, L., Lin, W., Gilmore, J.H., Shen, D., Li, G.: Spherical u-net on cortical surfaces: methods and applications. In: Information Processing in Medical Imaging: 26th International Conference, IPMI 2019, Hong Kong, China, June 2–7, 2019, Proceedings 26. pp. 855–866. Springer (2019)
Zhu, J.Y., Park, T., Isola, P., Efros, A.A.: Unpaired image-to-image translation using cycle-consistent adversarial networks. In: Proceedings of the IEEE International Conference on Computer Vision. pp. 2223–2232 (2017)
Acknowledgments
This work was supported in part by NIH grants (MH116225, MH123202, ES033518, AG075582, NS128534, and NS135574).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Ethics declarations
The authors have no competing interests to declare that are relevant to the content of this article.
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Yuan, X. et al. (2024). Longitudinally Consistent Individualized Prediction of Infant Cortical Morphological Development. In: Linguraru, M.G., et al. Medical Image Computing and Computer Assisted Intervention – MICCAI 2024. MICCAI 2024. Lecture Notes in Computer Science, vol 15005. Springer, Cham. https://doi.org/10.1007/978-3-031-72086-4_42
Download citation
DOI: https://doi.org/10.1007/978-3-031-72086-4_42
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-72085-7
Online ISBN: 978-3-031-72086-4
eBook Packages: Computer ScienceComputer Science (R0)
