Abstract
Cortical thickness (CTh) is an important biomarker commonly used in clinical studies for a range of neurodegenerative and neurological conditions. In such studies, CTh estimation software packages are employed to estimate CTh from T1-weighted (T1-w) brain MRI scans. Since commonly used software packages (e.g. FreeSurfer) are time-consuming, the fast-inference Machine Learning (ML) CTh estimation solutions have gained much popularity. Recently, several ML regression-based solutions offering morphological properties (CTh, volume and curvature) estimation have emerged but typically achieved lower accuracy compared to mainstream alternatives. One of the reasons for such performance of the ML-based CTh estimation models is the inaccurate automatic labels typically used for their training. In this paper, we investigate the impact of automatic labels selection on the performance of the current state-of-the-art ML regression-based CTh estimation method - HerstonNet. We train two models on pairs of brain MRIs and FreeSurfer/DL+DiReCT automatic CTh measurements to investigate the benefits of using DL+DiReCT instead of, the more frequently used, FreeSurfer CTh measurements on the learning capability of a modified version of HerstonNet. Then, we evaluate the performance of the two trained models on three test sets with scans coming from four publicly available datasets. We show that HerstonNet trained on DL+DiReCT labels overall achieves a 13.3% higher Intraclass Correlation Coefficient (ICC) on a test set composed of ADNI and AIBL scans, 19.4% on OASIS-3 and 17.1% on SIMON dataset compared to the same model trained on FreeSurfer derived measurements. The results suggest that DL+DiReCT provides automatic labels more suitable for CTh estimation model training than FreeSurfer.
This work was funded in part through an Australian Department of Industry, Energy and Resources CRC-P project between CSIRO, Maxwell Plus and I-Med Radiology Network.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
Data used in the preparation of this article were obtained from the Alzheimer’s Disease Neuroimaging Initiative (ADNI) database (adni.loni.usc.edu). The ADNI was launched in 2003 as a public-private partnership, led by Principal Investigator Michael W. Weiner, MD. The primary goal of ADNI has been to test whether serial magnetic resonance imaging (MRI), positron emission tomography (PET), other biological markers, and clinical and neuropsychological assessment can be combined to measure the progression of mild cognitive impairment (MCI) and early AD. For up-to-date information, see www.adni-info.org [11, 23].
References
Aganj, I., Sapiro, G., Parikshak, N., Madsen, S.K., Thompson, P.M.: Measurement of cortical thickness from MRI by minimum line integrals on soft-classified tissue. Human Brain Mapp. 30(10), 3188–3199 (2009)
Cicchetti, D.V.: Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychol. Assessm. 6(4), 284 (1994)
Das, S.R., Avants, B.B., Grossman, M., Gee, J.C.: Registration based cortical thickness measurement. Neuroimage 45(3), 867–879 (2009)
Desikan, R.S.,et al.: An automated labeling system for subdividing the human cerebral cortex on MRI scans into Gyral based regions of interest. Neuroimage 31(3), 968–980 (2006)
Duchesne, S., et al.: Structural and functional multi-platform MRI series of a single human volunteer over more than fifteen years. Sci. Data 6(1), 1–9 (2019)
Fischl, B.: Freesurfer. Neuroimage 62(2), 774–781 (2012)
Fischl, B., Dale, A.M.: Measuring the thickness of the human cerebral cortex from magnetic resonance images. Proc. Natl. Acad. Sci. 97(20), 11050–11055 (2000)
Fischl, B., Sereno, M.I., Dale, A.M.: Cortical surface-based analysis: Ii: inflation, flattening, and a surface-based coordinate system. Neuroimage 9(2), 195–207 (1999)
Hutton, C., De Vita, E., Ashburner, J., Deichmann, R., Turner, R.: Voxel-based cortical thickness measurements in MRI. Neuroimage 40(4), 1701–1710 (2008)
Izmailov, P., Podoprikhin, D., Garipov, T., Vetrov, D., Wilson, A.G.: Averaging weights leads to wider optima and better generalization. arXiv preprint arXiv:1803.05407 (2018)
Jack, C.R., Jr., et al.: The Alzheimer’s disease neuroimaging initiative (ADNI): MRI methods. J. Magnet. Resonan. Imag. Off. J. Int. Soc. Magnet. Resonan. Med. 27(4), 685–691 (2008)
Koo, T.K., Li, M.Y.: A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J. Chiropract. Med. 15(2), 155–163 (2016)
LaMontagne, P.J., et al.: Oasis-3: longitudinal neuroimaging, clinical, and cognitive dataset for normal aging and Alzheimer disease. MedRxiv (2019)
Li, Q., Pardoe, H., Lichter, R., Werden, E., Raffelt, A., Cumming, T., Brodtmann, A.: Cortical thickness estimation in longitudinal stroke studies: a comparison of 3 measurement methods. NeuroImage Clin. 8, 526–535 (2015)
Lüsebrink, F., Wollrab, A., Speck, O.: Cortical thickness determination of the human brain using high resolution 3 t and 7 t MRI data. Neuroimage 70, 122–131 (2013)
McKinley, R., et al.: Simultaneous lesion and brain segmentation in multiple sclerosis using deep neural networks. Sci. Rep. 11(1), 1–11 (2021)
Rebsamen, M., Rummel, C., Reyes, M., Wiest, R., McKinley, R.: Direct cortical thickness estimation using deep learning-based anatomy segmentation and cortex parcellation. Human Brain Mapp. 41(17), 4804–4814 (2020)
Rebsamen, M., Suter, Y., Wiest, R., Reyes, M., Rummel, C.: Brain morphometry estimation: from hours to seconds using deep learning. Front. Neurol. 11, 244 (2020)
Rowe, C.C., et al.: Amyloid imaging results from the Australian imaging, biomarkers and lifestyle (AIBL) study of aging. Neurobiol. Aging 31(8), 1275–1283 (2010)
Santa Cruz, R., et al.: Going deeper with brain morphometry using neural networks. In: 2021 IEEE 18th International Symposium on Biomedical Imaging (ISBI), pp. 711–715. IEEE (2021)
Tustison, N.J., et al.: Large-scale evaluation of ants and freesurfer cortical thickness measurements. Neuroimage 99, 166–179 (2014)
Van Leemput, K., Maes, F., Vandermeulen, D., Suetens, P.: Automated model-based bias field correction of MR images of the brain. IEEE Trans. Med. Imaging 18(10), 885–896 (1999)
Weiner, M.W., et al.: The Alzheimer’s disease neuroimaging initiative 3: continued innovation for clinical trial improvement. Alzheimer’s Dementia 13(5), 561–571 (2017)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Rusak, F. et al. (2022). Lesser of Two Evils Improves Learning in the Context of Cortical Thickness Estimation Models - Choose Wisely. In: Nguyen, H.V., Huang, S.X., Xue, Y. (eds) Data Augmentation, Labelling, and Imperfections. DALI 2022. Lecture Notes in Computer Science, vol 13567. Springer, Cham. https://doi.org/10.1007/978-3-031-17027-0_4
Download citation
DOI: https://doi.org/10.1007/978-3-031-17027-0_4
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-17026-3
Online ISBN: 978-3-031-17027-0
eBook Packages: Computer ScienceComputer Science (R0)
