Skip to main content

Advertisement

Log in

Comparison of Three Automated Approaches for Classification of Amyloid-PET Images

  • Original Article
  • Published:
Neuroinformatics Aims and scope Submit manuscript

Abstract

Automated amyloid-PET image classification can support clinical assessment and increase diagnostic confidence. Three automated approaches using global cut-points derived from Receiver Operating Characteristic (ROC) analysis, machine learning (ML) algorithms with regional SUVr values, and deep learning (DL) network with 3D image input were compared under various conditions: number of training data, radiotracers, and cohorts. 276 [11C]PiB and 209 [18F]AV45 PET images from ADNI database and our local cohort were used. Global mean and maximum SUVr cut-points were derived using ROC analysis. 68 ML models were built using regional SUVr values and one DL network was trained with classifications of two visual assessments – manufacturer’s recommendations (gray-scale) and with visually guided reference region scaling (rainbow-scale). ML-based classification achieved similarly high accuracy as ROC classification, but had better convergence between training and unseen data, with a smaller number of training data. Naïve Bayes performed the best overall among the 68 ML algorithms. Classification with maximum SUVr cut-points yielded higher accuracy than with mean SUVr cut-points, particularly for cohorts showing more focal uptake. DL networks can support the classification of definite cases accurately but performed poorly for equivocal cases. Rainbow-scale standardized image intensity scaling and improved inter-rater agreement. Gray-scale detects focal accumulation better, thus classifying more amyloid-positive scans. All three approaches generally achieved higher accuracy when trained with rainbow-scale classification. ML yielded similarly high accuracy as ROC, but with better convergence between training and unseen data, and further work may lead to even more accurate ML methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

Availability of Data and Material

The data will not be available as the authors have no permission to share the data.

References

Download references

Acknowledgements

We acknowledge all the coordinators from NUH memory clinic and Memory Aging and Cognition Centre for their contributions in subject recruitment and data acquisition, and the PET radiochemistry team from CIRC for the production of [11C]PiB used in this study. Data collection and sharing for this project was funded by the Alzheimer's Disease Neuroimaging Initiative (ADNI) (National Institutes of Health Grant U01 AG024904) and DOD ADNI (Department of Defense award number W81XWH-12-2-0012). ADNI is funded by the National Institute on Aging, the National Institute of Biomedical Imaging and Bioengineering, and through generous contributions from the following: AbbVie, Alzheimer's Association; Alzheimer's Drug Discovery Foundation; Araclon Biotech; BioClinica, Inc.; Biogen; Bristol-Myers Squibb Company; CereSpir, Inc.; Cogstate; Eisai Inc.; Elan Pharmaceuticals, Inc.; Eli Lilly and Company; EuroImmun; F. Hoffmann-La Roche Ltd and its affiliated company Genentech, Inc.; Fujirebio; GE Healthcare; IXICO Ltd.;Janssen Alzheimer Immunotherapy Research & Development, LLC.; Johnson & Johnson Pharmaceutical Research & Development LLC.; Lumosity; Lundbeck; Merck & Co., Inc.;Meso Scale Diagnostics, LLC.; NeuroRx Research; Neurotrack Technologies; Novartis Pharmaceuticals Corporation; Pfizer Inc.; Piramal Imaging; Servier; Takeda Pharmaceutical Company; and Transition Therapeutics. The Canadian Institutes of Health Research is providing funds to support ADNI clinical sites in Canada. Private sector contributions are facilitated by the Foundation for the National Institutes of Health (www.fnih.org). The grantee organization is the Northern California Institute for Research and Education, and the study is coordinated by the Alzheimer's Therapeutic Research Institute at the University of Southern California. ADNI data are disseminated by the Laboratory for Neuro Imaging at the University of Southern California

Funding

This study was supported by the following National Medical Research Council grant in Singapore: NMRC/CG/NUHS/2010-R-184–005-184–511, NMRC/CG/013/2013, and NMRC/CIRG/1446/2016.

Author information

Authors and Affiliations

Authors

Consortia

Contributions

Ying-Hwey Nai and Anthonin Reilhac designed and supervised the study. Yee-Hsin Tay, Tomotaka Tanaka, Anthonin Reilhac and Ying-Hwey Nai carried out the visual assessments. Yee-Hsin Tay and Ying-Hwey Nai and Anthonin Reilhac analyzed the data and wrote the draft manuscript. Edward G. Robins was responsible for the production and delivery of [11C]PiB used in the study. Christopher P. Chen designed the clinical study and is responsible for clinical data. All authors contributed to the revision of the draft manuscript and approved the final version of the manuscript for submission.

Corresponding author

Correspondence to Ying-Hwey Nai.

Ethics declarations

Informed Consent

Informed consent was obtained from all individual participants included in the study. Patients signed informed consent regarding publishing their data and photographs.

Conflicts of Interest

The authors declare that they have no conflict of interest.

Research Involving Human Participants

All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards. Ethics approval was obtained from the National-Healthcare Group Domain-Specific Review Board in Singapore.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Ying-Hwey Nai and Anthonin Reilhac made an equal contribution to this manuscript.

Alzheimer's Disease Neuroimaging Initiative (ADNI) is a Group/Institutional Author.

Data used in preparation of this article were obtained from the Alzheimer's Disease Neuroimaging Initiative (ADNI) database (adni.loni.usc.edu). As such, the investigators within the ADNI contributed to the design and implementation of ADNI and/or provided data but did not participate in analysis or writing of this report. A complete listing of ADNI investigators can be found at: http://adni.loni.usc.edu/wp-content/uploads/how_to_apply/ADNI_Acknowledgement_List.pdf.

Supplementary Information

Below is the link to the electronic supplementary material.

Supplementary file1 (PDF 1172 KB)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Nai, YH., Tay, YH., Tanaka, T. et al. Comparison of Three Automated Approaches for Classification of Amyloid-PET Images. Neuroinform 20, 1065–1075 (2022). https://doi.org/10.1007/s12021-022-09587-2

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12021-022-09587-2

Keywords

Navigation