Skip to main content
Springer Nature Link
Log in

A multilayered framework for diagnosis and classification of Alzheimer's disease using transfer learned Alexnet and LSTM

  • Original Article
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

Alzheimer's disease (AD) is the most frequent type of dementia that has no effective cure, except early discovery and treatment that may help patients to include successful years in patient’s lives. Currently, mini-mental state examination (MMSE) score and manual examination of magnetic resource imaging (MRI) scan along with machine learning techniques are used to diagnose the disease; however, they possess certain accuracy limits. Therefore, this paper proposes a deep learning-based multilayered framework for AD classification using transfer learned Alexnet and LSTM for multiclass and binary classification of MR images. However, the deep learning models used in the current study necessitate a large training dataset to produce better outcomes. As a result, this work also utilizes generative adversarial network (GAN) as a data augmentation tool to improve the classification results and further to solve the problem of overfitting. The study uses Alzheimer’s disease neuroimaging initiative (ADNI) dataset of 60 AD, 73 mild cognitive impairment (MCI) and 67 cognitively normal (CN) patients from which 2 D MR image scans are extracted. Furthermore, the proposed method achieved the classification accuracy on AD–CN at 98.13%, AD–MCI at 99.38% and CN–MCI at 99.37%, respectively. Also, the multiclass classification shows the promising accuracy of 96.83% for the proposed framework. Finally, the proposed model's performance is compared to other state-of-the-art techniques and the experimental results show that the proposed model outperforms in terms of accuracy, sensitivity and hypothesis testing.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

Data availability statement

The data used to support the findings of the study are made available on Alzheimer's Disease Neuroimaging Initiative (ADNI) at http://adni.loni.usc.edu/about/.

References

  1. Singh SP, Wang L, Gupta S, Goli H, Padmanabhan P, Gulyás B (2020) 3D Deep learning on medical images: a review. Sensors 20(18):5097

    PubMed  PubMed Central  ADS  Google Scholar 

  2. Jo T, Nho K, Saykin AJ (2019) Deep learning in Alzheimer’s disease: diagnostic classification and prognostic prediction using neuroimaging data. Front Aging Neurosci 11:220

    PubMed  PubMed Central  Google Scholar 

  3. Cilia ND, D’Alessandro T, De Stefano C et al (2022) Deep transfer learning algorithms applied to synthetic drawing images as a tool for supporting Alzheimer’s disease prediction. Mach Vis Appl 33:49

    Google Scholar 

  4. Wen J, Thibeau-Sutre E, Diaz-Melo M, Samper-Gonzalez J, Routlier A, Bottani S, Initiative ADN (2020) Convolutional neural networks for classification of Alzheimer’s disease: overview and reproducible evaluation. Med Image Anal 63:101694

    PubMed  Google Scholar 

  5. Altinkaya E, Polat K, Barakli B (2020) Detection of Alzheimer’s disease and dementia states based on deep learning from MRI images: a comprehensive review. J Inst Electron Comp 1(1):39–53

    Google Scholar 

  6. Physicians PC (2020) Alzheimer’s disease facts and figures. Alzheimer’s Dementia 16(3):391–460

    Google Scholar 

  7. Yang Y, Li X, Wang P, Xia Y, Ye Q (2020) Multi-Source transfer learning via ensemble approach for initial diagnosis of Alzheimer’s disease. IEEE J Transl Eng Health Med 8:1–10

    Google Scholar 

  8. Wang X, Zhen X, Li Q, Shen D, Huang H (2018) Cognitive assessment prediction in Alzheimer’s disease by multi-layer multi-target regression. Neuroinformatics 16(3–4):285–294

    PubMed  PubMed Central  Google Scholar 

  9. Nanni L, Brahnam S, Salvatore C, Castiglioni I, Initiative ADN (2019) Texture descriptors and voxels for the early diagnosis of Alzheimer’s disease. Artif Intell Med 97:19–26

    PubMed  Google Scholar 

  10. Adelina C (2019) The costs of Dementia: advocacy, media, and stigma. Alzheimer's Dis Int World Alzheimer Rep., pp 100–1.

  11. Pulido MLB, Hernández JBA, Ballester MAF, González CMT, Mekyska J, Smékal Z (2020) Alzheimer’s disease and automatic speech analysis: a review. Expert Syst Appl 150:113213

    Google Scholar 

  12. Irankhah E (2020) Evaluation of early detection methods for Alzheimer’s disease. Bioprocess Eng 4(1):17–22

    Google Scholar 

  13. He Y et al (2007) Regional coherence changes in the early stages of Alzheimer’s disease: a combined structural and resting-state functional MRI study. Neuroimage 35(2):488–500

    PubMed  Google Scholar 

  14. Vemuri P, Jones DT, Jack CR (2012) Resting-state functional MRI in Alzheimer’s disease. Alzheimer’s Res Therapy 4(1):1–9

    Google Scholar 

  15. Bron EE, Smits M, Van Der Flier WM, Vrenken H, Barkhof F, Scheltens P, Initiative ADN (2015) Standardized evaluation of algorithms for computer-aided diagnosis of Dementia based on structural MRI: the CAD Dementia challenge. Neuroimage 111:562–579

    PubMed  Google Scholar 

  16. Allioui H, Sadgal M, Elfazziki A (2020) Utilization of a convolutional method for Alzheimer disease diagnosis. Mach Vis Appl 31:25

    Google Scholar 

  17. Segato A, Marzullo A, Calimeri F, De Momi E (2020) Artificial intelligence for brain diseases: a systematic review. APL Bioeng 4(4):041503

    PubMed  PubMed Central  Google Scholar 

  18. Yamanakkanavar N, Choi JY, Lee B (2020) MRI segmentation and classification of the human brain using deep learning for diagnosis of Alzheimer’s disease: a survey. Sensors (Switzerland) 20(11):1–31

    Google Scholar 

  19. Noor MBT, Zenia NZ, Kaiser MS, Al Mamun S, Mahmud M (2020) Application of deep learning in detecting neurological disorders from magnetic resonance images: a survey on the detection of Alzheimer’s disease. Parkinson’s disease, and schizophrenia. Brain Informatics 7(1):11

    PubMed  PubMed Central  Google Scholar 

  20. Li F, Tran L, Thung K-H, Ji S, Shen D, Li J (2015) A robust deep model for improved classification of AD/MCI patients. IEEE J Biomed Heal informatics 19(5):1610–1616

    Google Scholar 

  21. Voulodimos A, Doulamis N, Doulamis A, Protopapadakis E. (2018) Deep learning for computer vision: a brief review. Computational Intell Neurosci, pp 1–13.

  22. Goyal P., Rani R., & Singh K. (2021) State-of-the-art machine learning techniques for diagnosis of Alzheimer's disease from MR-images: a systematic review. Arch Comput Methods Eng, 1–44.

  23. Maqsood M, Nazir F, Khan U, Aadil F, Jamal H, Mehmood I, Song OY (2019) Transfer learning assisted classification and detection of Alzheimer’s disease stages using 3D MRI scans. Sensors 19(11):2645

    PubMed  PubMed Central  ADS  Google Scholar 

  24. Yan B, Li Y, Li L, Yang X, Li TQ, Yang G, Jiang M (2022) Quantifying the impact of pyramid squeeze attention mechanism and filtering approaches on Alzheimer’s disease classification. Comput Biol Med 148:105944

    CAS  PubMed  Google Scholar 

  25. Zhu J, Tan Y, Lin R et al (2022) Efficient self-attention mechanism and structural distilling model for Alzheimer’s disease diagnosis. Comput Biol Med 147:105737

    PubMed  Google Scholar 

  26. Li J, Wei Y, Wang C, Hu Q, Liu Y, Xu L (2022) 3-D CNN-based multichannel contrastive learning for Alzheimer’s disease automatic diagnosis. IEEE Trans Instrum Meas 71:1–11

    Google Scholar 

  27. Divya R, Shantha Selva Kumari R, Alzheimer’s Disease Neuroimaging Initiative (2021) Genetic algorithm with logistic regression feature selection for Alzheimer’s disease classification. Neural Comput Appl 33(14):8435–8444

    Google Scholar 

  28. Kang W, Lin L, Zhang B, Shen X, Wu S, Initiative ADN (2021) Multi-model and multi-slice ensemble learning architecture based on 2D convolutional neural networks for Alzheimer’s disease diagnosis. Comput Biol Med 136:104678

    PubMed  Google Scholar 

  29. Feng J, Zhang SW, Chen L, Xia J, Alzheimer’s Disease Neuroimaging Initiative (2021) Alzheimer’s disease classification using features extracted from nonsubsampled contourlet subband-based individual networks. Neurocomputing 421:260–272

    Google Scholar 

  30. Jain R, Jain N, Aggarwal A, Hemanth DJ (2019) Convolutional neural network-based Alzheimer’s disease classification from magnetic resonance brain images. Cogn Syst Res 57:147–159

    Google Scholar 

  31. Basheera S, Ram MS (2019) Convolution neural network-based Alzheimer’s disease classification using hybrid enhanced independent component analysis based segmented gray matter of T2 weighted magnetic resonance imaging with clinical valuation. Alzheimer’s Dementia: Transl Res Clin Intervent 5(1):974–986

    Google Scholar 

  32. Choi H, Jin KH (2018) Predicting cognitive decline with deep learning of brain metabolism and Amyloid imaging. Behav Brain Res 344:103–109

    CAS  PubMed  Google Scholar 

  33. Liu M, Cheng D, Wang K, Wang Y (2018) Multi-modality cascaded convolutional neural networks for Alzheimer's disease diagnosis. Neuroinformatics, pp 1–14.

  34. Shi J, Zheng X, Li Y, Zhang Q, Ying S (2018) Multimodal neuroimaging feature learning with multimodal stacked deep polynomial networks for diagnosis of Alzheimer’s disease. IEEE J Biomed Health Inform 22(1):173–183

    PubMed  Google Scholar 

  35. Korolev S, Safiullin A, Belyaev M, Dodonova Y (2017) Residual and plain convolutional neural networks for 3d brain MRI classification. In: IEEE 14th International Symposium Biomedical Imaging, pp 835–838.

  36. Liu M, Zhang D, Adeli E, Shen D (2016) Inherent structure-based Multiview learning with multi-template feature representation for Alzheimer’s disease diagnosis. IEEE Trans Biomed Eng 63(7):1473–1482

    PubMed  ADS  Google Scholar 

  37. Zu C, Jie B, Liu M, Chen S, Shen D, Zhang D, the ADNI (2016) Label-aligned multitask feature learning for multimodal classification of Alzheimer’s disease and mild cognitive impairment. Brain Imaging Behavior 10(4):1148–1159

    PubMed  Google Scholar 

  38. Ortiz A, Munilla J, Gorriz JM, Ramirez J (2016) Ensembles of deep learning architectures for the early diagnosis of the Alzheimer’s disease. Int J Neural Syst 26(07):1650025

    PubMed  Google Scholar 

  39. Li F, Tran L, Thung K-H, Ji S, Shen D, Li J (2015) A robust deep model for improved classification of AD/MCI patients. IEEE J Biomed Health Inform 19(5):1610–1616

    PubMed  PubMed Central  Google Scholar 

  40. Liu S, Liu S, Cai W, Che H, Pujol S, Kikinis R, Feng D, Fulham MJ (2015) Multimodal neuroimaging feature learning for multiclass diagnosis of Alzheimer’s disease. IEEE Trans Biomed Eng 62(4):1132–1140

    PubMed  Google Scholar 

  41. Payan A., Montana G (2015) Predicting Alzheimer's disease: a neuroimaging study with 3D convolutional neural networks, arXiv Prepr. arxiv.org/abs/1502.02506.

  42. Suk H-I, Shen D (2013) Deep learning-based feature representation for AD/MCI classification. In: International conference on medical image computing and computer-assisted intervention, pp 583–590.

  43. Suk HI, Lee SW, Shen D, ADNI (2015) Deep sparse multitask learning for feature selection in Alzheimer’s disease diagnosis. Brain Struct Funct 221:1–19

    Google Scholar 

  44. Zhu X, Suk H-I, Shen D (2014) A novel matrix-similarity based loss function for joint regression and classification in AD diagnosis. Neuroimage 100:91–105

    PubMed  Google Scholar 

  45. Suk H-I, Lee S-W, Shen D, ADNI (2014) Hierarchical feature representation and multimodal fusion with deep learning for AD/MCI diagnosis. Neuroimage 101:569–582

    PubMed  Google Scholar 

  46. Ebrahimighahnavieh MA, Luo S, Chiong R (2020) Deep learning to detect Alzheimer’s disease from neuroimaging: a systematic literature review. Comput Methods Programs Biomed 187:105242

    PubMed  Google Scholar 

  47. Yamashita R, Nishio M (2018) Convolutional neural networks: an overview and application in radiology. Insights Imaging 9:611–629

    PubMed  PubMed Central  Google Scholar 

  48. Shams S, Platania R et al (2018) Deep generative breast cancer screening and diagnosis. Springer Nature, Berlin

    Google Scholar 

  49. Wang D, Lu Z et al (2019) Cellular structure image classification with small targeted training samples. IEEE Access 7:148967–148974

    PubMed  PubMed Central  Google Scholar 

  50. Weng Y, Zhou H (2019) Data augmentation computing model based on generative adversarial network. IEEE Access.

  51. Kokil P, Sudharson S (2019) Automatic detection of renal abnormalities by Off-the-shelf CNN features. IETE J Educ 60:14–23

    Google Scholar 

  52. Saranyaraj D, Manikandan M, Maheswari S (2018) A deep convolutional neural network for the early detection of breast carcinoma concerning hyperparameter tuning. Multimedia Tools Appl 79(15):11013–11038

    Google Scholar 

  53. Talo M, Baloglu UV, Yıldırım O, Acharya UR (2018) Application of deep transfer learning for automated brain abnormality classification using MR Images. Cogn Syst Res 54:176–188

    Google Scholar 

  54. Kaur T, Gandhi TK (2020) Deep convolutional neural networks with transfer learning for automated brain image classification. Mach Vis Appl 31(3):1–16

    Google Scholar 

  55. Wang SH, Xie S et al (2019) Alcoholism identification based on an AlexNet transfer learning model. Front Psych 10:205

    ADS  Google Scholar 

  56. Sakr GE, Mokbel M et al (2016) Comparing deep learning and support vector machines for autonomous waste sorting. In: IEEE international multidisciplinary conference on engineering technology, pp 207–212.

  57. Deng J, Dong W et al (2009) Imagenet: A large-scale hierarchical image database. In 2009 IEEE conference on computer vision and pattern recognition, pp 248–255.

  58. Shin HC, Roth HR et al (2016) Deep convolutional neural networks for computer-aided detection: CNN architectures, dataset characteristics and transfer learning. IEEE Trans Med Imaging 35(5):1285–1298

    PubMed  Google Scholar 

  59. Loddo A, Buttau S, Ruberto CD (2022) Deep learning based pipelines for Alzheimer’s disease diagnosis: a comparative study and a novel deep-ensemble method. Comput Biol Med 141:105032

    PubMed  Google Scholar 

  60. Mateen M, Wen J, Song S, Huang Z (2018) Fundus image classification using VGG-19 architecture with PCA and SVD. Symmetry 11(1):1

    ADS  Google Scholar 

  61. Ghaffari H, Tavakoli H, Pirzad Jahromi G (2022) Deep transfer learning–based fully automated detection and classification of Alzheimer’s disease on brain MRI. Brit J Radiol, 20211253.

  62. Foody GM (2004) Supervised image classification by MLP and RBF neural networks with and without an exhaustively defined set of classes. Int J Remote Sens 25(15):3091–3104

    Google Scholar 

  63. Lai Z, Deng H (2018) Medical image classification based on deep features extracted by deep model and statistic feature fusion with multilayer perceptron. Comput Intell Neurosci 2018:2061516

    Google Scholar 

  64. Naeem H, Bin-Salem AA (2021) A CNN-LSTM network with multi-level feature extraction-based approach for automated detection of coronavirus from CT scan and X-ray images. Appl Soft Comput 113:107918

    PubMed  PubMed Central  Google Scholar 

  65. Liu T, Bao J, Wang J, Zhang Y (2018) A hybrid CNN–LSTM algorithm for online defect recognition of CO2 welding. Sensors 18(12):4369

    PubMed  PubMed Central  ADS  Google Scholar 

  66. Tsironi E, Barros P, Weber C, Wermter S (2017) An analysis of convolutional long short-term memory recurrent neural networks for gesture recognition. Neurocomputing 268:76–86

    Google Scholar 

  67. Oehmcke S, Zielinski O, Kramer O (2018) Input quality aware convolutional LSTM networks for virtual marine sensors. Neurocomputing 275:2603–2615

    Google Scholar 

  68. Zhao R, Yan R, Wang J, Mao K (2017) Learning to monitor machine health with convolutional bi-directional LSTM networks. Sensors 17(2):273

    PubMed  PubMed Central  ADS  Google Scholar 

  69. Nunez JC, Cabido R, Pantrigo JJ, Montemayor AS, Velez JF (2018) Convolutional neural networks and long short-term memory for skeleton-based human activity and hand gesture recognition. Pattern Recogn 76:80–94

    ADS  Google Scholar 

  70. Isaac ER (2015) Test of hypothesis-concise formula summary. Anna University, Tamil Nadu, pp 1–5

    Google Scholar 

Download references

Acknowledgements

The authors express their gratitude to the Alzheimer's Disease Neuroimaging Initiative (ADNI) for providing the standardized MR Images Dataset.

Author information

Authors and Affiliations

  1. Department of Computer Science and Engineering, Thapar Institute of Engineering and Technology, Patiala, Punjab, 147001, India

    Palak Goyal, Rinkle Rani & Karamjeet Singh

Authors
  1. Palak Goyal
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Rinkle Rani
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. Karamjeet Singh
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Palak Goyal.

Ethics declarations

Conflict of interest

The authors declare no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Goyal, P., Rani, R. & Singh, K. A multilayered framework for diagnosis and classification of Alzheimer's disease using transfer learned Alexnet and LSTM. Neural Comput & Applic 36, 3777–3801 (2024). https://doi.org/10.1007/s00521-023-09301-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-023-09301-6

Keywords