Skip to main content

Advertisement

SpringerLink
Log in

Deep learning based computer-aided automatic prediction and grading system for diabetic retinopathy

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Diabetic Retinopathy (DR) is a consequence of diabetes mellitus that results in damage to the retina’s blood vessel networks. It is now the major cause of irreversible blindness among diabetics. It is more prevalent in those with a history of diabetes mellitus. A high blood glucose level results in the loss of blood and other fluids from the retina’s blood vessels. The importance of early detection and treatment of this illness cannot be overstated. In medical image processing, reliably detecting diabetic retinopathy from digital fundus pictures is considered an open challenge that requires the exploration of innovative approaches. An automated computerized system accomplishes this goal via a series of processes, including the identification and classification of lesions in fundus images. We are motivated by the researchers who chose to use deep learning for the detection of many diseases, like glaucoma, due to its recent breakthroughs and significant success over typical machine learning techniques in a variety of applications. The goal of this article is to develop reformed networks for detecting and categorizing diabetic retinopathy into five classes. Through this work, three novel Convolutional Neural Networks(CNNs) based on deep learning have been proposed for the prediction of diabetic retinopathy. The first proposed network is built from scratch, the second network is the ensemble of five best-performing networks, and the last one is the Convolutional Neural Network-Long Short Term Memory (CNN-LSTM) model. The performance of three proposed networks is compared with twenty-one well-accepted image nets. The effectiveness of the proposed reformed networks is validated using multiple performance indicators on seven experiments of three Kaggle datasets (separately and in combination of these). The presented work achieves the maximum accuracy of 0.9545 (highest average-wise 0.9368), a maximum F1 score of 0.9685 (highest average-wise 0.9374), the maximum sensitivity of 0.9566 (highest average-wise 0.9420),and a maximum AUC score of 0.9769 (highest average-wise 0.9395). The results of the experiments showed that the provided model outperforms the many current models in terms of classification. So, the results of the calculations show that with the proposed networks, retinal problems in diabetic patients can be effectively found so that they can get a better diagnosis and avoid losing their sight.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

References

  1. Ahmad A, Mansoor AB, Mumtaz R, Khan M, Mirza SH (2014) Image processing and classification in diabetic retinopathy: a review. In: 2014 5th European workshop on visual information processing (EUVIP). IEEE. pp. 1-6

  2. Alyoubi WL, Shalash WM, Abulkhair MF (2020) Diabetic retinopathy detection through deep learning techniques: a review. Inform Med Unlocked 20:100377

    Google Scholar 

  3. Amalia R, Bustamam A, Sarwinda D (2021) Detection and description generation of diabetic retinopathy using convolutional neural network and long short-term memory. J Phys Conf Ser 1722(1):012010 IOP publishing

  4. Atre S (2015) Addressing policy needs for prevention and control of type 2 diabetes in India. Perspect Public Health 135(5):257–263

    Google Scholar 

  5. Atre S (2019) The burden of diabetes in India. Lancet Glob Health 7(4):e418

    Google Scholar 

  6. Ayan E, Karabulut B, Ünver HM (2021) Diagnosis of pediatric pneumonia with Ensemble of Deep Convolutional Neural Networks in chest X-ray images. Arab J Sci Eng:1–17

  7. Bodapati JD, Naralasetti V, Shareef SN, Hakak S, Bilal M, Maddikunta PKR, Jo O (2020) Blended multi-modal deep convnet features for diabetic retinopathy severity prediction. Electronics 9(6):914

    Google Scholar 

  8. Bodapati JD, Shaik NS, Naralasetti V (2021) Composite deep neural network with gated-attention mechanism for diabetic retinopathy severity classification. J Ambient Intell Humaniz Comput 12(10):9825–9839

    Google Scholar 

  9. Butt MM, Latif G, Iskandar DA, Alghazo J, Khan AH (2019) Multi-channel convolutions neural network based diabetic retinopathy detection from fundus images. Procedia Comput Sci 163:283–291

    Google Scholar 

  10. Casanova R, Saldana S, Chew EY, Danis RP, Greven CM, Ambrosius WT (2014) Application of random forests methods to diabetic retinopathy classification analyses. PLoS One 9(6):e98587

    Google Scholar 

  11. Chandrakumar T, Kathirvel RJIJERT (2016) Classifying diabetic retinopathy using deep learning architecture. Int J Eng Res Technol 5(6):19–24

    Google Scholar 

  12. Chang K, Balachandar N, Lam C, Yi D, Brown J, Beers A, Rosen B, Rubin DL, Kalpathy-Cramer J (2018) Distributed deep learning networks among institutions for medical imaging. J Am Med Inform Assoc 25(8):945–954

    Google Scholar 

  13. Chen H, Zeng X, Luo Y, Ye W (2018) Detection of diabetic retinopathy using deep neural network. In: 2018 IEEE 23rd international conference on digital signal processing (DSP). IEEE. pp. 1-5

  14. Colas E, Besse A, Orgogozo A, Schmauch B, Meric N, Besse E (2016) Deep learning approach for diabetic retinopathy screening. Acta Ophthalmol 94

  15. Dal Canto E, Ceriello A, Rydén L, Ferrini M, Hansen TB, Schnell O, Beulens JW (2019) Diabetes as a cardiovascular risk factor: an overview of global trends of macro and micro vascular complications. Eur J Prev Cardiol 26(2_suppl):25–32

  16. Das S, Saha SK (2022) Diabetic retinopathy detection and classification using CNN tuned by genetic algorithm. Multimed Tools Appl 81(6):8007–8020

    Google Scholar 

  17. Das S, Kharbanda K, Suchetha M, Raman R, Dhas E (2021) Deep learning architecture based on segmented fundus image features for classification of diabetic retinopathy. Biomed Signal Process Control 68:102600

    Google Scholar 

  18. Diabetes in India (n.d.) Cadi Research. Retrieved 29 Apr 2021

  19. Dow C, Mancini F, Rajaobelina K, Boutron-Ruault MC, Balkau B, Bonnet F, Fagherazzi G (2018) Diet and risk of diabetic retinopathy: a systematic review. Eur J Epidemiol 33(2):141–156

    Google Scholar 

  20. Dutta S, Manideep BC, Basha SM, Caytiles RD, Iyengar NCSN (2018) Classification of diabetic retinopathy images by using deep learning models. Int J Grid Distrib Comput 11(1):89–106

    Google Scholar 

  21. Esfahani MT, Ghaderi M, Kafiyeh R (2018) Classification of diabetic and normal fundus images using new deep learning method. Leonardo Electron J Pract Technol 17:233–248

    Google Scholar 

  22. Esteva A, Chou K, Yeung S, Naik N, Madani A, Mottaghi A, Liu Y, Topol E, Dean J, Socher R (2021) Deep learning-enabled medical computer vision. NPJ Digital Med 4(1):1–9

    Google Scholar 

  23. Fenner BJ, Wong RL, Lam WC, Tan GS, Cheung G (2018) Advances in retinal imaging and applications in diabetic retinopathy screening: a review. Ophthalmol Therapy 7(2):333–346

    Google Scholar 

  24. García G, Gallardo J, Mauricio A, López J, Carpio CD (2017) Detection of diabetic retinopathy based on a convolutional neural network using retinal fundus images. In: International conference on artificial neural networks. Springer, Cham. pp. 635-642

  25. Gargeya R, Leng T (2017) Automated identification of diabetic retinopathy using deep learning. Ophthalmology 124(7):962–969

    Google Scholar 

  26. Goel N, Kaur S, Gunjan D, Mahapatra SJ (2022) Dilated CNN for abnormality detection in wireless capsule endoscopy images. Soft Comput 26(3):1231–1247

    Google Scholar 

  27. Gondal WM, Köhler JM, Grzeszick R, Fink GA, Hirsch M (2017) Weakly-supervised localization of diabetic retinopathy lesions in retinal fundus images. In: 2017 IEEE international conference on image processing (ICIP). IEEE. pp. 2069-2073

  28. Gräsbeck TC, Gräsbeck SV, Miettinen PJ, Summanen PA (2016) Fundus photography as a screening method for diabetic retinopathy in children with type 1 diabetes: outcome of the initial photography. Am J Ophthalmol 169:227–234

    Google Scholar 

  29. Gulshan V, Peng L, Coram M, Stumpe MC, Wu D, Narayanaswamy A, Venugopalan S, Widner K, Madams T, Cuadros J, Kim R, Raman R, Nelson PC, Mega JL, Webster DR (2016) Development and validation of a deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs. Jama 316(22):2402–2410

    Google Scholar 

  30. Gupta G, Kulasekaran S, Ram K, Joshi N, Sivaprakasam M, Gandhi R (2017) Local characterization of neovascularization and identification of proliferative diabetic retinopathy in retinal fundus images. Comput Med Imaging Graph 55:124–132

    Google Scholar 

  31. Harangi B, Toth J, Baran A, Hajdu A (2019) Automatic screening of fundus images using a combination of convolutional neural network and hand-crafted features. In: 2019 41st annual international conference of the IEEE engineering in medicine and biology society (EMBC). IEEE. pp. 2699-2702

  32. Hemanth DJ, Deperlioglu O, Kose U (2020) An enhanced diabetic retinopathy detection and classification approach using deep convolutional neural network. Neural Comput & Applic 32(3):707–721

    Google Scholar 

  33. Islam MM, Yang HC, Poly TN, Jian WS, Li YCJ (2020) Deep learning algorithms for detection of diabetic retinopathy in retinal fundus photographs: a systematic review and meta-analysis. Comput Methods Prog Biomed 191:105320

    Google Scholar 

  34. Jaafar HF, Nandi AK, Al-Nuaimy W (2011) Automated detection and grading of hard exudates from retinal fundus images. In: 2011 19th European signal processing conference. IEEE. pp. 66-70

  35. Janakiramaiah B, Kalyani G (2021) Dementia detection using the deep convolution neural network method. In: Trends in Deep Learning Methodologies, pp 157–181

    Google Scholar 

  36. Janakiramaiah B, Kalyani G, Jayalakshmi A (2021) Automatic alert generation in a surveillance systems for smart city environment using deep learning algorithm. Evol Intel 14(2):635–642

    Google Scholar 

  37. Kaggle (2015) Diabetic retinopathy detection. https://www.kaggle.com/c/diabeticretinopathy-detection/. Accessed 7 May 2020

  38. Kalyani G, Janakiramaiah B, Karuna A, Prasad LV (2021) Diabetic retinopathy detection and classification using capsule networks. Complex Intell Syst:1–14. https://doi.org/10.1007/s40747-021-00318-9

  39. Karim T, Riad MS, Kabir R (2019) Symptom analysis of diabetic retinopathy by micro-aneurysm detection using NPRTOOL. In: 2019 international conference on robotics, electrical and signal processing techniques (ICREST). IEEE. pp. 606-610

  40. Kaur S, Gunjan D, Mahapatra SJ (2022) Investigating the significance of color space for abnormality detection in wireless capsule endoscopy images. Biomed Process Control 75:103624

    Google Scholar 

  41. Khan Z, Khan FG, Khan A, Rehman ZU, Shah S, Qummar S, Ali F, Pack S (2021) Diabetic retinopathy detection using VGG-NIN a deep learning architecture. IEEE Access 9:61408–61416

    Google Scholar 

  42. Khanna M, Agarwal A, Singh LK, Thawkar S, Khanna A, Gupta D (2021) Radiologist-level two novel and robust automated computer-aided prediction models for early detection of COVID-19 infection from chest X-ray images. Arab J Sci Eng 7:1–33

  43. Kumar S, Adarsh A, Kumar B, Singh AK (2020) An automated early diabetic retinopathy detection through improved blood vessel and optic disc segmentation. Opt Laser Technol 121:105815

    Google Scholar 

  44. Li F, Wang Y, Xu T, Dong L, Yan L, Jiang M, Zou H (2021) Deep learning-based automated detection for diabetic retinopathy and diabetic macular oedema in retinal fundus photographs. Eye 36(7):1433–1441

  45. Lin X, Xu Y, Pan X, Xu J, Ding Y, Sun X, Song X, Ren Y, Shan P-F (2020) Global, regional, and national burden and trend of diabetes in 195 countries and territories: an analysis from 1990 to 2025. Sci Rep 10(1):1–11

    Google Scholar 

  46. Mansour RF (2018) Deep-learning-based automatic computer-aided diagnosis system for diabetic retinopathy. Biomed Eng Lett 8(1):41–57

    Google Scholar 

  47. Mary AR, Kavitha P (2021) Automated diabetic retinopathy detection and classification using stochastic coordinate descent deep learning architectures. Mater Today: Proceedings

  48. Mateen M, Wen J, Nasrullah N, Sun S, Hayat S (2020) Exudate detection for diabetic retinopathy using pretrained convolutional neural networks. Complexity 2020:1–11

    Google Scholar 

  49. Math L, Fatima R (2021) Adaptive machine learning classification for diabetic retinopathy. Multimed Tools Appl 80(4):5173–5186

    Google Scholar 

  50. Ministry of Health & Family Welfare (MoHFW, India), & Directorate General of Health Services (DGHS) (2020) National programme for prevention and control of cancer, diabetes, cardiovascular diseases and stroke

  51. Mo W, Luo X, Zhong Y, Jiang W (2019) Image recognition using convolutional neural network combined with ensemble learning algorithm. J Phys Conf Ser 1237(2):022026 IOP publishing

  52. Mushtaq G, Siddiqui F (2021) Detection of diabetic retinopathy using deep learning methodology. IOP Conf Ser: Mater Sci Eng 1070(1):012049 IOP publishing

  53. Najrabi D, Hamghalam M, Ayatollahi A (2018) Diagnosis of astrocytoma and globalastom using machine vision. In: 2018 6th Iranian joint congress on fuzzy and intelligent systems (CFIS). IEEE. pp. 152-155

  54. Pires R, Avila S, Wainer J, Valle E, Abramoff MD, Rocha A (2019) A data-driven approach to referable diabetic retinopathy detection. Artif Intell Med 96:93–106

    Google Scholar 

  55. Pratt H, Coenen F, Broadbent DM, Harding SP, Zheng Y (2016) Convolutional neural networks for diabetic retinopathy. Procedia Comput Sci 90:200–205

    Google Scholar 

  56. Qiao L, Zhu Y, Zhou H (2020) Diabetic retinopathy detection using prognosis of microaneurysm and early diagnosis system for non-proliferative diabetic retinopathy based on deep learning algorithms. IEEE Access 8:104292–104302

    Google Scholar 

  57. Quellec G, Charrière K, Boudi Y, Cochener B, Lamard M (2017) Deep image mining for diabetic retinopathy screening. Med Image Anal 39:178–193

    Google Scholar 

  58. Qummar S, Khan FG, Shah S, Khan A, Shamshirband S, Rehman ZU, Ahmed Khan I, Jadoon W (2019) A deep learning ensemble approach for diabetic retinopathy detection. IEEE Access 7:150530–150539

    Google Scholar 

  59. Qureshi I, Ma J, Abbas Q (2021) Diabetic retinopathy detection and stage classification in eye fundus images using active deep learning. Multimed Tools Appl 80(8):11691–11721

    Google Scholar 

  60. Raju M, Pagidimarri V, Barreto R, Kadam A, Kasivajjala V, Aswath A (2017) Development of a deep learning algorithm for automatic diagnosis of diabetic retinopathy. MEDINFO 2017: precision healthcare through informatics. IOS press, pp 559–563

    Google Scholar 

  61. Reddy SS, Sethi N, Rajender R, Mahesh G (2020) Extensive analysis of machine learning algorithms to early detection of diabetic retinopathy. Mater Today: Proceedings

  62. Renukadevi NT, Saraswathi K, Karunakaran S, Anguraj B (2021) Categorization of diabetic retinopathy using deep learning techniques. IOP Conf Ser: Mater Sci Eng 1055(1):012087 IOP publishing

  63. Safi H, Safi S, Hafezi-Moghadam A, Ahmadieh H (2018) Early detection of diabetic retinopathy. Surv Ophthalmol 63(5):601–608

    Google Scholar 

  64. Sajid S, Hussain S, Sarwar A (2019) Brain tumor detection and segmentation in MR images using deep learning. Arab J Sci Eng 44(11):9249–9261

    Google Scholar 

  65. Salamat N, Missen MMS, Rashid A (2019) Diabetic retinopathy techniques in retinal images: a review. Artif Intell Med 97:168–188

    Google Scholar 

  66. Samanta A, Saha A, Satapathy SC, Fernandes SL, Zhang YD (2020) Automated detection of diabetic retinopathy using convolutional neural networks on a small dataset. Pattern Recogn Lett 135:293–298

    Google Scholar 

  67. Saxena G, Verma DK, Paraye A, Rajan A, Rawat A (2020) Improved and robust deep learning agent for preliminary detection of diabetic retinopathy using public datasets. Intell Based Med 3:100022

    Google Scholar 

  68. Schaal KB, Munk MR, Wyssmueller I, Berger LE, Zinkernagel MS, Wolf S (2019) Vascular abnormalities in diabetic retinopathy assessed with swept-source optical coherence tomography angiography widefield imaging. Retina 39(1):79–87

    Google Scholar 

  69. Seth S, Agarwal B (2018) A hybrid deep learning model for detecting diabetic retinopathy. J Stat Manag Syst 21(4):569–574

    Google Scholar 

  70. Shahin EM, Taha TE, Al-Nuaimy W, El Rabaie S, Zahran OF, Abd El-Samie FE (2012) Automated detection of diabetic retinopathy in blurred digital fundus images. In: 2012 8th international computer engineering conference (ICENCO). IEEE. pp. 20-25

  71. Shaikh TA, Ali R (2020) An intelligent healthcare system for optimized breast cancer diagnosis using harmony search and simulated annealing (HS-SA) algorithm. Inform Med Unlocked 21:100408

    Google Scholar 

  72. Shaikh TA, Ali R, Beg MM (2020) Transfer learning privileged information fuels CAD diagnosis of breast cancer. Mach Vis Appl 31(1):1–23

    Google Scholar 

  73. Sharma NC (2019) Government survey found 11.8% prevalence of diabetes in India. Livemint

  74. Soleymanifard M, Hamghalam M (2022) Multi-stage glioma segmentation for tumour grade classification based on multiscale fuzzy C-means. Multimed Tools Appl 81(6):8451–8470

    Google Scholar 

  75. Tandon N, Anjana RM, Mohan V, Kaur T, Afshin A, Ong K, Mukhopadhyay S, Thomas N, Bhatia E, Krishnan A, Mathur P, Dhaliwal RS, Shukla DK, Bhansali A, Prabhakaran D, Rao PV, Yajnik CS, Kumar GA, Varghese CM, … Dandona L (2018) The increasing burden of diabetes and variations among the states of India: the global burden of disease study 1990–2016. Lancet Glob Health 6(12):e1352–e1362

  76. Vives-Boix V, Ruiz-Fernández D (2021) Diabetic retinopathy detection through convolutional neural networks with synaptic metaplasticity. Comput Methods Prog Biomed 206:106094

    Google Scholar 

  77. Wan S, Liang Y, Zhang Y (2018) Deep convolutional neural networks for diabetic retinopathy detection by image classification. Comput Electr Eng 72:274–282

    Google Scholar 

  78. Wang Z, Yin Y, Shi J, Fang W, Li H, Wang X (2017) Zoom-in-net: deep mining lesions for diabetic retinopathy detection. In: International conference on medical image computing and computer-assisted intervention. Springer, Cham. pp. 267-275

  79. Wang X, Lu Y, Wang Y, Chen WB (2018) Diabetic retinopathy stage classification using convolutional neural networks. In: 2018 IEEE international conference on information reuse and integration (IRI). IEEE. pp. 465-471

  80. Xu K, Feng D, Mi H (2017) Deep convolutional neural network-based early automated detection of diabetic retinopathy using fundus image. Molecules 22(12):2054

    Google Scholar 

  81. Yang Y, Li T, Li W, Wu H, Fan W, Zhang W (2017) Lesion detection and grading of diabetic retinopathy via two-stages deep convolutional neural networks. In: International conference on medical image computing and computer-assisted intervention. Springer, Cham. pp. 533-540

  82. Zago GT, Andreão RV, Dorizzi B, Salles EOT (2020) Diabetic retinopathy detection using red lesion localization and convolutional neural networks. Comput Biol Med 116:103537

    Google Scholar 

  83. Zeng X, Chen H, Luo Y, Ye W (2019) Automated diabetic retinopathy detection based on binocular siamese-like convolutional neural network. IEEE Access 7:30744–30753

    Google Scholar 

Download references

Availability of data and material

The data that support the findings of this study are available from the first author upon reasonable request.

Funding

Not applicable.

Author information

Authors and Affiliations

  1. Department of Computer Science and Engineering, Hindustan College of Science and Technology, Mathura, 281122, India

    Munish Khanna & Mayur Goyal

  2. Department of Computer Engineering and Applications, G L A University, Mathura, 281406, India

    Law Kumar Singh

  3. Department of Information Technology, Hindustan College of Science and Technology, Mathura, 281122, India

    Shankar Thawkar

Authors
  1. Munish Khanna
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Law Kumar Singh
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Shankar Thawkar
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Mayur Goyal
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Munish Khanna.

Ethics declarations

None.

Conflicts of interest/competing interests

The authors declare no conflict of interest.

Informed consent

None.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Khanna, M., Singh, L.K., Thawkar, S. et al. Deep learning based computer-aided automatic prediction and grading system for diabetic retinopathy. Multimed Tools Appl 82, 39255–39302 (2023). https://doi.org/10.1007/s11042-023-14970-5

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-023-14970-5

Keywords

Search

Navigation