Skip to main content
SpringerLink
Log in

MES-Net: a new network for retinal image segmentation

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Glaucoma, diabetic retinopathy, and other eye diseases have seriously threatened people’s visual health. Whether it is clinical diagnosis or computer-aided diagnosis, the accurate segmentation of the retinal tissues and lesion areas (optic disc (OD), optic cup (OC), retinal blood vessels) are indispensable. In this paper, we propose a novel network MES-Net for the retinal image segmentation tasks. MES-Net adopts U-Net as the overall architecture, including three proposed modules: multi-scale feature pre-extraction (MFP) block, encoder spatial cascading encoding (ESCE) path, and decoder input SE block. We use MFP block to extract multi-scale semantic features from input images with different resolutions, and take ESCE path to extract deep features and improve the feature reuse rate. SE block can weaken the semantic gaps between the encoder paths and the decoder paths. For retinal vessel segmentation, the accuracy values of MES-Net tested on the DRIVE, STARE and CHASE datasets are 0.9667, 0.9724, and 0.9697, and AUC is 0.9853, 0.9897, and 0.9869, respectively. For OC and OD simultaneous segmentation, the overlap coefficients of OC and OD tested on the ORIGA dataset are 0.818 and 0.948, and the accuracy are 0.935 and 0.977, respectively. The experimental results show that the proposed method significantly improves the performance of the original U-Net and is superior to other state-of-the-art methods. Thus, it can be applied to retinal image segmentation tasks, and many other medical image segmentation problems can also benefit from the proposed method.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

References

  1. Agarwal A, Gulia S, Chaudhary S, Dutta MK, Travieso CM, Alonso-Hernández JB (2015) A novel approach to detect glaucoma in retinal fundus images using cup-disk and rim-disk ratio. 2015 4th International Work Conference on Bioinspired Intelligence (IWOBI), San Sebastian, pp 139–144

    Google Scholar 

  2. Almazroa A, Alodhayb S, Osman E, Ramadan E, Hummadi M, Dlaim M, Alkatee M, Raahemifar K, Lakshminarayanan V (2018) Retinal fundus images for glaucoma analysis: the RIGA dataset. Proceeding of SPIE Medical Imaging, Houston, pp 1–8

    Google Scholar 

  3. Biswas R, Vasan A, Roy SS (2020) Dilated deep neural network for segmentation of retinal blood vessels in fundus images. Iran J Sci Technol Trans Electr Eng 44:505–518

    Article  Google Scholar 

  4. Bourne RRA (2006) Worldwide glaucoma through the looking glass. Br J Ophthalmol 90:253–254

    Article  Google Scholar 

  5. Chen L-C; Papandreou G; Schroff F; Adam H (2017) Rethinking Atrous Convolution for Semantic Image Segmentation. arXiv:1706.05587

  6. Chen L, Papandreou G, Kokkinos I, Murphy K, Yuille A (2017) Deeplab: semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected crfs. IEEE Trans Pattern Anal Mach Intell 40:834–848

    Article  Google Scholar 

  7. Cheng J, Liu J, Xu Y, Yin F, Wong DW, Tan NM, Tao D, Cheng CY, Aung T, Wong TY (2013) Superpixel classification based optic disc and optic cup segmentation for glaucoma screening. IEEE T Med Imaging 32:1019–1032

    Article  Google Scholar 

  8. Cheng J, Tao D, Wong DWK, Liu J (2017) Quadratic divergence regularized SVM for optic disc segmentation. Biomed Opt Express 8:2687–2696

    Article  Google Scholar 

  9. Chowdhary CL, Acharjya DP (2015) Segmentation of Mammograms using a Novel Intuitionistic Possibilistic Fuzzy C-Mean Clustering Algorithm. 50th Annual Golden Jubilee Convention of the Computer Society of India (CSI-2015), 2nd-5th December, Springer, AISC vol 652, pp. 75–82.

  10. Chowdhary CL, Acharjya DP (2016) A hybrid scheme for breast Cancer detection using intuitionistic fuzzy rough set technique. Int J Healthcare Inform Syst Informatics 11:38–61

    Article  Google Scholar 

  11. Chowdhary CL, Acharjya DP (2017) Clustering algorithm in Possibilistic exponential fuzzy C-mean segmenting medical images. J Biomimetics, Biomater Biomed Eng 30:12–23

    Article  Google Scholar 

  12. Chowdhary CL, Acharjya DP (2019) Segmentation and Feature Extraction in Medical Imaging: A Systematic Review. International Conference on Computational Intelligence and Data Science (ICCIDS 2019). Procedia computer science, Elsevier 167:26–36

    Article  Google Scholar 

  13. Decenciere E, Zhang XW, Cazuguel G, Lay B, Cochener B, Trone C, Gain P, Ordonez-Varela JR, Massin P, Erginay A, Charton B, Klein JC (2014) Feedback on a publicly distributed image database: the Messidor database. Image Anal Stereol 33(3):231–234

    Article  Google Scholar 

  14. Feng S, Zhuo Z, Pan D, Tian Q (2020) CcNet: a cross-connected convolutional network for segmenting retinal vessels using multi-scale features. Neurocomputing 392:268–276

    Article  Google Scholar 

  15. Fu H, Cheng J, Xu Y, Wong DWK, Liu J, Cao XC (2018) Joint optic disc and cup segmentation based on multi-label deep network and polar transformation. IEEE Trans Med Imaging 37:1597–1605

    Article  Google Scholar 

  16. Gu Z, Cheng J, Fu H, Zhou K, Hao H, Zhao Y, Liu J (2019) CE-net: context encoder network for 2D medical image segmentation. IEEE Trans Med Imaging 38:2281–2292

    Article  Google Scholar 

  17. Hassan G, El-Bendary N, Hassanien AE, Ali Fahmy A, Shoeb M, Snasel V (2015) Retinal blood vessel segmentation approach based on mathematical morphology. Procedia Comput Sci 65:612–622

    Article  Google Scholar 

  18. He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. Proceedings of the IEEE conference on computer vision and pattern recognition, Las Vegas, pp 770–778

    Google Scholar 

  19. Hu J, Shen L, Albanie S, Sun G, Wu E (2020) Squeeze-and-excitation networks. IEEE Trans Pattern Anal Mach Intell 42(8):2011–2023

    Article  Google Scholar 

  20. Huang G, Liu Z, Van Der Maaten L, Weinberger KQ (2017) Densely Connected Convolutional Networks. Proceedings of the IEEE conference on computer vision and pattern recognition, Honolulu, pp 2261–2269

    Google Scholar 

  21. Issac A, Sarathi MP, Dutta MK (2015) An adaptive threshold based image processing technique for improved glaucoma detection and classification. Comput Meth Prog Bio 122:229–244

    Article  Google Scholar 

  22. Jonas JB, Bergua A (2000) Schmitz–Valckenberg P Ranking of optic disc variables for detection of glaucomatous optic nerve damage. Invest Ophth Vis Sci 41:1764–1773

    Google Scholar 

  23. Koukounis D, Ttofis C, Papadopoulos A, Theocharides T (2014) A high performance hardware architecture for portable, low-power retinal vessel segmentation. Integration. 47:377–386

    Article  Google Scholar 

  24. Liu Q, Hong X, Li S, Chen Z, Guo Y, Zou B (2019) A spatial-aware joint optic disc and cup segmentation method. Neurocomputing. 359:285–297

    Article  Google Scholar 

  25. Lupascu CA, Tegolo D, Trucco E (2010) Fabc: retinal vessel segmentation using adaboost. IEEE Trans Inf Technol Biomed 14:1267–1274

    Article  Google Scholar 

  26. Lv Y, Ma H, Li J, Liu S (2020) Attention guided U-net with Atrous convolution for accurate retinal vessels segmentation. IEEE Access 8:32826–32839

    Article  Google Scholar 

  27. Mittapalli PS, Kande GB (2016) Segmentation of optic disk and optic cup from digital fundus images for the assessment of glaucoma. Biomed Signal Proces 24:34–46

    Article  Google Scholar 

  28. Nayak J, Rajendra AU, Bhat PS, Shetty N, Lim TC (2009) Automated diagnosis of glaucoma using digital fundus images. J Med Syst 33:337–346

    Article  Google Scholar 

  29. Ni J, Wu J, Tong J, Chen Z, Zhao J (2020) GC-net: global context network for medical image segmentation. Comput Methods Prog Biomed 190:105–121

    Article  Google Scholar 

  30. Noor N, Khalid N, Ariff N Optic cup and disc color channel multi-thresholding segmentation. IEEE International Conference on Control System, Computing and Engineering, Mindeb, 29 November −1 December 2013, pp 530–534

  31. Ramlugun GS, Nagarajan VK, Chakraborty C (2012) Small retinal vessels extraction towards proliferative diabetic retinopathy screening. Expert Syst Appl 39:1141–1146

    Article  Google Scholar 

  32. Ronneberger O, Fischer P, Brox T (2015) U-net: Convolutional networks for biomedical image segmentation. In Medical Image Computing and Computer-Assisted Intervention -- MICCAI 2015: 18th International Conference, Munich, Germany. Springer, Cham, pp 234–241

    Google Scholar 

  33. Sevastopolsky A (2017) Optic disc and cup segmentation methods for glaucoma detection with modification of u-net convolutional neural network. Pattern Recognit Image Anal 27(3):618–624

    Article  Google Scholar 

  34. Szegedy C, Ioffe S, Vanhoucke V, Alemi AA (2017) Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning. AAAI Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence, San Francisco, pp 4–9

    Google Scholar 

  35. Tang P, Liang Q, Yan X, Zhang D, Coppola G, Sun W (2019) Multi-proportion channel ensemble model for retinal vessel segmentation. Comput Biol Med 111:103352

    Article  Google Scholar 

  36. Tham Y-C, Li X, Wong TY, Quigley HA, Aung T, Cheng C-Y (2014) Global prevalence of glaucoma and projections of glaucoma burden through. Ophthalmology 121:2081–2090

    Article  Google Scholar 

  37. Wu Y, Xia Y, Song Y, Zhang Y, Cai W (2020) NFN+: a novel network followed network for retinal vessel segmentation. Neural Netw 126:153–162

    Article  Google Scholar 

  38. Yu F, Koltun V (2016) Multi-scale context aggregation by dilated convolutions. Available online: https://arxiv.org/abs/1511.07122v3 (accessed on 20 March 2020)

  39. Yue K, Zou B, Chen Z, Liu Q (2019) Retinal vessel segmentation using dense U-net with multiscale inputs. J Med imaging 6:034004

    Article  Google Scholar 

  40. Zhang Z, Yin FS, Liu J, Wong WK (2010) Origa-light: An online retinal fundus image database for glaucoma analysis and research. Proceedings of Engineering in Medicine and Biology Society (EMBC), Buenos Aires, pp 3065–3068

    Google Scholar 

  41. Zhang Y, Li T, Gao Y, Kang H, Wang K, Guo S (2019) BTS-DSN: deeply supervised neural network with short connections for retinal vessel segmentation. Int J Med Inform 126:105–113

    Article  Google Scholar 

  42. Zhou ZW, Siddiquee MMR, Tajbakhsh N, Liang J (2018) UNet++: a nested U-Net architecture for medical image segmentation. In: Deep Learning in Medical Image Analysis and Multimodal Learning for Clinical Decision Support, Granada, Spain, 20 September 2018. Springer, Cham, pp 3–11

    Chapter  Google Scholar 

  43. Zhu C, Zou B, Zhao R, Cui J, Duan X, Chen Z (2017) Retinal vessel segmentation in colour fundus images using extreme learning machine. Comput Med Imag Grap 55:68–77

    Article  Google Scholar 

Download references

Acknowledgements

This research was funded by the National Natural Science Foundation of China (Grant No. 61502537), the Hunan Provincial Natural Science Foundation of China (Grant No. 2018JJ3681), and the Fundamental Research Funds for the Central Universities of Central South University (No.2020zzts567). We would also like to thank Pingbo Ouyang, the doctor of Xiangya second hospital, Changsha, P.R. China, for her support and guidance.

Author information

Authors and Affiliations

  1. School of Automation, Central South University, Changsha, 410083, China

    Fan Guo, Weiqing Li, Zhonghao Kuang & Jin Tang

Authors
  1. Fan Guo
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Weiqing Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Zhonghao Kuang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jin Tang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jin Tang.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Appendices

Appendices

The comparison results of retinal vessel segmentation based on STARE dataset and CHASE dataset can be seen in Fig. 11 and 12, respectively.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Guo, F., Li, W., Kuang, Z. et al. MES-Net: a new network for retinal image segmentation. Multimed Tools Appl 80, 14767–14788 (2021). https://doi.org/10.1007/s11042-021-10580-1

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-021-10580-1

Keywords

Search

Navigation