Abstract
The accurate segmentation of retinal vessel image is significant for the early diagnosis of some diseases. A retinal vessel image segmentation algorithm based on an encoder-decoder structure is proposed. In the encoding section, the Inception module is used, which uses convolution kernels of different scales to achieve features extract to obtain images multi-scale information. So as to enable the model to perceive blood vessels of various shapes and improve the accuracy of segmentation of small blood vessels, multiple pyramid pooling modules are adopted in the decoding process to aggregate more contextual information, and multi-scale and multi-local area feature fusion is used to improve segmentation effect. In addition, the feature fusion method is applied in the upsampling process to fuse low-order semantic features to obtain more low-level detailed information, thereby further promote the segmentation effect. The experimental results on DRIVE and STAER fundus image datasets show that the algorithm has higher sensitivity, accuracy and AUC value compared with other algorithms, and the segmentation effect is better.
Similar content being viewed by others
Data availablity
The datasets analysed during the current study are available from the Introduction - Grand Challenge (grand-challenge.org).
References
Breiman L (1996) Bagging predictors. Mach Learn 24(2):123–140
Chaudhuri S, Chatterjee S, Katz N, Nelson M, Goldbaum M (1989) Detection of blood vessels in retinal images using two-dimensional matched filters. IEEE Trans Med Imaging 8(3):263–269
Cortes C, Vapnik V (1995) Support-vector networks. Mach Learn 20(3):273–297
Fraz MM, Barman SA, Remagnino P, Hoppe A, Basit A, Uyyanonvara B, Rudnicka AR, Owen CG (2012) An approach to localize the retinal blood vessels using bit planes and centerline detection. Comput Methods Prog Biomed 108(2):600–616
Fraz MM, Basit A, Barman SA (2013) Application of morphological bit planes in retinal blood vessel extraction. J Digit Imaging 26(2):274–286
Fraz MM, Remagnino P, Hoppe A, Uyyanonvara B, Rudnicka AR, Owen CG, Barman SA (2012) An ensemble classification-based approach applied to retinal blood vessel segmentation. IEEE Trans Biomed Eng 59(9):2538–2548
Friedman N, Geiger D, Goldszmidt M (1997) Bayesian network classifiers. Mach Learn 23(5):131–163
Gu P, Xiao Z (2021) Application of modified U-NET in retinal vascular segmentation. Comput Sci Explor 1–12
Hatamizadeh A, Hosseini H, Liu Z, Schwartz SD, Terzopoulos D (2019) Deep dilated convolutional nets for the automatic segmentation of retinal vessels. arXiv preprint arXiv:1905.12120
Hong C, Yu J, Zhang J, Jin X, Lee K (2019) Multimodal face-pose estimation with multitask manifold deep learning. IEEE Trans Ind Inf 15(7):3952–3961
Imani E, Javidi M, Pourreza HR (2015) Improvement of retinal blood vessel detection using morphological component analysis. Comput Methods Prog Biomed 118(3):263–279
Jin Q, Meng Z, Pham TD, Chen Q, Wei L, Su R (2019) DUNet: a deformable network for retinal vessel segmentation. Knowl-Based Syst 178:149–162
Lechner J, O'Leary OE, Stitt AW (2017) The pathology associated with diabetic retinopathy. Vis Res 139:7–14
Li D, Dharmawan DA, Ng BP, Rahardja S (2019) Residual u-net for retinal vessel segmentation. In 2019 IEE International Conference on Image Processing (ICIP), pp 1425–1429
Prokofyeva E, Zrenner E (2012) Epidemiology of major eye diseases leading to blindness in Europe: a literature review. Ophthalmic Res 47(4):171–188
Ronneberger O Fischer P Brox T (2015) UGNet convolutional networks for biomedical image segmentation [C]. International Conference on Medical Image Computing and Computer-Assisted Intervention 234–241
Ronneberger O, Fischer P, Brox T (2015) U-net: Convolutional networks for biomedical image segmentation. International Conference on Medical image computing and computer-assisted intervention, pp 234–241
Song J, Lee B (2017) Development of automatic retinal vessel segmentation method in fundus images via convolutional neural networks. 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, 681–684
Wang W, Zhang J, Wu W, Zhou S (2018) An automatic approach for retinal vessel segmentation by multi-scale morphology and seed point tracking. J Med Imaging Health Inf 8(2):262–274
Ying C, Qi-Guang M, Jia-Chen L, Lin G (2013) Advance and prospects of AdaBoost algorithm. Acta Automat Sin 39(6):745–758
Yu J, Rui Y, Tao D (2014) Click prediction for web image Reranking using multimodal sparse coding. IEEE Trans Image Process 23(5):2019–2032
Yu J, Tan M, Zhang H, Tao D, Rui Y (2019) Hierarchical deep click feature prediction for fine-grained image recognition. IEEE Trans Pattern Anal Mach Intell pp 1–1
Funding
This work was supported by the National Natural Science Foundation of China under Grant 61502262
Author information
Authors and Affiliations
Contributions
All authors designed the research. Material preparation, data collection and analysis were performed by Zhengli Zhai and Shu Feng, these authors contributed equally to this work. The first draft of the manuscript was written by Shu Feng, Luyao Yao and Penghui Li. All authors commented on previous versions of the manuscript and read and approved the final manuscript.”
Corresponding author
Ethics declarations
Competing interests
The authors have no relevant financial or non-financial interests to disclose.
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Zhai, Z., Feng, S., Yao, L. et al. Retinal vessel image segmentation algorithm based on encoder-decoder structure. Multimed Tools Appl 81, 33361–33373 (2022). https://doi.org/10.1007/s11042-022-13176-5
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-022-13176-5