Skip to main content

Advertisement

Springer Nature Link
Log in

NAUNet: lightweight retinal vessel segmentation network with nested connections and efficient attention

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

The state of retinal vessels in fundus images is a reliable biomarker for many diseases, and the accurate segmentation of retinal vessels is important for the diagnosis of related diseases. To address the problem of many layers and high complexity of deep learningbased vascular segmentation network, this paper proposes a lightweight encoderdecoder network NAUNet by reasonably reducing the number of network layers. By introducing the DropBlock regularization strategy, the local semantic information can be discarded more effectively to motivate the network to learn more robust and effective features. Efficient attention module uses appropriate crosschannel interaction to capture richer global information. In the skip connection part, the nested connection strategy is adopted to effectively fuse the feature maps gathered from the intermediate decoder and the original feature maps from the encoder, which makes up for the semantic gap caused by direct simple connection. In addition, data augmentation is performed on the original image to improve the robustness and prevent the overfitting problem caused by insufficient data. A mixed loss function is proposed to solve the problem of class imbalance in vascular images. Finally, NAUNet was tested and achieved F1 scores of 80.92%/81.25%/74.86% and AUC values of 0.9831/0.9849/0.9841 on the DRIVE, STARE and CHASE_DB1 datasets, respectively.The number of parameters for the proposed method was only 2.66 M.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

Data Availability

The data that support the findings of this study are available from the corresponding author upon reasonable request.

References

  1. Alom MZ, Hasan M, Yakopcic C et al (2018) Recurrent residual convolutional neural network based on U-Net (R2U-Net) for medical image segmentation. Preprint at arXiv:1802.06955

  2. Ambati LS, El-Gayar O, Nawar N (2020) Influence of the digital divide and socio-economic factors on prevalence of diabetes. Issues Inf Syst. https://doi.org/10.48009/4/_iis_2020_103-113

  3. Badrinarayanan V, Kendall A, Cipolla R (2017) Segnet: a deep convolutional encoder-decoder architecture for image segmentation. IEEE Trans Pattern Anal Mach Intell 39:2481–2495

    Article  Google Scholar 

  4. Chen L-C, Zhu Y, Papandreou G et al (2018) Encoder-decoder with atrous separable convolution for semantic image segmentation. In: Ferrari V, Hebert M, Sminchisescu C, Weiss Y (eds) Computer vision ECCV 2018. Springer International Publishing, Cham, pp 833–851

  5. El-Gayar O, Ambati LS, Nawar N (2020) Wearables, artificial intelligence, and the future of healthcare. Fac Res Publ 104–129

  6. Faisal A, Pluempitiwiriyawej C (2020) Active contour driven by scalable local regional information on expandable kernel. J Sci Appl Technol 4:1–14

    Article  Google Scholar 

  7. Fan Z, Mo J, Qiu B et al (2019) Accurate retinal vessel segmentation via octave convolution neural network. Preprint at arXiv:1906.12193

  8. Feng S, Zhuo Z, Pan D, Tian Q (2020) Ccnet: a cross-connected convolutional network for segmenting retinal vessels using multi-scale features. Neurocomputing 392:268–276

    Article  Google Scholar 

  9. Fu J, Liu J, Tian H et al (2019) Dual attention network for scene segmentation. In: 2019 IEEE/CVF conference on computer vision and pattern recognition (CVPR). pp 3141–3149

  10. Ghiasi G, Lin T-Y, Le QV (2018) DropBlock: a regularization method for convolutional networks. Preprint at arXiv:1810.12890

  11. Guo S, Wang K, Kang H et al (2019) BTS-DSN: deeply supervised neural network with short connections for retinal vessel segmentation. Int J Med Inf 126:105–113

    Article  Google Scholar 

  12. Hu J, Shen L, Albanie S et al (2020) Squeeze-and-excitation networks. IEEE Trans Pattern Anal Mach Intell 42:2011–2023

    Article  Google Scholar 

  13. Ibtehaz N, Rahman MS (2020) MultiresUNet: rethinking the U-Net architecture for multimodal biomedical image segmentation. Neural Netw 121:74–87

    Article  Google Scholar 

  14. Jin Q, Meng Z, Pham TD et al (2019) DUNEt: a deformable network for retinal vessel segmentation. Knowl-Based Syst 178:149–162

    Article  Google Scholar 

  15. Lam BSY, Gao Y, Liew AW (2010) General retinal vessel segmentation using regularization-based multiconcavity modeling. IEEE Trans Med Imaging 29:1369–1381

    Article  Google Scholar 

  16. Li Q, Feng B, Xie L et al (2016) A cross-modality learning approach for vessel segmentation in retinal images. IEEE Trans Med Imaging 35:109–118

    Article  Google Scholar 

  17. Li L, Verma M, Nakashima Y et al (2020) IterNet: retinal image segmentation utilizing structural redundancy in vessel networks. In: 2020 IEEE winter conference on applications of computer vision (WACV). pp 3645–3654

  18. Milletari F, Navab N, Ahmadi S (2016) V-Net: fully convolutional neural networks for volumetric medical image segmentation. In: 2016 fourth international conference on 3D vision (3DV). pp 565–571

  19. Oliveira A, Pereira S, Silva CA (2018) Retinal vessel segmentation based on fully convolutional neural networks. Expert Syst Appl 112:229–242

    Article  Google Scholar 

  20. Owen CG, Rudnicka AR, Mullen R et al (2009) Measuring retinal vessel tortuosity in 10-year-old children: validation of the computer-assisted image analysis of the retina (CAIAR) program. Invest Ophthalmol Vis Sci 50:2004–2010

    Article  Google Scholar 

  21. Palanivel DA, Natarajan S, Gopalakrishnan S (2020) Retinal vessel segmentation using multifractal characterization. Appl Soft Comput 94:106439

    Article  Google Scholar 

  22. Rezaee K, Haddadnia J, Tashk A (2017) Optimized clinical segmentation of retinal blood vessels by using combination of adaptive filtering, fuzzy entropy and skeletonization. Appl Soft Comput 52:937–951

    Article  Google Scholar 

  23. Ronneberger O, Fischer P, Brox T (2015) U-Net: convolutional networks for biomedical image segmentation. In: Navab N, Hornegger J, Wells WM, Frangi AF (eds) Medical image computing and computer-assisted intervention – MICCAI 2015. Springer International Publishing, Cham, pp 234–241

  24. Saroj SK, Kumar R, Singh NP (2020) Fréchet PDF based matched filter approach for retinal blood vessels segmentation. Comput Methods Programs Biomed 194:105490

    Article  Google Scholar 

  25. Setiawan AW, Faisal A (2020) A study on JPEG compression in color retinal image using BT.601 and BT.709 standards: image quality assessment vs. file size. In: 2020 international seminar on application for technology of information and communication (isemantic). IEEE, Indonesia, pp 436–441

  26. Shelhamer E, Long J, Darrell T (2017) Fully convolutional networks for semantic segmentation. IEEE Trans Pattern Anal Mach Intell 39:640–651

    Article  Google Scholar 

  27. Soares JVB, Leandro JJG, Cesar RM et al (2006) Retinal vessel segmentation using the 2-D gabor wavelet and supervised classification. IEEE Trans Med Imaging 25:1214–1222

    Article  Google Scholar 

  28. Soomro TA, Afifi AJ, Gao J et al (2019) Strided fully convolutional neural network for boosting the sensitivity of retinal blood vessels segmentation. Expert Syst Appl 134:36–52

    Article  Google Scholar 

  29. Srivastava N, Hinton G, Krizhevsky A et al (2014) Dropout: a simple way to prevent neural networks from overfitting. J Mach Learn Res 15:1929–1958

    MathSciNet  MATH  Google Scholar 

  30. Staal J, Abramoff MD, Niemeijer M et al (2004) Ridge-based vessel segmentation in color images of the retina. IEEE Trans Med Imaging 23:501–509

    Article  Google Scholar 

  31. Tang X, Zhong B, Peng J et al (2020) Multi-scale channel importance sorting and spatial attention mechanism for retinal vessels segmentation. Appl Soft Comput 93:106353

    Article  Google Scholar 

  32. Vaswani A, Shazeer N, Parmar N et al (2017) Attention is all you need. Preprint at arXiv:1706.03762

  33. Wang Q, Wu B, Zhu P et al (2020) ECA-Net: efficient channel attention for deep convolutional neural networks. In: 2020 IEEE/CVF conference on computer vision and pattern recognition (CVPR). pp 11531–11539

  34. Wu Y, Xia Y, Song Y et al (2020) NFN+: a novel network followed network for retinal vessel segmentation. Neural Netw 126:153–162

    Article  Google Scholar 

  35. Xiang Y, Gao X, Zou B et al (2014) Segmentation of retinal blood vessels based on divergence and bot-hat transform. In: 2014 IEEE international conference on progress in informatics and computing. pp 316–320

  36. Yan Z, Yang X, Cheng K-T (2018) Joint segment-level and pixel-wise losses for deep learning based retinal vessel segmentation. IEEE Trans Biomed Eng 65:1912–1923

    Article  Google Scholar 

  37. Yan Z, Yang X, Cheng K-T (2019) A Three-stage deep learning model for accurate retinal vessel segmentation. IEEE J Biomed Health Inform 23:1427–1436

    Article  Google Scholar 

  38. Zhang B, Huang S, Hu S (2018) Multi-scale neural networks for retinal blood vessels segmentation. Preprint at arXiv:1804.04206

  39. Zhou Z, Siddiquee MMR, Tajbakhsh N, Liang J (2020) UNEt++: redesigning skip connections to exploit multiscale features in image segmentation. IEEE Trans Med Imaging 39:1856–1867

    Article  Google Scholar 

Download references

Acknowledgements

This work was supported in part by the Science and Technology on Electro-Optical Information Security Control Laboratory (No. 2021JCJQLB055008) and Tianjin Science and Technology Plan (No.21YDTPJC00050).

Author information

Authors and Affiliations

  1. School of Electronic and Information Engineering, Hebei University of Technology, Tianjin, 300401, China

    Dongxu Yang, Hongdong Zhao & Lixin Geng

  2. Science and Technology on Electro-Optical Information Security Control Laboratory, Tianjin, 300308, China

    Dongxu Yang, Hongdong Zhao, Kuaikuai Yu & Lixin Geng

Authors
  1. Dongxu Yang
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Hongdong Zhao
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. Kuaikuai Yu
    View author publications

    You can also search for this author inPubMed Google Scholar

  4. Lixin Geng
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Hongdong Zhao.

Ethics declarations

Conflict of Interests

The authors have no relevant financial or non-financial interests to disclose.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Yang, D., Zhao, H., Yu, K. et al. NAUNet: lightweight retinal vessel segmentation network with nested connections and efficient attention. Multimed Tools Appl 82, 25357–25379 (2023). https://doi.org/10.1007/s11042-022-14319-4

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-022-14319-4

Keywords