Skip to main content

Advertisement

SpringerLink
Log in

WGAN domain adaptation for the joint optic disc-and-cup segmentation in fundus images

  • Original Article
  • Published:
International Journal of Computer Assisted Radiology and Surgery Aims and scope Submit manuscript

Abstract

Purpose

The cup-to-disc ratio (CDR), a clinical metric of the relative size of the optic cup to the optic disc, is a key indicator of glaucoma, a chronic eye disease leading to loss of vision. CDR can be measured from fundus images through the segmentation of optic disc and optic cup . Deep convolutional networks have been proposed to achieve biomedical image segmentation with less time and more accuracy, but requires large amounts of annotated training data on a target domain, which is often unavailable. Unsupervised domain adaptation framework alleviates this problem through leveraging off-the-shelf labeled data from its relevant source domains, which is realized by learning domain invariant features and improving the generalization capabilities of the segmentation model.

Methods

In this paper, we propose a WGAN domain adaptation framework for detecting optic disc-and-cup boundary in fundus images. Specifically, we build a novel adversarial domain adaptation framework that is guided by Wasserstein distance, therefore with better stability and convergence than typical adversarial methods. We finally evaluate our approach on publicly available datasets.

Results

Our experiments show that the proposed approach improves Intersection-over-Union score for optic disc-and-cup segmentation, Dice score and reduces the root-mean-square error of cup-to-disc ratio, when we compare it with direct transfer learning and other state-of-the-art adversarial domain adaptation methods.

Conclusion

With this work, we demonstrate that WGAN guided domain adaptation obtains a state-of-the-art performance for the joint optic disc-and-cup segmentation in fundus images.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

Notes

  1. https://refuge.grand-challenge.org.

  2. Provided by Medical Image Processing (MIP) group, IIIT Hyderabad.

References

  1. Akram M, Tariq A, Khalid S, Javed M, Abbas S, Yasin U (2015) Glaucoma detection using novel optic disc localization, hybrid feature set and classification techniques. Australas Phys Eng Sci Med 38(4):643–655

    Article  Google Scholar 

  2. Arjovsky M, Chintala S, Bottou L (2017) Wasserstein gan. arXiv preprint arXiv:1701.07875

  3. Chen L, Papandreou G, Kokkinos I, Murphy K, Yuille A (2017) Deeplab: semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected crfs. IEEE TPAMI

  4. Chen LC, Papandreou G, Schroff F, Adam H (2017) Rethinking atrous convolution for semantic image segmentation. arXiv preprint arXiv:1706.05587

  5. Dong N, Kampffmeyer M, Liang X, Wang Z, Dai W, Xing E (2018) Unsupervised domain adaptation for automatic estimation of cardiothoracic ratio. In: MICCAI. Springer, pp 544–552

  6. Dou Q, Ouyang C, Chen C, Chen H, Heng PA (2018) Unsupervised cross-modality domain adaptation of convnets for biomedical image segmentations with adversarial loss. arXiv preprint arXiv:1804.10916

  7. Fu H, Cheng J, Xu Y, Wong D, Liu J, Cao X (2018) Joint optic disc and cup segmentation based on multi-label deep network and polar transformation. IEEE TMI

  8. Fu H, Cheng J, Xu Y, Zhang C, Wong D, Liu J, Cao X (2018) Disc-aware ensemble network for glaucoma screening from fundus image. IEEE TMI

  9. Ganin Y, Lempitsky V (2015) Unsupervised domain adaptation by backpropagation. In: International conference on machine learning, pp 1180–1189

  10. Ganin Y, Ustinova E, Ajakan H, Germain P, Larochelle H, Laviolette F, Marchand M, Lempitsky V (2016) Domain-adversarial training of neural networks. J Mach Learn Res 17(1):2096–3030

    Google Scholar 

  11. Göçeri E (2016) Fully automated liver segmentation using sobolev gradient-based level set evolution. Int J Numer Methods Biomed Eng 32(11):e02765

    Article  Google Scholar 

  12. Goceri E (2017) Intensity normalization in brain mr images using spatially varying distribution matching. In: 11th International conference on computer graphics, visualization, computer vision and image processing (CGVCVIP 2017), pp 300–304

  13. Goceri E (2018) Fully automated and adaptive intensity normalization using statistical features for brain mr images. Celal Bayar Üniversitesi Fen Bilimleri Dergisi 14(1):125–134

    Article  Google Scholar 

  14. Goceri E (2019) Diagnosis of alzheimer’s disease with sobolev gradient-based optimization and 3d convolutional neural network. Int J Numer Methods Biomedi Eng 35(7):e3225

    Google Scholar 

  15. Goceri E, Martinez ED (2014) A level set method with sobolev gradient and haralick edge detection. Glob J Technol 5:1

    Google Scholar 

  16. Goodfellow I, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S, Courville A, Bengio Y (2014) Generative adversarial nets. In: NIPS, pp 2672–2680

  17. Gu Z, Cheng J, Fu H, Zhou K, Hao H, Zhao Y, Zhang T, Gao S, Liu J (2019) Ce-net: context encoder network for 2d medical image segmentation. IEEE Trans Med Imaging 38(10):2281–2292

    Article  Google Scholar 

  18. He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: The IEEE conference on computer vision and pattern recognition (CVPR)

  19. Hoffman J, Wang D, Yu F, Darrell T (2016) Fcns in the wild: Pixel-level adversarial and constraint-based adaptation. arXiv preprint arXiv:1612.02649

  20. Huang G, Liu Z, Van Der Maaten L, Weinberger K (2017) Densely connected convolutional networks. In: CVPR. IEEE, pp 4700–4708

  21. Isola P, Zhu J-Y, Zhou T, Efros AA (2017) Image-to-image translation with conditional adversarial networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1125–1134

  22. Javanmardi M, Tasdizen T (2018) Domain adaptation for biomedical image segmentation using adversarial training. In: IEEE 15th international symposium on biomedical imaging (ISBI 2018). IEEE, pp 554–558

  23. Kaya B, Goceri E, Becker A, Elder B, Puduvalli V, Winter J, Gurcan M, Otero JJ (2017) Automated fluorescent miscroscopic image analysis of ptbp1 expression in glioma. PloS One 12(3):1

    Article  Google Scholar 

  24. Li P, Liang X, Jia D, Xing EP (2018) Semantic-aware grad-gan for virtual-to-real urban scene adaption. arXiv preprint arXiv:1801.01726

  25. Lim G, Cheng Y, Hsu W, Lee M (2015) Integrated optic disc and cup segmentation with deep learning. In: ICTAI. IEEE, pp 162–169

  26. Long J, Shelhamer E, Darrell T (2015) Fully convolutional networks for semantic segmentation. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 3431–3440

  27. Orlando JI, Fu H, Breda JB, van Keer K, Bathula DR, Diaz-Pinto A, Fang R, Heng P-A, Kim J, Lee JH et al (2020) REFUGE Challenge: A unified framework for evaluating automated methods for glaucoma assessment from fundus photographs. Med Image Anal 59:101570

    Article  Google Scholar 

  28. Petzka H, Fischer A, Lukovnicov D (2017) On the regularization of wasserstein gans. arXiv preprint arXiv:1709.08894

  29. Ronneberger O, Fischer P, Brox T (2015) U-net: Convolutional networks for biomedical image segmentation. In: International conference on Medical image computing and computer-assisted intervention. Springer, pp 234–241

  30. Shen J, Qu Y, Zhang W, Yu Y (2017) Wasserstein distance guided representation learning for domain adaptation. arXiv preprint arXiv:1707.01217

  31. Sivaswamy J, Krishnadas S, Chakravarty A, Joshi G, Tabish A (2015) A comprehensive retinal image dataset for the assessment of glaucoma from the optic nerve head analysis. JSM Biomed Imaging Data Pap 2(1):1004

    Google Scholar 

  32. Sivaswamy J, Krishnadas S, Joshi G, Jain M, Tabish A (2014) Drishti-gs: retinal image dataset for optic nerve head (onh) segmentation. In: ISBI. IEEE, pp 53–56

  33. Syc S, Warner C, Saidha S, Farrell S, Conger A, Bisker E, Wilson J, Frohman T, Frohman E, Balcer L, Pa C (2011) Cup to disc ratio by optical coherence tomography is abnormal in multiple sclerosis. J Neurol Sci 302(1–2):19–24

    Article  CAS  Google Scholar 

  34. Tsai YH, Hung WC, Schulter S, Sohn K, Yang MH, Chandraker M (2018) Learning to adapt structured output space for semantic segmentation. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 7472–7481

  35. Tzeng E, Hoffman J, Saenko K, Darrell T (2017) Adversarial discriminative domain adaptation. In: CVPR. IEEE, pp 2962–2971

  36. Tzeng E, Hoffman J, Zhang N, Saenko K, Darrell T (2014) Deep domain confusion: maximizing for domain invariance. arXiv preprint arXiv:1412.3474

  37. Wang S, Yu L, Yang X, Fu CW, Heng PA (2019) Patch-based output space adversarial learning for joint optic disc and cup segmentation. IEEE Trans Med Imaging 38(11):2485–2495

    Article  Google Scholar 

  38. Wang Z, Dong N, Dai W, Rosario S, Xing E (2018) Classification of breast cancer histopathological images using convolutional neural networks with hierarchical loss and global pooling. In: ICIAR. Springer, pp 745–753

  39. Wang Z, Dong N, Rosario SD, Xu M, Xie P, Xing EP (2019) Ellipse detection of optic disc-and-cup boundary in fundus images. In: IEEE 16th international symposium on biomedical imaging (ISBI 2019). IEEE, pp 601–604

Download references

Author information

Author notes

  1. Shreya Kadambi and Zeya Wang have contributed equally to this work.

Authors and Affiliations

  1. Petuum Inc., Pittsburgh, PA, 15222, USA

    Shreya Kadambi, Zeya Wang & Eric Xing

Authors
  1. Shreya Kadambi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Zeya Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Eric Xing
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Zeya Wang.

Ethics declarations

Conflict of interest

All the authors declare that they have no conflict of interest.

Ethical approval

This article does not contain any studies with human participants or animals performed by any of the authors.

Informed consent

This articles does not contain patient data.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kadambi, S., Wang, Z. & Xing, E. WGAN domain adaptation for the joint optic disc-and-cup segmentation in fundus images. Int J CARS 15, 1205–1213 (2020). https://doi.org/10.1007/s11548-020-02144-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11548-020-02144-9

Keywords

Search

Navigation