Abstract
Optic disc (OD) and optic cup (OC) segmentation are important steps for automatic screening and diagnosing of optic nerve head abnormalities such as glaucoma. Many recent works formulated the OD and OC segmentation as a pixel classification task. However, it is hard for these methods to explicitly model the spatial relations between the labels in the output mask. Furthermore, the proportion of the background, OD and OC are unbalanced which also may result in a biased model as well as introduce more noise. To address these problems, we developed an approach that follows a coarse-to-fine segmentation process. We start with a U-Net to obtain a rough segmenting boundary and then crop the area around the boundary to form a boundary contour centered image. Second, inspired by sequence labeling tasks in natural language processing, we regard the OD and OC segmentation as a sequence labeling task and propose a novel fully convolutional network called SU-Net and combine it with the Viterbi algorithm to jointly decode the segmentation boundary. We also introduced a geometric parameter-based data augmentation method to generate more training samples in order to minimize the differences between training and test sets and reduce overfitting. Experimental results show that our method achieved state-of-the-art results on 2 datasets for both OD and OC segmentation and our method outperforms most of the ophthalmologists in terms of achieving agreement out of 6 ophthalmologists on the MESSIDOR dataset for both OD and OC segmentation. In terms of glaucoma screening, we achieved the best cup-to-disc ratio (CDR) error and area under the ROC curve (AUC) for glaucoma classification on the Drishti-GS dataset.
Similar content being viewed by others
References
Sadun A. A, Wang M. Y (2011) Abnormalities of the optic disc
Gagnon L, Lalonde M, Beaulieu M, Boucher M. C (2001) Procedure to detect anatomical structures in optical fundus images. In: Medical imaging 2001: Image processing. Pp 1218–1225
Sevastopolsky, A., Optic disc and cup segmentation methods for glaucoma detection with modification of U-net convolutional neural network. Pattern Recognit Image Anal. 27(3):618–624, 2017. https://doi.org/10.1134/S1054661817030269.
Murthy V, Shankar M, Lin J, Lieu S, Patel M, Post H, Murthy H, Liu BJ (2019) Fundus Analysis Software Tool (FAST): development of software integrating CAD with the EHR for the longitudinal study of fundus images. In: Proc. SPIE 10954, Medical Imaging 2019: Imaging informatics for healthcare, Research, and Applications
Fu, H., Cheng, J., Xu, Y., Wong, D. W. K., Liu, J., and Cao, X., Joint optic disc and cup segmentation based on multi-label deep network and polar transformation. IEEE Trans Med Imaging., 2018. https://doi.org/10.1109/TMI.2018.2791488.
Chakravarty, A., and Sivaswamy, J., Joint optic disc and cup boundary extraction from monocular fundus images. Computer Methods and Programs in Biomedicine, 2017. https://doi.org/10.1016/j.cmpb.2017.06.004.
Liu, Q., Hong, X., Li, S., Chen, Z., Zhao, G., and Zou, B., A spatial-aware joint optic disc and cup segmentation method. Neurocomputing, 2019. https://doi.org/10.1016/j.neucom.2019.05.039.
Ronneberger O, Fischer P, Brox T (2015) U-net: Convolutional networks for biomedical image segmentation. In: Lecture notes in computer science (including subseries lecture notes in artificial intelligence and lecture notes in bioinformatics)
Dauphin Y. N, Fan A, Auli M, Grangier D (2017) Language modeling with gated convolutional networks. In: 34th international conference on machine learning, ICML 2017
Yu F, Koltun V (2016) Multi-scale context aggregation by dilated convolutions. In: 4th international conference on learning representations, ICLR 2016 - conference track proceedings
Aquino, A., Gegúndez-Arias, M. E., and Marín, D., Detecting the optic disc boundary in digital fundus images using morphological, edge detection, and feature extraction techniques. IEEE Trans Med Imaging., 2010. https://doi.org/10.1109/TMI.2010.2053042.
Giachetti A, Ballerini L, Trucco E (2014) Accurate and reliable segmentation of the optic disc in digital fundus images. J Med Imaging. https://doi.org/10.1117/1.jmi.1.2.024001
Pallawala P. M. D. S, Hsu W, Lee M. L, Eong K. G. A (2004) Automated optic disc localization and contour detection using ellipse fitting and wavelet transform. Lect Notes Comput Sci (including Subser Lect Notes Artif Intell Lect Notes Bioinformatics). https://doi.org/10.1007/978-3-540-24671-8_11
Zhu X, Rangayyan R. M (2008) Detection of the optic disc in images of the retina using the Hough transform. In: Proceedings of the 30th annual international conference of the IEEE engineering in medicine and biology society, EMBS’08 - “personalized healthcare through technology”
Almazroa A, Alodhayb S, Raahemifar K, Lakshminarayanan V (2017) Optic cup segmentation: Type-II fuzzy thresholding approach and blood vessel extraction. Clin Ophthalmol. https://doi.org/10.2147/OPTH.S117157
Lalonde M, Beaulieu M, Gagnon L (2001) Fast and robust optic disc detection using pyramidal decomposition and hausdorff-based template matching. IEEE Trans Med Imaging. https://doi.org/10.1109/42.963823
Dashtbozorg, B., Mendonça, A. M., and Campilho, A., Optic disc segmentation using the sliding band filter. Comput Biol Med., 2015. https://doi.org/10.1016/j.compbiomed.2014.10.009.
Osareh A (2004) Automated identification of diabetic retinal exudates and the optic disc
Dehghani, A., Moghaddam, H. A., and Moin, M. S., Optic disc localization in retinal images using histogram matching. Eurasip J Image Video Process. 2012(1):1–11, 2012. https://doi.org/10.1186/1687-5281-2012-19.
Barrett S. F, Naess E, Molvik T (2001) Employing the hough transform to locate the optic disk. In: Biomedical Sciences Instrumentation
Chrástek R, Wolf M, Donath K, Niemann H, Paulus D, Hothorn T, Lausen B, Lämmer R, Mardin C. Y, Michelson G (2005) Automated segmentation of the optic nerve head for diagnosis of glaucoma. Med Image Anal. https://doi.org/10.1016/j.media.2004.12.004
Mendels F, Heneghan C, Thiran J. P (1999) Identification of the optic disk boundary in retinal images using active contours. Proc Irish Mach Vis Image Process Conf
Sedai S, Roy P. K, Mahapatra D, Garnavi R (2016) Segmentation of optic disc and optic cup in retinal fundus images using shape regression. In: Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS
Hatanaka Y, Nagahata Y, Muramatsu C, Okumura S, Ogohara K, Sawada A, Ishida K, Yamamoto T, Fujita H (2014) Improved automated optic cup segmentation based on detection of blood vessel bends in retinal fundus images. In: 2014 36th annual international conference of the IEEE engineering in medicine and biology society, EMBC 2014
Haleem M. S, Han L, van Hemert J, Li B, Fleming A, Pasquale L. R, Song B. J (2018) A novel adaptive deformable model for automated optic disc and cup segmentation to aid Glaucoma diagnosis. Journal of Medical Systems https://doi.org/10.1007/s10916-017-0859-4, 42, 1, 1, 18
Joshi, G. D., Sivaswamy, J., and Krishnadas, S. R., Optic disk and cup segmentation from monocular color retinal images for glaucoma assessment. IEEE Trans Med Imaging., 2011. https://doi.org/10.1109/TMI.2011.2106509.
Cootes T. F, Taylor C. J, Cooper DH, Graham J (1995) Active shape models - their training and application. Comput Vis Image Underst. https://doi.org/10.1006/cviu.1995.1004
Li H, Chutatape O (2003) Boundary detection of optic disk by a modified ASM method. Pattern Recognit. https://doi.org/10.1016/S0031-3203(03)00052-9
Yin F, Liu J, Ong S. H, Sun Y, Wong D. W. K, Tan N. M, Cheung C, Baskaran M, Aung T, Wong T. Y (2011) Model-based optic nerve head segmentation on retinal fundus images. In: Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS
Hamednejad G, Pourghassem H (2017) Retinal optic disk segmentation and analysis in fundus images using DBSCAN clustering algorithm. In: 2016 23rd Iranian conference on biomedical engineering and 2016 1st international Iranian conference on biomedical engineering, ICBME 2016
Khalid N. E. A, Noor N. M, Ariff N. M (2014) Fuzzy c-means (FCM) for optic cup and disc segmentation with morphological operation. In: Procedia Computer Science
Thakur, N., and Juneja, M., Optic disc and optic cup segmentation from retinal images using hybrid approach. Expert Systems with Applications 127:308–322, 2019.
Joshi G. D, Sivaswamy J, Krishnadas S. R (2012) Depth discontinuity-based cup segmentation from multiview color retinal images. IEEE Trans Biomed Eng. https://doi.org/10.1109/TBME.2012.2187293
Cheng J, Liu J, Xu Y, Yin F, Wong D. W. K, Tan N. M, Tao D, Cheng C. Y, Aung T, Wong T. Y (2013) Superpixel classification based optic disc and optic cup segmentation for glaucoma screening. IEEE Trans Med Imaging. https://doi.org/10.1109/TMI.2013.2247770
Xu Y, Duan L, Lin S, Chen X, Wong D. W. K, Wong T. Y, Liu J (2014) Optic cup segmentation for glaucoma detection using low-rank superpixel representation. In: Lecture notes in computer science (including subseries lecture notes in artificial intelligence and lecture notes in bioinformatics)
Tan N. M, Xu Y, Goh W. B, Liu J (2015) Robust multi-scale superpixel classification for optic cup localization. Comput Med Imaging Graph. https://doi.org/10.1016/j.compmedimag.2014.10.002
Krizhevsky A, Sutskever I, Hinton G. E (2017) ImageNet classification with deep convolutional neural networks. Commun ACM. https://doi.org/10.1145/3065386
Simonyan K, Zisserman A (2015) Very deep convolutional networks for large-scale image recognition. In: 3rd international conference on learning representations, ICLR 2015 - conference track proceedings
Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Erhan D, Vanhoucke V, Rabinovich A (2015) Going deeper with convolutions. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition
Long J, Shelhamer E, Darrell T (2015) Fully convolutional networks for semantic segmentation. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition
Chen L. C, Papandreou G, Kokkinos I, Murphy K, Yuille A. L (2018) DeepLab: Semantic image segmentation with deep convolutional nets, Atrous convolution, and fully connected CRFs. IEEE Trans Pattern Anal Mach Intell. https://doi.org/10.1109/TPAMI.2017.2699184
Chen L. C, Zhu Y, Papandreou G, Schroff F, Adam H (2018) Rethinking Atrous convolution for semantic image segmentation. arXiv.org. https://doi.org/10.1159/000018039
Zhao H, Shi J, Qi X, Wang X, Jia J (2017) Pyramid scene parsing network. In: Proceedings - 30th IEEE conference on computer vision and pattern recognition, CVPR 2017
Muramatsu C, Nakagawa T, Sawada A, Hatanaka Y, Hara T, Yamamoto T, Fujita H (2009) Determination of cup-to-disc ratio of optical nerve head for diagnosis of glaucoma on stereo retinal fundus image pairs. In: Medical imaging 2009: Computer-aided diagnosis
Zahoor M. N, Fraz M. M (2017) Fast optic disc segmentation in retina using polar transform. IEEE Access. https://doi.org/10.1109/ACCESS.2017.2723320
Zuiderveld K (1994) Contrast limited adaptive histogram equalization. In: Graphics Gems
Shankaranarayana S. M, Ram K, Mitra K, Sivaprakasam M (2017) Joint optic disc and cup segmentation using fully convolutional and adversarial networks. In: Lecture notes in computer science (including subseries lecture notes in artificial intelligence and lecture notes in bioinformatics)
Singh V. K, Rashwan H. A, Akram F, Pandey N, Sarker M. M. K, Saleh A, Abdulwahab S, Maaroof N, Barrena J. T, Romani S, Puig D (2018) Retinal optic disc segmentation using conditional generative adversarial network. In: Frontiers in Artificial Intelligence and Applications
Jiang Y, Tan N, Peng T (2019) Optic disc and cup segmentation based on deep convolutional generative adversarial networks. IEEE Access. https://doi.org/10.1109/ACCESS.2019.2917508
Wang S, Yu L, Yang X, Fu C. W, Heng P. A (2019) Patch-based output space adversarial learning for joint optic disc and cup segmentation. IEEE Trans Med Imaging. https://doi.org/10.1109/TMI.2019.2899910
Gehring J, Auli M, Grangier D, Yarats D, Dauphin Y. N (2017) Convolutional sequence to sequence learning. In: 34th international conference on machine learning, ICML 2017
Decencière E, Zhang X, Cazuguel G, Laÿ B, Cochener B, Trone C, Gain P, Ordóñez-Varela J. R, Massin P, Erginay A, Charton B, Klein JC (2014) Feedback on a publicly distributed image database: The Messidor database. Image Anal Stereol. https://doi.org/10.5566/ias.1155
Sivaswamy J, Krishnadas S. R, Joshi G. D, Ujjwal M. J, Tabish S (2014) Drishti-GS: Retinal image dataset for optic nerve head (ONH) segmentation. In: 2014 IEEE 11th international symposium on biomedical imaging, ISBI 2014
Almazroa A. A, Alodhayb S, Osman E, Ramadan E, Hummadi M, Dlaim M, Alkatee M, Raahemifar K, Lakshminarayanan V (2018) Retinal fundus images for glaucoma analysis: The RIGA dataset
He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition
Acknowledgements
Thanks to the University of Chinese Academy of Sciences, UCAS Joint PhD Training Program. This work was supported in part by the Ministry of Science and Technology of China under project 2017YFC0112902.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
The authors declare that they have no conflict of interest. This article does not contain any studies with human participants or animals performed by any of the authors.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
This article is part of the Topical Collection on Image & Signal Processing
Rights and permissions
About this article
Cite this article
Xie, Z., Ling, T., Yang, Y. et al. Optic Disc and Cup Image Segmentation Utilizing Contour-Based Transformation and Sequence Labeling Networks. J Med Syst 44, 96 (2020). https://doi.org/10.1007/s10916-020-01561-2
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s10916-020-01561-2