Abstract
Retinal edema area, which can be observed in the non-invasive optical coherence tomography image, is essential for the diagnosis and treatment of many retinal diseases. Due to the demand of professional knowledge for its annotation, acquiring sufficient labeled data for the usual data-driven learning-based approaches is time-consuming and laborious. To alleviate the intensive workload for manual labeling, unsupervised learning technique has been widely explored and adopted in different applications. However, the corresponding research in medical image segmentation is still limited and the performance is unsatisfactory. In this paper, we propose a novel unsupervised segmentation framework, which consists of two stages: the image-level clustering to group images into different categories and the pixel-level segmentation which leverages the guidance of the clustering network. Based on the observation that smaller lesions are more obvious on large scale images with detail texture information and larger lesions are easier to capture on small scale images for the large field-of-view, we introduce multiscale information into both stages through a scale-invariant regularization and a multiscale Class Activation Map (CAM) fusing strategy, respectively. Experiments on the public retinal dataset show that the proposed framework achieves a 76.28% Dice score without any supervision, which outperforms state-of-the-art unsupervised approaches by a large margin (more than 20% improvement in Dice score).
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Chen, C.W., Luo, J., Parker, K.J.: Image segmentation via adaptive K-mean clustering and knowledge-based morphological operations with biomedical applications. IEEE Trans. Image Process. 7(12), 1673–1683 (1998)
Chen, J., Frey, E.C.: Medical image segmentation via unsupervised convolutional neural network. In: Proceedings of the International Conference on Medical Imaging with Deep Learning (2020)
Girish, G., Thakur, B., Chowdhury, S.R., Kothari, A.R., Rajan, J.: Segmentation of intra-retinal cysts from optical coherence tomography images using a fully convolutional neural network model. IEEE J. Biomed. Health Inform. 23(1), 296–304 (2018)
Gulrajani, I., Ahmed, F., Arjovsky, M., Dumoulin, V., Courville, A.: Improved training of Wasserstein GANs. In: Advances in Neural Information Processing Systems, pp. 5769–5779 (2017)
He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)
Hee, M.R., et al.: Optical coherence tomography of the human retina. Arch. Ophthalmol. 113(3), 325–332 (1995)
Hu, K., Shen, B., Zhang, Y., Cao, C., Xiao, F., Gao, X.: Automatic segmentation of retinal layer boundaries in OCT images using multiscale convolutional neural network and graph search. Neurocomputing 365, 302–313 (2019)
Isensee, F., Jaeger, P.F., Kohl, S.A., Petersen, J., Maier-Hein, K.H.: nnU-Net: a self-configuring method for deep learning-based biomedical image segmentation. Nat. Methods 18(2), 203–211 (2021)
Ji, X., Henriques, J.F., Vedaldi, A.: Invariant information clustering for unsupervised image classification and segmentation. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 9865–9874 (2019)
Ji, Z., et al.: Beyond retinal layers: a large blob detection for subretinal fluid segmentation in SD-OCT images. In: Frangi, A.F., Schnabel, J.A., Davatzikos, C., Alberola-López, C., Fichtinger, G. (eds.) MICCAI 2018. LNCS, vol. 11071, pp. 372–380. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-00934-2_42
Joyce, T., Chartsias, A., Tsaftaris, S.A.: Deep multi-class segmentation without ground-truth labels. In: Proceedings of the International Conference on Medical Imaging with Deep Learning (2018)
Kanezaki, A.: Unsupervised image segmentation by backpropagation. In: IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 1543–1547 (2018)
Kass, M., Witkin, A., Terzopoulos, D.: Snakes: active contour models. Int. J. Comput. Vision 1(4), 321–331 (1988)
Liu, W., Sun, Y., Ji, Q.: MDAN-UNet: multi-scale and dual attention enhanced nested U-Net architecture for segmentation of optical coherence tomography images. Algorithms 13(3), 60 (2020)
Lu, D., et al.: Deep-learning based multiclass retinal fluid segmentation and detection in optical coherence tomography images using a fully convolutional neural network. Med. Image Anal. 54, 100–110 (2019)
Montuoro, A., Waldstein, S.M., Gerendas, B.S., Schmidt-Erfurth, U., Bogunović, H.: Joint retinal layer and fluid segmentation in OCT scans of eyes with severe macular edema using unsupervised representation and auto-context. Biomed. Opt. Express 8(3), 1874–1888 (2017)
Moriya, T., et al.: Unsupervised segmentation of 3D medical images based on clustering and deep representation learning. In: Medical Imaging 2018: Biomedical Applications in Molecular, Structural, and Functional Imaging, vol. 10578, p. 20. International Society for Optics and Photonics (2018)
Wu, J., et al.: Deep comprehensive correlation mining for image clustering. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 8150–8159 (2019)
Xia, X., Kulis, B.: W-Net: a deep model for fully unsupervised image segmentation. arXiv preprint arXiv:1711.08506 (2017)
Zhao, J., Lu, D., Ma, K., Zhang, Yu., Zheng, Y.: Deep image clustering with category-style representation. In: Vedaldi, A., Bischof, H., Brox, T., Frahm, J.-M. (eds.) ECCV 2020. LNCS, vol. 12359, pp. 54–70. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-58568-6_4
Acknowledgements
This work was funded by the Scientific and Technical Innovation 2030-‘New Generation Artificial Intelligence’ (No. 2020AAA0104100).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
1 Electronic supplementary material
Below is the link to the electronic supplementary material.
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Yuan, W., Lu, D., Wei, D., Ning, M., Zheng, Y. (2022). Multiscale Unsupervised Retinal Edema Area Segmentation in OCT Images. In: Wang, L., Dou, Q., Fletcher, P.T., Speidel, S., Li, S. (eds) Medical Image Computing and Computer Assisted Intervention – MICCAI 2022. MICCAI 2022. Lecture Notes in Computer Science, vol 13432. Springer, Cham. https://doi.org/10.1007/978-3-031-16434-7_64
Download citation
DOI: https://doi.org/10.1007/978-3-031-16434-7_64
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-16433-0
Online ISBN: 978-3-031-16434-7
eBook Packages: Computer ScienceComputer Science (R0)
