Abstract
Due to the tedious and expensive nature of annotating data for medical image segmentation tasks, semi-supervised learning (SSL) methods utilizing a small amount of labeled data have gained widespread attention. However, most existing methods overlook the importance of boundary regions in multi-class tasks and are sensitive to incorrect pseudo-label. In this paper, a novel Dual-Cycled Boundary Refine Network (DCBR-Net) is presented, consisting of two simple yet slightly different segmentation networks and a Boundary Residual Refine (BRR) module. First, a new boundary refine method for the semi-supervised medical image segmentation field is designed, that is a BRR module with a residual architecture. This module is capable of enhancing the representation of boundaries while ensuring the quality of inner regions. Besides, a dual-cycled pseudo-label scheme is designed to train the unlabeled data. Through providing diverse outputs and achieving double supervision for the result, the issue of ineffective guidance caused by model consistency after multiple iterations is alleviated. Furthermore, a novel dynamic loss function is developed based on the prediction disagreement between different models, which can suppress the influence of incorrect pseudo-labels. Extensive experiments conducted on four public medical datasets demonstrate that our network can achieve competitive results, especially with higher reliability in boundary regions. On the ACDC, LA, and Fundus datasets, with only a 20% labeled ratio, our network achieves DSC scores of 90.53%, 90.40%, and 89.19%, respectively, which are comparable to fully supervised performance.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Code availability
Code availability not applicable.
References
He W, Zhang C, Dai J et al (2024) A statistical deformation model-based data augmentation method for volumetric medical image segmentation. Med Image Anal 91:102984. https://doi.org/10.1016/j.media.2023.102984
Liang X, Li N, Zhang Z et al (2021) Incorporating the hybrid deformable model for improving the performance of abdominal ct segmentation via multi-scale feature fusion network. Med Image Anal 73:102156. https://doi.org/10.1016/j.media.2021.102156
Chen Y, Ouyang X, Zhu K et al (2021) Complexmix: Semi-supervised semantic segmentation via mask-based data augmentation. In: 2021 IEEE International Conference on Image Processing (ICIP), pp 2264–2268. https://doi.org/10.1109/ICIP42928.2021.9506602
Ouali Y, Hudelot C, Tami M (2020) Semi-supervised semantic segmentation with cross-consistency training. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). https://doi.org/10.1109/CVPR42600.2020.01269
An S, Zhu H, Zhang J et al (2022) Deep tri-training for semi-supervised image segmentation. IEEE Robot Autom Lett 7(4):10097–10104. https://doi.org/10.1109/LRA.2022.3185768
Tarvainen A, Valpola H (2017) Mean teachers are better role models: Weight-averaged consistency targets improve semi-supervised deep learning results. In: Neural information processing systems, pp 1195–1204. https://doi.org/10.48550/arXiv.1703.01780
Feng Z, Zhou Q, Gu Q et al (2022) Dmt: Dynamic mutual training for semi-supervised learning. Pattern Recognit 130:108777. https://doi.org/10.1016/j.patcog.2022.108777
Wang Z, Peng Y, Li D et al (2022) Mmnet: A multi-scale deep learning network for the left ventricular segmentation of cardiac mri images. Appl Intell 52(5):5225–5240. https://doi.org/10.1007/s10489-021-02720-9
Luo S, Zhang J, Xiao N et al (2022) Das-net: A lung nodule segmentation method based on adaptive dual-branch attention and shadow mapping. Appl Intell 52(13):15617–15631. https://doi.org/10.1007/s10489-021-03038-2
Yang X, Chen Y, Yue X et al (2022) Local linear embedding based interpolation neural network in pancreatic tumor segmentation. Appl Intell 52(8):8746–8756. https://doi.org/10.1007/s10489-021-02847-9
Wu Y, Xu M, Ge Z et al (2021) Semi-supervised left atrium segmentation with mutual consistency training. In: Medical image computing and computer assisted intervention–MICCAI 2021: 24th international conference, Strasbourg, France, September 27–October 1, 2021, Proceedings, Part II 24, pp 297–306. https://doi.org/10.48550/arXiv.2103.02911
Zheng H, Lin L, Hu H et al (2019) Semi-supervised segmentation of liver using adversarial learning with deep atlas prior. In: Medical Image Computing and Computer Assisted Intervention–MICCAI 2019: 22nd International Conference, Shenzhen, China, October 13–17, 2019, Proceedings, Part VI 22, pp 148–156. https://doi.org/10.1007/978-3-030-32226-7_17
He Y, Yang G, Chen Y et al (2019) Dpa-densebiasnet: Semi-supervised 3d fine renal artery segmentation with dense biased network and deep priori anatomy. In: Medical Image Computing and Computer Assisted Intervention–MICCAI 2019: 22nd International Conference, Shenzhen, China, October 13–17, 2019, Proceedings, Part VI 22, pp 139–147. https://doi.org/10.1007/978-3-030-32226-7_16
Zhang Y, Zhang J (2021) Dual-task mutual learning for semi-supervised medical image segmentation. In: Pattern recognition and computer vision: 4th Chinese Conference, PRCV 2021, Beijing, China, October 29–November 1, 2021, Proceedings, Part III 4, pp 548–559
Luo X, Chen J, Song T et al (2021) Semi-supervised medical image segmentation through dual-task consistency. In: Proceedings of the AAAI conference on artificial intelligence, pp 8801–8809. https://doi.org/10.1609/aaai.v35i10.17066
Chen X, Yuan Y, Zeng G et al (2021) Semi-supervised semantic segmentation with cross pseudo supervision. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 2613–2622
Qin X, Zhang Z, Huang C et al (2019) Basnet: Boundary-aware salient object detection. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 7479–7489
Ronneberger O, Fischer P, Brox T (2015) U-net: Convolutional networks for biomedical image segmentation. In: Medical Image Computing and Computer-Assisted Intervention–MICCAI 2015: 18th International Conference, Munich, Germany, October 5-9, 2015, Proceedings, Part III 18, pp 234–241. https://doi.org/10.1007/978-3-319-24574-4_28
He K, Gkioxari G, Dollár P et al (2017) Mask r-cnn. In: Proceedings of the IEEE international conference on computer vision, pp 2961–2969. https://doi.org/10.1109/TPAMI.2018.2844175
Chen LC, Zhu Y, Papandreou G et al (2018) Encoder-decoder with atrous separable convolution for semantic image segmentation. In: Proceedings of the European Conference on Computer Vision (ECCV), pp 801–818
Chu P, Li Z, Lammers K et al (2021) Deep learning-based apple detection using a suppression mask r-cnn. Pattern Recognit Lett 147:206–211. https://doi.org/10.1016/j.patrec.2021.04.022
Tian Y, Yang G, Wang Z et al (2020) Instance segmentation of apple flowers using the improved mask r-cnn model. Biosyst Eng 193:264–278. https://doi.org/10.1016/j.biosystemseng.2020.03.008
Lin Z, He Z, Wang X et al (2024) DBGANet: dual-branch geometric attention network for accurate 3d tooth segmentation. IEEE Trans Circ Syst Video Technol 34(6):4285–4298. https://doi.org/10.1109/TCSVT.2023.3331589
Wang K, Zhang X, Lu Y et al (2023) GSAL: Geometric structure adversarial learning for robust medical image segmentation. Pattern Recognit 140:109596. https://doi.org/10.1016/j.patcog.2023.109596
Lin Y, Zhang D, Fang X et al (2023) Rethinking boundary detection in deep learning models for medical image segmentation. In: International conference on information processing in medical imaging, pp 730–742
Xie Q, Dai Z, Hovy E et al (2020) Unsupervised data augmentation for consistency training. Adv Neural Inf Process Syst 33:6256–6268
Sohn K, Berthelot D, Carlini N et al (2020) Fixmatch: Simplifying semi-supervised learning with consistency and confidence. Adv Neural Inf Process Syst 33:596–608. https://doi.org/10.48550/arXiv.2001.07685
Yang L, Qi L, Feng L et al (2023) Revisiting weak-to-strong consistency in semi-supervised semantic segmentation. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 7236–7246
Weng Z, Yang X, Li A et al (2022) Semi-supervised vision transformers. In: European conference on computer vision, pp 605–620
Vaswani A, Shazeer N, Parmar N et al (2017) Attention is all you need. Adv Neural Inf Process Syst 30:6000–6010. https://doi.org/10.48550/arXiv.1706.03762
Yang L, Zhuo W, Qi L et al (2022) St++: Make self-training work better for semi-supervised semantic segmentation. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 4268–4277. https://doi.org/10.48550/arXiv.2106.05095
Yuan J, Liu Y, Shen C et al (2021) A simple baseline for semi-supervised semantic segmentation with strong data augmentation. In: Proceedings of the IEEE/CVF international conference on computer vision, pp 8229–8238. https://doi.org/10.48550/arXiv.2104.07256
Zhang Y, Xiang T, Hospedales TM et al (2018) Deep mutual learning. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 4320–4328. https://doi.org/10.1109/CVPR.2018.00454
Li X, Yu L, Chen H et al (2021) Transformation-consistent self-ensembling model for semisupervised medical image segmentation. IEEE Trans Neural Netw Learn Syst 32(2):523–534. https://doi.org/10.1109/TNNLS.2020.2995319
Li X, Yu L, Chen H et al (2020) Transformation-consistent self-ensembling model for semisupervised medical image segmentation. IEEE Trans Neural Netw Learn Syst 32(2):523–534. https://doi.org/10.1109/TNNLS.2020.2995319
Yu L, Wang S, Li X et al (2019) Uncertainty-aware self-ensembling model for semi-supervised 3d left atrium segmentation. In: Medical Image Computing and Computer Assisted Intervention–MICCAI 2019: 22nd International Conference, Shenzhen, China, October 13–17, 2019, Proceedings, Part II 22, pp 605–613. https://doi.org/10.1007/978-3-030-32245-8_67
Li S, Zhang C, He X (2020) Shape-aware semi-supervised 3d semantic segmentation for medical images. In: Medical Image Computing and Computer Assisted Intervention–MICCAI 2020: 23rd International Conference, Lima, Peru, October 4–8, 2020, Proceedings, Part I 23, pp 552–561. https://doi.org/10.1007/978-3-030-59710-8_54
You C, Zhou Y, Zhao R et al (2022) Simcvd: Simple contrastive voxel-wise representation distillation for semi-supervised medical image segmentation. IEEE Trans Med Imaging 41(9):2228–2237. https://doi.org/10.1109/TMI.2022.3161829
Shi Y, Zhang J, Ling T et al (2021) Inconsistency-aware uncertainty estimation for semi-supervised medical image segmentation. IEEE Trans Med Imaging 41(3):608–620. https://doi.org/10.1109/TMI.2021.3117888
Wu Y, Wu Z, Wu Q et al (2022) Exploring smoothness and class-separation for semi-supervised medical image segmentation. In: International conference on medical image computing and computer-assisted intervention, pp 34–43. https://doi.org/10.1007/978-3-031-16443-9_4
Bai Y, Chen D, Li Q et al (2023) Bidirectional copy-paste for semi-supervised medical image segmentation. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 11514–11524
Peng C, Zhang X, Yu G et al (2017) Large kernel matters–improve semantic segmentation by global convolutional network. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 4353–4361
Ke Z, Qiu D, Li K et al (2020) Guided collaborative training for pixel-wise semi-supervised learning. In: Computer vision–ECCV 2020: 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part XIII 16, pp 429–445. https://doi.org/10.1007/978-3-030-58601-0_26
Woo S, Park J, Lee JY et al (2018) Cbam: Convolutional block attention module. In: Proceedings of the European conference on computer vision (ECCV), pp 3–19
Bernard O, Lalande A, Zotti C et al (2018) Deep learning techniques for automatic mri cardiac multi-structures segmentation and diagnosis: is the problem solved? IEEE Trans Med Imaging 37(11):2514–2525. https://doi.org/10.1109/TMI.2018.2837502
Xiong Z, Xia Q, Hu Z et al (2021) A global benchmark of algorithms for segmenting the left atrium from late gadolinium-enhanced cardiac magnetic resonance imaging. Med Image Anal 67:101832. https://doi.org/10.1016/j.media.2020.101832
Milletari F, Navab N, Ahmadi SA (2016) V-net: Fully convolutional neural networks for volumetric medical image segmentation. In: 2016 fourth international conference on 3D vision (3DV), pp 565–571. https://doi.org/10.1109/3DV.2016.79
Fumero F, Alayón S, Sanchez JL et al (2011) Rim-one: An open retinal image database for optic nerve evaluation. In: 2011 24th international symposium on computer-based medical systems (CBMS), pp 1–6. https://doi.org/10.1109/CBMS.2011.5999143
Orlando JI, Fu H, Breda JB et al (2020) Refuge challenge: A unified framework for evaluating automated methods for glaucoma assessment from fundus photographs. Med Image Anal 59:101570. https://doi.org/10.1016/j.media.2019.101570
Wang K, Xu M, Wang Q et al (2022) Tumor detection, segmentation, and classification challenge on automated 3d breast ultrasound. In: 26th International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI 2023). https://doi.org/10.5281/zenodo.6362504
Luo X, Wang G, Liao W et al (2022) Semi-supervised medical image segmentation via uncertainty rectified pyramid consistency. Med Image Anal 80:102517. https://doi.org/10.1016/j.media.2022.102517
Lu L, Yin M, Fu L et al (2023) Uncertainty-aware pseudo-label and consistency for semi-supervised medical image segmentation. Biomed Signal Process Control 79:104203. https://doi.org/10.1016/j.bspc.2022.104203
Wang Y, Xiao B, Bi X et al (2023) Mcf: Mutual correction framework for semi-supervised medical image segmentation. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 15651–15660
Campello VM, Gkontra P, Izquierdo C et al (2021) Multi-centre, multi-vendor and multi-disease cardiac segmentation: the M &Ms challenge. IEEE Trans Med Imaging 40:3543–3554. https://doi.org/10.1109/TMI.2021.3090082
Acknowledgements
The work was supported in part by the National Natural Science Foundation of China (No. 62272027), and the Beijing Natural Science Foundation (No. 4232012).
Author information
Authors and Affiliations
Contributions
Xiaochen Ma: Conceptualization, Methodology, Software, Writing-Original draft preparation. Yanfeng Li: Conceptualization, Resources, Supervision, Writing-Reviewing and Editing. Jia Sun: Conceptualization, Supervision, Writing-Reviewing and Editing. Houjin Chen: Conceptualization, Supervision, Writing-Reviewing and Editing. Yihan Ren: Conceptualization, Supervision, Writing-Reviewing and Editing. Ziwei Chen: Conceptualization, Supervision, Writing-Reviewing and Editing.
Corresponding author
Ethics declarations
Conflict of interest
The authors have no competing interests to declare that are relevant to the content of this article.
Ethics approval
Not applicable.
Consent to participate
Not applicable.
Consent for publication
Not applicable.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Ma, X., Li, Y., Sun, J. et al. Exploring refined boundaries and accurate pseudo-labels for semi-supervised medical image segmentation. Appl Intell 55, 246 (2025). https://doi.org/10.1007/s10489-024-06222-2
Accepted:
Published:
DOI: https://doi.org/10.1007/s10489-024-06222-2