Zhongwei Yang
ABSTRACT
Multi-organ segmentation from abdominal CT images plays a vital role in clinical practice. However, due to the low contrast of soft tissues in CT images and the significant differences in the shape and appearance of organs, this is a challenging task. In this paper, we propose a two-stage framework based on multi-view fusion to solve this challenge. Specifically, the first stage is to segment the organs in the original abdominal CT image quickly. Based on this, we introduce anatomical knowledge to robustly extract the image region of a single organ. Then, inspired by the clinician's image reading, the organ image blocks from three views are used as the input of the second stage network, and the features from different views are adaptively fused to output accurate segmentation results. We conduct extensive experiments on a public CT dataset, and the experimental results show that our method is accurate and robust to this challenging segmentation task.
- Van Ginneken B, Schaefer-Prokop C M, Prokop M. 2011. Computer-aided diagnosis: how to move from the laboratory to the clinic. Journal of Radiology, 261(3), 719-732. https://doi.org/10.1148/radiol.11091710Google Scholar
Cross Ref
- Wolz R, Chu C, Misawa K, 2013. Automated abdominal multi-organ segmentation with subject-specific atlas generation. Journal of IEEE transactions on medical imaging, 32(9), 1723-1730. https://doi.org/10.1109/TMI.2013.2265805Google ScholarCross Ref
- Yushkevich P A, Gao Y, Gerig G. 2016. ITK-SNAP: An interactive tool for semi-automatic segmentation of multi-modality biomedical images. 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). IEEE, 3342-3345. https://doi.org/10.1109/EMBC.2016.7591443Google ScholarCross Ref
- Wolz R, Chu C, Misawa K, 2012. Multi-organ abdominal CT segmentation using hierarchically weighted subject-specific atlases. International Conference on Medical Image Computing and Computer-Assisted Intervention. Springer, Berlin, Heidelberg, 10-17. https://doi.org/10.1007/978-3-642-33415-3_2Google ScholarDigital Library
- Cerrolaza J J, Reyes M, Summers R M, 2015. Automatic multi-resolution shape modeling of multi-organ structures. Journal of Medical image analysis, 25(1), 11-21. https://doi.org/10.1016/j.media.2015.04.003Google ScholarCross Ref
- Wang Y, Zhou Y, Shen W, 2019. Abdominal multi-organ segmentation with organ-attention networks and statistical fusion. Journal of Medical image analysis, 55: 88-102. https://doi.org/10.1016/j.media.2019.04.005Google ScholarCross Ref
- Gibson E, Giganti F, Hu Y, Bonmati E, Bandula S, Gurusamy K, Barratt D C, 2018. Automatic multi-organ segmentation on abdominal CT with dense V-networks. IEEE transactions on medical imaging, 37(8), 1822-1834. https://doi.org/10.1109/TMI.2018.2806309Google Scholar
- Liang X, Li N, Zhang Z, 2021. Incorporating the hybrid deformable model for improving the performance of abdominal CT segmentation via multi-scale feature fusion network. Journal of Medical Image Analysis, 73: 102156. https://doi.org/10.1016/j.media.2021.102156Google ScholarCross Ref
- Shi G, Xiao L, Chen Y, 2021. Marginal loss and exclusion loss for partially supervised multi-organ segmentation. Journal of Medical Image Analysis, 70: 101979. https://doi.org/10.1016/j.media.2021.101979Google ScholarCross Ref
- Fang X, Yan P. 2020. Multi-organ segmentation over partially labeled datasets with multi-scale feature abstraction. Journal of IEEE Transactions on Medical Imaging, 39(11): 3619-3629. https://doi.org/10.1109/TMI.2020.3001036Google ScholarCross Ref
- Li X, Chen H, Qi X, 2018. H-DenseUNet: hybrid densely connected UNet for liver and tumor segmentation from CT volumes. Journal of IEEE transactions on medical imaging, 37(12): 2663-2674. https://doi.org/10.1109/TMI.2018.2845918Google ScholarCross Ref
- Lei Y, Fu Y, Wang T, 2020. Deep learning in multi-organ segmentation. arXiv preprint arXiv: 2001.10619. https://arxiv.org/abs/2001.10619v1Google Scholar
- Ronneberger O, Fischer P, Brox T. 2015. U-net: Convolutional networks for biomedical image segmentation. International Conference on Medical image computing and computer-assisted intervention. Springer, Cham, 234-241. https://doi.org/10.1007/978-3-319-24574-4_28Google ScholarCross Ref
- Landman B, Xu Z, Igelsias J, Styner M, Langerak T, Klein A. 2015. Miccai multi-atlas labeling beyond the cranial vault-workshop and challenge. In Proceedings of MICCAI Multi-Atlas Labeling Beyond Cranial Vault—Workshop Challenge. https://www.synapse.org/#!Synapse:syn3193805/wiki/Google Scholar
- Zhang H, Goodfellow I, Metaxas D, 2019. Self-attention generative adversarial networks. International conference on machine learning. PMLR, 7354-7363. https://arxiv.org/abs/1805.08318v2Google Scholar
- Paszke A, Gross S, Chintala S, 2017. Automatic differentiation in pytorch. https://openreview.net/forum?id=BJJsrmfCZGoogle Scholar
- Çiçek Ö, Abdulkadir A, Lienkamp S S, 2016. 3D U-Net: learning dense volumetric segmentation from sparse annotation. International conference on medical image computing and computer-assisted intervention. Springer, Cham, 424-432. https://doi.org/10.1007/978-3-319-46723-8_49Google ScholarDigital Library
- Kumar H, DeSouza S V, Petrov M S. 2019. Automated pancreas segmentation from computed tomography and magnetic resonance images: a systematic review. Journal of Computer methods and programs in biomedicine, 178: 319-328. https://doi.org/10.1016/j.cmpb.2019.07.002Google ScholarDigital Library
- Roth H R, Oda H, Hayashi Y, 2017. Hierarchical 3D fully convolutional networks for multi-organ segmentation. arXiv preprint arXiv:1704.06382. https://arxiv.org/abs/1704.06382Google Scholar
- Zhou Y, Xie L, Shen W, 2017. A fixed-point model for pancreas segmentation in abdominal CT scans. International conference on medical image computing and computer-assisted intervention. Springer, Cham, 693-701. https://doi.org/10.1007/978-3-319-66182-7_79Google ScholarDigital Library
Recommendations
Towards Image-Guided Pancreas and Biliary Endoscopy: Automatic Multi-organ Segmentation on Abdominal CT with Dense Dilated Networks
Medical Image Computing and Computer Assisted Intervention − MICCAI 2017AbstractSegmentation of anatomy on abdominal CT enables patient-specific image guidance in clinical endoscopic procedures and in endoscopy training. Because robust interpatient registration of abdominal images is necessary for existing multi-atlas- and ...
Multi-view fusion segmentation for brain glioma on CT images
AbstractComputed tomography (CT) images of the brain aid the radiotherapy of glioma. The identification and contouring of the gross tumor volume (GTV) are important for radiotherapy. However, manual segmenting GTV is time-consuming, exhausting, and ...
Multiple Abdominal Organ Segmentation: An Atlas-Based Fuzzy Connectedness Approach
Organ segmentation is an important step in various medical image applications. In this paper, a presegmented atlas is incorporated into the fuzzy connectedness (FC) framework for automatic segmentation of abdominal organs. First, the atlas is registered ...
Comments