Abstract
U-net is a classic deep network framework in the field of biomedical image segmentation, which uses a U-shaped encoder and decoder structure to realize the recognition and segmentation of semantic features, but only uses the last layer of the decoder structure for the final prediction, ignoring the feature maps of different levels of semantic strength. In addition, the convolution kernel size used by U-net is fixed, which is poorly adaptable to unknown changes. Therefore, we propose Dfp-Unet based on deformable convolution and feature pyramid for biomedical image segmentation. Dfp-Unet uses the idea of feature pyramid to respectively add an additional independent path including convolution and up-sampling operations to each level of the decoder. Then, the output feature maps of all levels are concatenated to obtain the final feature map containing multiple levels of semantic information for final prediction. Besides, Dfp-Unet replaces the convolution in the down-sampling modules with a deformable convolution on the basis of U-net. To verify the performance of Dfp-Unet, four image segmentation data sets including Sunnybrook, ISIC2017, Covid19-ct-scans, and ISBI2012 are used to compare Dfp-Unet with the existing convolutional neural networks (U-net and U-net++), and the experimental results show that Dfp-Unet has high segmentation accuracy and generalization performance.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Xu, Y.-Y., Yao, L.-X., Shen, H.-B.: Bioimage-based protein subcellular location prediction: a comprehensive review. Front. Comp. Sci. 12, 26–39 (2018)
Yidong, C., Qin, Z., lan, L., Li, P., Jin, Y.: A review of deep convolutional neural networks in medical image segment. Chin. J. Health Inf. Manag. (2021)
Seo, H., et al.: Machine learning techniques for biomedical image segmentation: an overview of technical aspects and introduction to state-of-art applications. Med. Phys. 47(5), e148–e167 (2020)
Pang, S., Du, A., Orgun, M.A., Yu, Z.: A novel fused convolutional neural network for biomedical image classification. Med. Biol. Eng. Comput. 57(1), 107–121 (2019)
Krizhevsky, A., Sutskever, I., Hinton, G.E.: ImageNet classification with deep convolutional neural networks. Commun. ACM 60(6), 84–90 (2017)
Long, J., Shelhamer, E., Darrell, T.: Fully convolutional networks for semantic segmentation. In: Fully Convolutional Networks for Semantic Segmentation, pp. 3431–3440. IEEE (2015)
Yuan, Y., Chao, M., Lo, Y.-C.: Automatic skin lesion segmentation using deep fully convolutional networks with jaccard distance. IEEE Trans. Med. Imaging 36(9), 1876–1886 (2017)
Ronneberger, O., Fischer, P., Brox, T.: U-net: convolutional networks for biomedical image segmentation. In: Navab, N., Hornegger, J., Wells, W., Frangi, A. (eds.) U-net: Convolutional Networks for Biomedical Image Segmentation, pp. 234–241. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-24574-4_28
Curiale, A.H., Colavecchia, F.D., Kaluza, P., Isoardi, R.A., Mato, G.: Automatic myocardial segmentation by using a deep learning network in cardiac MRI. In: Automatic Myocardial Segmentation by Using a Deep Learning Network in Cardiac MRI, pp. 1–6. IEEE (2017)
Zhou, Z., Siddiquee, M.M.R., Tajbakhsh, N., Liang, J.: UNet++: redesigning skip connections to exploit multiscale features in image segmentation. IEEE Trans. Med. Imaging 39(6), 1856–1867 (2020)
Alom, M.Z., Hasan, M., Yakopcic, C., Taha, T.M., Asari, V.K.: Recurrent residual convolutional neural network based on u-net (r2u-net) for medical image segmentation, arXiv preprint (2018)
Ibtehaz, N., Rahman, M.S.: MultiResUNet: rethinking the U-Net architecture for multimodal biomedical image segmentation. Neural Netw. 121, 74–87 (2020)
Li, X., Chen, H., Qi, X., Dou, Q., Fu, C.-W., Heng, P.-A.: H-DenseUNet: hybrid densely connected UNet for liver and tumor segmentation from CT volumes. IEEE Trans. Med. Imaging 37(12), 2663–2674 (2018)
Lei, T., Wang, R., Zhang, Y., Wan, Y., Liu, C., Nandi, A.K.: DefED-Net: deformable encoder-decoder network for liver and liver tumor segmentation. IEEE Trans. Radiat. Plasma Med. Sci. 6(1), 68–78 (2022)
Lin, T.-Y., Dollár, P., Girshick, R., He, K., Hariharan, B., Belongie, S.: Feature pyramid networks for object detection. In: Feature Pyramid Networks for Object Detection, pp. 2117–2125. IEEE (2017)
Dai, J., et al.: Deformable convolutional networks. In: Deformable Convolutional Networks, pp. 764–773. IEEE (2017)
Zhu, X., Hu, H., Lin, S., Dai, J.: Deformable convnets v2: more deformable, better results. In: Deformable Convnets v2: More Deformable, Better Results, pp. 9308–9316. IEEE (2019)
Moradi, S., et al.: MFP-Unet: a novel deep learning based approach for left ventricle segmentation in echocardiography. Phys. Med. 67, 58–69 (2019)
Fonseca, C.G., et al.: The cardiac atlas project–an imaging database for computational modeling and statistical atlases of the heart. Bioinformatics 27(16), 2288–2295 (2011)
Codella, N.C., et al.: Skin lesion analysis toward melanoma detection: a challenge at the 2017 international symposium on biomedical imaging (ISBI), hosted by the international skin imaging collaboration (ISIC). In: Skin Lesion Analysis Toward Melanoma Detection: A Challenge at the 2017 International Symposium on Biomedical Imaging (ISBI), hosted by the International Skin Imaging Collaboration (ISIC), pp. 168–172. IEEE (2018)
Karimi, D., Salcudean, S.E.: Reducing the hausdorff distance in medical image segmentation with convolutional neural networks. IEEE Trans. Med. Imaging 39(2), 499–513 (2020)
Acknowledgments
This work was supported by National Science and Technology Major Project (No. 2021ZD0112600), National Natural Science Foundation of China (61803320) and Natural Science Foundation of Fujian Province of China (2022J05012).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Ethics declarations
The authors have no competing interests to declare that are relevant to the content of this article.
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Yang, Z., Wei, Y., Yu, X., Guan, J. (2024). Dfp-Unet: A Biomedical Image Segmentation Method Based on Deformable Convolution and Feature Pyramid. In: Yang, DN., Xie, X., Tseng, V.S., Pei, J., Huang, JW., Lin, J.CW. (eds) Advances in Knowledge Discovery and Data Mining. PAKDD 2024. Lecture Notes in Computer Science(), vol 14648. Springer, Singapore. https://doi.org/10.1007/978-981-97-2238-9_23
Download citation
DOI: https://doi.org/10.1007/978-981-97-2238-9_23
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-97-2240-2
Online ISBN: 978-981-97-2238-9
eBook Packages: Computer ScienceComputer Science (R0)