Abstract
Segmenting vertebrae and intervertebral discs from spinal MRI images is essential for the diagnosis and treatment of spinal diseases. However, the similarity among different vertebrae and discs, coupled with pathological variations, complicates the segmentation process of MRI images. To tackle this challenge, this study introduces an improved U-Net architecture for spinal MRI image segmentation. The encoder employs a Multi-scale Feature Fusion Module that integrates shallow and deep features through feature downsampling. Additionally, a Dual Attention Mechanism Module is embedded within both the encoder and decoder to enhance feature extraction capabilities. Furthermore, a Graph Convolutional Module is integrated to capture contextual relationships between vertebrae and intervertebral discs. To mitigate background interference, a Spinal Region Guidance Module is also proposed. Experiments conducted on the public dataset from the MRSpineSeg Challenge yielded an average Dice Similarity Coefficient of 85.11%. The results indicate that our proposed method not only improves the segmentation performance of spinal MRI images but also surpasses other models, which holds significant implications for the clinical diagnosis and treatment of spinal diseases.









Similar content being viewed by others
Data availability
The datasets generated and/or analyzed during the current study are available from the corresponding author on reasonable request.
References
Hoy, D., March, L., Brooks, P., Blyth, F., Woolf, A., Bain, C., Williams, G., Smith, E., Vos, T., Barendregt, J., et al.: The global burden of low back pain: estimates from the global burden of disease 2010 study. Ann. Rheum. Dis. 73(6), 968–974 (2014)
Angulakshmi, M., Deepa, M.: A review on deep learning architecture and methods for MRI brain Tumour segmentation. Current Med. Imaging 17(6), 695–706 (2021)
Huang, Y., Hu, G., Ji, C., Xiong, H.: Glass-cutting medical images via a mechanical image segmentation method based on crack propagation. Nat. Commun. 11, 5669 (2020)
Park, J., Park, S., Cho, W.: Medical image segmentation using level set method with a new hybrid speed function based on boundary and region segmentation. IEICE Trans. Inf. Syst. 95, 2133–2141 (2012)
Eckstein, F., Cicuttini, F., Raynauld, J.-P., Waterton, J.C., Peterfy, C.: Magnetic resonance imaging (MRI) of articular cartilage in knee osteoarthritis (OA): morphological assessment. Osteoarthr. Cartil. 14, 46–75 (2006)
Long, J., Shelhamer, E., Darrell, T.: Fully convolutional networks for semantic segmentation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3431–3440 ( 2015)
Ronneberger, O., Fischer, P., Brox, T.: U-Net: convolutional networks for biomedical image segmentation, pp. 234–241 (2015)
Çiçek, Ö., Abdulkadir, A., Lienkamp, S.S., Brox, T., Ronneberger, O.: 3d U-Net: learning dense volumetric segmentation from sparse annotation, pp. 424–432 (2016)
Lee, K., Zung, J., Li, P., Jain, V., Seung, H.S.: Superhuman accuracy on the SNEMI3D connectomics challenge. arXiv:1706.00120 (2017)
Chen, L.-C., Zhu, Y., Papandreou, G., Schroff, F., Adam, H.: Encoder-decoder with Atrous separable convolution for semantic image segmentation. In: Proceedings of the European Conference on Computer Vision (ECCV), pp. 801–818 (2018)
Isensee, F., Jaeger, P.F., Kohl, S.A., Petersen, J., Maier-Hein, K.H.: nnU-Net: a self-configuring method for deep learning-based biomedical image segmentation. Nature 18, 203–211 (2021)
Xie, Y., Zhang, J., Shen, C., Xia, Y.: Cotr: efficiently bridging CNN and transformer for 3d medical image segmentation. In: Medical Image Computing and Computer Assisted Intervention–MICCAI 2021: 24th International Conference, Strasbourg, France, September 27–October 1, 2021, Proceedings, Part III 24, pp. 171– 180 (2021)
Payer, C., Stern, D., Bischof, H., Urschler, M.: Coarse to fine vertebrae localization and segmentation with SpatialConfiguration-Net and U-Net, pp. 124–133 (2020)
Meng, D., Boyer, E., Pujades, S.: Vertebrae localization, segmentation and identification using a graph optimization and an anatomic consistency cycle. Comput. Med. Imaging Graph. 107, 102235 (2023)
You, X., Gu, Y., Liu, Y., Lu, S., Tang, X., Yang, J.: EG-Trans3DUNet: a single-staged transformer-based model for accurate vertebrae segmentation from spinal CT images, pp. 1–5 (2022)
Pang, S., Pang, C., Zhao, L., Chen, Y., Su, Z., Zhou, Y., Huang, M., Yang, W., Lu, H., Feng, Q.: SpineParseNet: spine parsing for volumetric MR image by a two-stage segmentation framework with semantic image representation. IEEE Trans. Med. Imaging 40(1), 262–273 (2020)
Huang, M., Zhou, S., Chen, X., Lai, H., Feng, Q.: Semi-supervised hybrid spine network for segmentation of spine MR images. Comput. Med. Imaging Graph. 107, 102245 (2023)
Wang, B., Qin, J., Lv, L., Cheng, M., Li, L., Xia, D., Wang, S.: MLKCA-Unet: multiscale large-kernel convolution and attention in Unet for spine MRI segmentation. Optik 272, 170277 (2023)
Xia, L., Xiao, L., Quan, G., Bo, W.: 3d cascaded convolutional networks for multi-vertebrae segmentation, vol. 16, pp. 231– 240 (2020)
Saeed, M.U., Bin, W., Sheng, J., Ali, G., Dastgir, A.: 3D MRU-Net: a novel mobile residual U-Net deep learning model for spine segmentation using computed tomography images. Biomed. Signal Process. Control 86, 105153 (2023)
Saeed, M.U., Bin, W., Sheng, J., Mobarak Albarakati, H.: An automated multi-scale feature fusion network for spine fracture segmentation using computed tomography images. J. Imaging Inform. Med. (2024). https://doi.org/10.1007/s10278-024-01091-0
Funding
This work was supported in part by the National Natural Science Foundation of China under Grant(No.62071161), the Scientific Research Fund of Zhejiang Provincial Department of Education(No.Y202351775) andZhejiang Province College Students’ Science and Technology Innovation Activity Program and XinMiao Talent Program Project(No.2024R407B060).
Author information
Authors and Affiliations
Contributions
Mei was responsible for model improvement and experimental verification, Mei and Zhang jointly completed the initial draft writing, Sun and Ma collaborated on providing research directions and project management.
Corresponding author
Ethics declarations
Conflict of interest
The authors have no Conflict of interest that might be perceived to influence the results and/or discussion reported in this paper.
Ethical approval
Not applicable.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Mei, X., Zhang, W., Sun, M. et al. Spinal MRI image segmentation based on improved U-Net. SIViP 18, 9319–9329 (2024). https://doi.org/10.1007/s11760-024-03548-9
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11760-024-03548-9