Abstract
Automated segmentation for paraspinal muscles on axial lumbar MRIs of varied spinal levels is clinically demanded. However, it is challenging and there is no reported success due to the large inter- and intra-organ variations, unclear muscle boundaries and unpredictable muscle degeneration patterns. In this paper, we propose a novel explicit saliency-aware learning framework (BS-ESNet) for fine segmentation of multiple paraspinal muscles and other major components at varied spinal levels across the full lumbar spine. BS-ESNet is designed to first detect the location of each organ in forms of bounding box (b-box); then performs accurately segmentation which utilizes detected b-boxes to enable spatial saliency awareness. BS-ESNet creatively conducts detection upon a preliminary segmentation mask instead of input MRI, which eliminates the influence of inter-organ variations and is robust against unclear muscle boundaries. Such segment-then-detect workflow also provides a paradigm to formulate multi-organ detection in an end-to-end trainable process. Our framework also embeds an elaborate spatial attention gate which adopts detection b-boxes to obtain a saliency activation map in an explicitly supervised manner. Acquired salient attention map can automatically correct and enhance segmentation features, and further guides the adaptation of variable precise anatomical structures. The method is validated on a challenging dataset of 320 MRIs. Evaluation results demonstrate that our BS-ESNet achieves high segmentation performance with mean Dice score of 0.94 and outperforms other state-of-the-art frameworks.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Engstrom, C.M., Fripp, J., Jurcak, V., Walker, D.G., Salvado, O., Crozier, S.: Segmentation of the quadratus lumborum muscle using statistical shape modeling. J. Magn. Reson. Imaging 33(6), 1422–1429 (2011). https://doi.org/10.1002/jmri.22188
He, K., Gkioxari, G., Dollár, P., Girshick, R.: Mask r-cnn. IEEE Trans. Pattern Anal. Mach. Intell. 42(2), 386–397 (2020). https://doi.org/10.1109/TPAMI.2018.2844175
Hong, Y., Wei, B., Han, Z., Li, X., Zheng, Y., Li, S.: Mmcl-net: spinal disease diagnosis in global mode using progressive multi-task joint learning. Neurocomputing 399, 307–316 (2020). https://doi.org/10.1016/j.neucom.2020.01.112
Huang, J., et al.: Spine explorer: a deep learning based fully automated program for efficient and reliable quantifications of the vertebrae and discs on sagittal lumbar spine mr images. Spine J. 20(4), 590–599 (2020). https://doi.org/10.1016/j.spinee.2019.11.010
Li, S., Zhang, R., Xiao, X., Liu, Z., Li, Y.: Multi-task relational learning network for MRI vertebral localization, identification and segmentation. IEEE J. Biomed. Health Inform. 1 (2020). https://doi.org/10.1109/JBHI.2020.2969084
Lin, L., et al.: Multiple axial spine indices estimation via dense enhancing network with cross-space distance-preserving regularization. IEEE J. Biomed. Health Inform. 1 (2020). https://doi.org/10.1109/JBHI.2020.2977224
Liu, R., et al.: An intriguing failing of convolutional neural networks and the coordconv solution (2018)
Pang, S., et al.: Direct automated quantitative measurement of spine by cascade amplifier regression network with manifold regularization. Med. Image Anal. 55, 103–115 (2019). https://doi.org/10.1016/j.media.2019.04.012
Ranger, T.A., et al.: Are the size and composition of the paraspinal muscles associated with low back pain? A systematic review. Spine J. 17(11), 1729–1748 (2017). https://doi.org/10.1016/j.spinee.2017.07.002
Roth, H.R., et al.: Spatial aggregation of holistically-nested convolutional neural networks for automated pancreas localization and segmentation. Med. Image Anal. 45, 94–107 (2018). https://doi.org/10.1016/j.media.2018.01.006
Schlemper, J., et al.: Attention gated networks: learning to leverage salient regions in medical images. Med. Image Anal. 53, 197–207 (2019). https://doi.org/10.1016/j.media.2019.01.012
Tosato, M., et al.: Measurement of muscle mass in sarcopenia: from imaging to biochemical markers. Aging Clin. Exp. Res. 29(1), 19–27 (2017). https://doi.org/10.1007/s40520-016-0717-0
Wang, G., et al.: Automatic segmentation of vestibular schwannoma from t2-weighted MRI by deep spatial attention with hardness-weighted loss. In: Shen, D., et al. (eds.) Medical Image Computing and Computer Assisted Intervention - MICCAI 2019. pp. 264–272. Springer International Publishing, Cham (2019). https://doi.org/10.1007/978-3-030-32245-8_30
Wang, X., Girshick, R., Gupta, A., He, K.: Non-local neural networks. In: 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 7794–7803, June 2018. https://doi.org/10.1109/CVPR.2018.00813
Xia, W., et al.: Automatic paraspinal muscle segmentation in patients with lumbar pathology using deep convolutional Neural Network. In: Shen, D., et al. (eds.) MICCAI 2019. LNCS, vol. 11765, pp. 318–325. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-32245-8_36
Zheng, G., et al.: Evaluation and comparison of 3D intervertebral disc localization and segmentation methods for 3D T2 MR data: A grand challenge. Med. Image Anal. 35, 327–344 (2017). https://doi.org/10.1016/j.media.2016.08.005
Acknowledgements
This study was supported by National Key R&D Program of China (No. 2018YFB1105600), National Natural Science Foundation of China (NSFC, No. 81772382), and Innovation research grant program for 8-year-system medical students at Zhejiang University (No. 119000-5405A1).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Huang, J., Shen, H., Chen, B., Wang, Y., Li, S. (2020). Segmentation of Paraspinal Muscles at Varied Lumbar Spinal Levels by Explicit Saliency-Aware Learning. In: Martel, A.L., et al. Medical Image Computing and Computer Assisted Intervention – MICCAI 2020. MICCAI 2020. Lecture Notes in Computer Science(), vol 12266. Springer, Cham. https://doi.org/10.1007/978-3-030-59725-2_63
Download citation
DOI: https://doi.org/10.1007/978-3-030-59725-2_63
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-59724-5
Online ISBN: 978-3-030-59725-2
eBook Packages: Computer ScienceComputer Science (R0)