Skip to main content

Segmentation of Paraspinal Muscles at Varied Lumbar Spinal Levels by Explicit Saliency-Aware Learning

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 12266))

Abstract

Automated segmentation for paraspinal muscles on axial lumbar MRIs of varied spinal levels is clinically demanded. However, it is challenging and there is no reported success due to the large inter- and intra-organ variations, unclear muscle boundaries and unpredictable muscle degeneration patterns. In this paper, we propose a novel explicit saliency-aware learning framework (BS-ESNet) for fine segmentation of multiple paraspinal muscles and other major components at varied spinal levels across the full lumbar spine. BS-ESNet is designed to first detect the location of each organ in forms of bounding box (b-box); then performs accurately segmentation which utilizes detected b-boxes to enable spatial saliency awareness. BS-ESNet creatively conducts detection upon a preliminary segmentation mask instead of input MRI, which eliminates the influence of inter-organ variations and is robust against unclear muscle boundaries. Such segment-then-detect workflow also provides a paradigm to formulate multi-organ detection in an end-to-end trainable process. Our framework also embeds an elaborate spatial attention gate which adopts detection b-boxes to obtain a saliency activation map in an explicitly supervised manner. Acquired salient attention map can automatically correct and enhance segmentation features, and further guides the adaptation of variable precise anatomical structures. The method is validated on a challenging dataset of 320 MRIs. Evaluation results demonstrate that our BS-ESNet achieves high segmentation performance with mean Dice score of 0.94 and outperforms other state-of-the-art frameworks.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   119.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   159.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Engstrom, C.M., Fripp, J., Jurcak, V., Walker, D.G., Salvado, O., Crozier, S.: Segmentation of the quadratus lumborum muscle using statistical shape modeling. J. Magn. Reson. Imaging 33(6), 1422–1429 (2011). https://doi.org/10.1002/jmri.22188

    Article  Google Scholar 

  2. He, K., Gkioxari, G., Dollár, P., Girshick, R.: Mask r-cnn. IEEE Trans. Pattern Anal. Mach. Intell. 42(2), 386–397 (2020). https://doi.org/10.1109/TPAMI.2018.2844175

    Article  Google Scholar 

  3. Hong, Y., Wei, B., Han, Z., Li, X., Zheng, Y., Li, S.: Mmcl-net: spinal disease diagnosis in global mode using progressive multi-task joint learning. Neurocomputing 399, 307–316 (2020). https://doi.org/10.1016/j.neucom.2020.01.112

    Article  Google Scholar 

  4. Huang, J., et al.: Spine explorer: a deep learning based fully automated program for efficient and reliable quantifications of the vertebrae and discs on sagittal lumbar spine mr images. Spine J. 20(4), 590–599 (2020). https://doi.org/10.1016/j.spinee.2019.11.010

    Article  Google Scholar 

  5. Li, S., Zhang, R., Xiao, X., Liu, Z., Li, Y.: Multi-task relational learning network for MRI vertebral localization, identification and segmentation. IEEE J. Biomed. Health Inform. 1 (2020). https://doi.org/10.1109/JBHI.2020.2969084

  6. Lin, L., et al.: Multiple axial spine indices estimation via dense enhancing network with cross-space distance-preserving regularization. IEEE J. Biomed. Health Inform. 1 (2020). https://doi.org/10.1109/JBHI.2020.2977224

  7. Liu, R., et al.: An intriguing failing of convolutional neural networks and the coordconv solution (2018)

    Google Scholar 

  8. Pang, S., et al.: Direct automated quantitative measurement of spine by cascade amplifier regression network with manifold regularization. Med. Image Anal. 55, 103–115 (2019). https://doi.org/10.1016/j.media.2019.04.012

    Article  Google Scholar 

  9. Ranger, T.A., et al.: Are the size and composition of the paraspinal muscles associated with low back pain? A systematic review. Spine J. 17(11), 1729–1748 (2017). https://doi.org/10.1016/j.spinee.2017.07.002

    Article  Google Scholar 

  10. Roth, H.R., et al.: Spatial aggregation of holistically-nested convolutional neural networks for automated pancreas localization and segmentation. Med. Image Anal. 45, 94–107 (2018). https://doi.org/10.1016/j.media.2018.01.006

    Article  Google Scholar 

  11. Schlemper, J., et al.: Attention gated networks: learning to leverage salient regions in medical images. Med. Image Anal. 53, 197–207 (2019). https://doi.org/10.1016/j.media.2019.01.012

    Article  Google Scholar 

  12. Tosato, M., et al.: Measurement of muscle mass in sarcopenia: from imaging to biochemical markers. Aging Clin. Exp. Res. 29(1), 19–27 (2017). https://doi.org/10.1007/s40520-016-0717-0

    Article  Google Scholar 

  13. Wang, G., et al.: Automatic segmentation of vestibular schwannoma from t2-weighted MRI by deep spatial attention with hardness-weighted loss. In: Shen, D., et al. (eds.) Medical Image Computing and Computer Assisted Intervention - MICCAI 2019. pp. 264–272. Springer International Publishing, Cham (2019). https://doi.org/10.1007/978-3-030-32245-8_30

  14. Wang, X., Girshick, R., Gupta, A., He, K.: Non-local neural networks. In: 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 7794–7803, June 2018. https://doi.org/10.1109/CVPR.2018.00813

  15. Xia, W., et al.: Automatic paraspinal muscle segmentation in patients with lumbar pathology using deep convolutional Neural Network. In: Shen, D., et al. (eds.) MICCAI 2019. LNCS, vol. 11765, pp. 318–325. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-32245-8_36

    Chapter  Google Scholar 

  16. Zheng, G., et al.: Evaluation and comparison of 3D intervertebral disc localization and segmentation methods for 3D T2 MR data: A grand challenge. Med. Image Anal. 35, 327–344 (2017). https://doi.org/10.1016/j.media.2016.08.005

    Article  Google Scholar 

Download references

Acknowledgements

This study was supported by National Key R&D Program of China (No. 2018YFB1105600), National Natural Science Foundation of China (NSFC, No. 81772382), and Innovation research grant program for 8-year-system medical students at Zhejiang University (No. 119000-5405A1).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Yue Wang .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Huang, J., Shen, H., Chen, B., Wang, Y., Li, S. (2020). Segmentation of Paraspinal Muscles at Varied Lumbar Spinal Levels by Explicit Saliency-Aware Learning. In: Martel, A.L., et al. Medical Image Computing and Computer Assisted Intervention – MICCAI 2020. MICCAI 2020. Lecture Notes in Computer Science(), vol 12266. Springer, Cham. https://doi.org/10.1007/978-3-030-59725-2_63

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-59725-2_63

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-59724-5

  • Online ISBN: 978-3-030-59725-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics