Abstract
Multi-sequence cardiac magnetic resonance (MR) segmentation is an important medical imaging technology that facilitates intelligent interpretation of clinical MR images. However, fully automatic segmentation of multi-sequence cardiac MR is a challenging task due to the complexity and variability of cardiac anatomy. In this study, we propose a two-stage deep learning scheme for automatic segmentation of volumetric multi-sequence MR images by leveraging both 2D and 3D U-Net. In the first stage, a 2D U-Net model coupled with the iterative randomized Hough transform is employed on the balanced-steady state free precession (bSSFP) MR sequences, so as to find the center coordinates of the left ventricles (LVs). The regions of interest (ROIs) are then localized around the center coordinates on the corresponding late gadolinium enhanced (LGE) MR sequences. In the second stage, a 3D probabilistic U-Net model is performed on the ROIs in the LGE data to segment the LV, right ventricle (RV) and left ventricular myocardium (MYO). Experimental results on the MICCAI 2019 Multi-Sequence Cardiac MR Segmentation (MS-CMRSeg) Challenge show that the proposed scheme performs well with average Dice similarity coefficients of LV, RV and MYO as 0.792, 0.697 and 0.611, respectively.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Kim, H., Farzaneh-Far, A., Kim, R.: Cardiovascular magnetic resonance in patients with myocardial infarction: current and emerging applications. J. Am. Coll. Cardiol. 55(1), 1–16 (2009)
Kolipaka, A., Chatzimavroudis, G., White, R.: Segmentation of non-viable myocardium in delayed enhancement magnetic resonance images. Int. J. Cardiovasc. Imaging 21(2–3), 303–311 (2005)
Wright, J., Adriaenssens, T., Dymarkowski, S.: Quantification of myocardial area at risk with T2-weighted CMR: comparison with contrast-enhanced CMR and coronary angiography. J. Am. Coll. Cardiol. Imaging 2(7), 825–831 (2009)
Payer, C., Štern, D., Bischof, H., Urschler, M.: Multi-label whole heart segmentation using CNNs and anatomical label configurations. In: Pop, M., et al. (eds.) STACOM 2017. LNCS, vol. 10663, pp. 190–198. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-75541-0_20
Zhuang, X.: Multivariate mixture model for myocardial segmentation combining multi-source images. IEEE Trans. Pattern Anal. Mach. Intell. 41, 2933–2946 (2018)
Zhuang, X.: Multivariate mixture model for cardiac segmentation from multi-sequence MRI. In: Ourselin, S., Joskowicz, L., Sabuncu, Mert R., Unal, G., Wells, W. (eds.) MICCAI 2016. LNCS, vol. 9901, pp. 581–588. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46723-8_67
Yap, M., Pons, G., Martí, J.: Automated breast ultrasound lesions detection using convolutional neural networks. IEEE J. Biomed. Health Inform. 22(4), 1218–1226 (2017)
Çiçek, Ö., Abdulkadir, A., Lienkamp, Soeren S., Brox, T., Ronneberger, O.: 3D U-Net: learning dense volumetric segmentation from sparse annotation. In: Ourselin, S., Joskowicz, L., Sabuncu, Mert R., Unal, G., Wells, W. (eds.) MICCAI 2016. LNCS, vol. 9901, pp. 424–432. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46723-8_49
Tran, D., Bourdev, L., Fergus, R.: Deep end2end voxel2voxel prediction. In: Proceedings of Computer Vision and Pattern Recognition, pp. 17–24. Springer, Heidelberg (2016). https://doi.org/10.1109/CVPRW.2016.57
Kohl, S., Romera-Paredes, B., Meyer, C.: A probabilistic U-Net for segmentation of ambiguous images. In: Proceedings of Neural Information Processing Systems, pp. 6965–6975. Springer, Heidelberg (2018). https://arxiv.org/abs/1806.05034
Kingma, D., Welling, M.: Auto-encoding variational bayes. arXiv:1312.6114 (2013)
Rezende, D., Mohamed, S., Wierstra, D.: Stochastic backpropagation and approximate inference in deep generative models. arXiv:1401.4082 (2014)
Sohn, K., Lee, H., Yan, X.: Learning structured output representation using deep conditional generative models. In: Proceedings of Neural Information Processing Systems, pp. 3483–3491 (2015)
Higgins, I., et al.: beta-VAE: learning basic visual concepts with a constrained variational framework. In: International Conference on Learning Representation, pp. 6–18 (2017)
Dong, H., Yang, G., Liu, F., Mo, Y., Guo, Y.: Automatic brain tumor detection and segmentation using U-Net based fully convolutional networks. In: Valdés Hernández, M., González-Castro, V. (eds.) MIUA 2017. CCIS, vol. 723, pp. 506–517. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-60964-5_44
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Xu, H., Xu, Z., Gu, W., Zhang, Q. (2020). A Two-Stage Fully Automatic Segmentation Scheme Using Both 2D and 3D U-Net for Multi-sequence Cardiac MR. In: Pop, M., et al. Statistical Atlases and Computational Models of the Heart. Multi-Sequence CMR Segmentation, CRT-EPiggy and LV Full Quantification Challenges. STACOM 2019. Lecture Notes in Computer Science(), vol 12009. Springer, Cham. https://doi.org/10.1007/978-3-030-39074-7_33
Download citation
DOI: https://doi.org/10.1007/978-3-030-39074-7_33
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-39073-0
Online ISBN: 978-3-030-39074-7
eBook Packages: Computer ScienceComputer Science (R0)
