Abstract
Automatic quantitative analysis of cardiac left ventricle (LV) function is one of challenging task for heart disease diagnosis. Four different parameters, i.e. regional wall thicknesses (RWT), area of myocardium and LV cavity, LV dimensions in different direction and cardiac phase, are used for evaluating the LV function. In this paper, we implemented a novel multi-task quantification network (HQNet) to simultaneously quantify the four different parameters. The network is mainly constituted by a customized convolutional neural network named Hierarchical convolutional neural network (HCNN) which includes different pyramid-like 3D convolution blocks with different kernel sizes for efficient feature embedding; and two long-short term memory (LSTM) networks for temporal modeling. Respecting inter-task correlations, our proposed network uses multi-task constraints for phase to improve the final estimation of phase. Selu activation function is selected instead of relu, which can bring better performance of model in experiments. Experiments on MR sequences of 145 patients show that HQNet achieves high accurate estimation by means of 7-fold cross validation. The mean absolute error (MAE) of average areas, RWT, dimensions are \( 197\,{\text{mm}}^{2} ,1.51\,{\text{mm}},2.57\,{\text{mm}} \) respectively. The error rate of phase classification is 9.8%. These results indicate that the approach we proposed has a promising performance to estimate all four parameters.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsNotes
- 1.
LVQuan18 challenge, website: https://lvquan18.github.io/.
References
Xue, W., Brahm, G., Pandey, S., Leung, S., Li, S.: Full left ventricle quantification via deep multitask relationships learning. Med. Image Anal. 43, 54–65 (2018). https://doi.org/10.1016/j.media.2017.09.005
Xue, W., Lum, A., Mercado, A., Landis, M., Warrington, J., Li, S.: Full quantification of left ventricle via deep multitask learning network respecting intra- and inter-task relatedness. In: Descoteaux, M., Maier-Hein, L., Franz, A., Jannin, P., Collins, D.L., Duchesne, S. (eds.) MICCAI 2017. LNCS, vol. 10435, pp. 276–284. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-66179-7_32
Xue, W., Nachum, I.B., Pandey, S., Warrington, J., Leung, S., Li, S.: Direct estimation of regional wall thicknesses via residual recurrent neural network. In: Niethammer, M., et al. (eds.) IPMI 2017. LNCS, vol. 10265, pp. 505–516. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-59050-9_40
Karamitsos, T.D., Francis, J.M., Myerson, S., Selvanayagam, J.B., Neubauer, S.: The role of cardiovascular magnetic resonance imaging in heart failure. J. Am. Coll. Cardiol. 54(15), 1407–1424 (2009)
Attili, A.K., Schuster, A., Nagel, E., Reiber, J.H., van der Geest, R.J.: Quantification in cardiac MRI: advances in image acquisition and processing. Int. J. Cardiovasc. Imaging 26(1), 27–40 (2010)
Ayed, I.B., Chen, H.M., Punithakumar, K., Ross, I., Li, S.: Max-flow segmentation of the left ventricle by recovering subject-specific distributions via a bound of the Bhattacharyya measure. Med. Image Anal. 16(1), 87–100 (2012)
Graves, A.: Supervised sequence labelling. In: Graves, A. (ed.) Supervised Sequence Labelling with Recurrent Neural Networks. SCI, vol. 385, pp. 5–13. Springer, Heidelberg (2012). https://doi.org/10.1007/978-3-642-24797-2_2
Kong, B., Zhan, Y., Shin, M., Denny, T., Zhang, S.: Recognizing end-diastole and end-systole frames via deep temporal regression network. In: Ourselin, S., Joskowicz, L., Sabuncu, M.R., Unal, G., Wells, W. (eds.) MICCAI 2016. LNCS, vol. 9902, pp. 264–272. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46726-9_31
Petitjean, C., Dacher, J.N.: A review of segmentation methods in short axis cardiac MR images. Med. Image Anal. 15(2), 169–184 (2011)
Poudel, R.P., Lamata, P., Montana, G.: Recurrent fully convolutional neural networks for multi-slice MRI cardiac segmentation. arXiv:1608.03974 (2016)
Wang, Z., Ben Salah, M., Gu, B., Islam, A., Goela, A., Li, S.: Direct estimation of cardiac biventricular volumes with an adapted bayesian formulation. IEEE TBE 61(4), 1251–1260 (2014)
Zhang, Y., Yeung, D.Y.: A convex formulation for learning task relationships in multi-task learning. In: UAI, pp. 733–742 (2010)
Zhang, Z., Luo, P., Loy, C.C., Tang, X.: Facial landmark detection by deep multi-task learning. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014. LNCS, vol. 8694, pp. 94–108. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-10599-4_7
Shi, X., Chen, Z., Wang, H., Yeung, D.-Y.: Convolutional LSTM network: a machine learning approach for precipitation nowcasting. In: Neural Information Processing Systems (NIPS) (2015)
Gers, F.A., Schmidhuber, J., Cummins, F.A.: Learning to forget: continual prediction with LSTM. Neural Comput. 12(10), 2451–2471 (2000)
Zhao, H., Shi, J., Qi, X., Wang, X., Jia, J.: Pyramid scene parsing network. arXiv:1612.01105 (2016)
Hochreiter, S., Schmidhuber, J.: Long short-term memory. Neural Comput. 9(8), 1735–1780 (1997)
Szegedy, C., et al.: Going deeper with convolutions. In: CVPR (2015)
Liu, Y., Yao, X.: Ensemble learning via negative correlation. Neural Netw. 12, 1399–1404 (1999)
Rosen, B.: Ensemble learning using decorrelated neural networks. Connect. Sci. 8(3/4), 373–383 (1996)
Klambauer, G., Unterthiner, T., Mayr, A., Hochreiter, S.: Self-normalizing neural networks. arXiv preprint arXiv:1706.02515 (2017)
Objective, LVQuan18 challenge. https://lvquan18.github.io/2018/03/12/objective.html. Accessed 26 June 2018
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., Wojna, Z.: Rethinking the inception architecture for computer vision. In: CVPR (2016). https://arxiv.org/abs/1512.00567
Acknowledgement
This research was supported by National Natural Science Foundation under grants (31571001, 61828101), the National Key Research and Development Program of China (2017YFC0107903) and the Science Foundation for The Excellent Youth Scholars of Southeast University.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Yang, G. et al. (2019). Left Ventricle Full Quantification via Hierarchical Quantification Network. In: Pop, M., et al. Statistical Atlases and Computational Models of the Heart. Atrial Segmentation and LV Quantification Challenges. STACOM 2018. Lecture Notes in Computer Science(), vol 11395. Springer, Cham. https://doi.org/10.1007/978-3-030-12029-0_46
Download citation
DOI: https://doi.org/10.1007/978-3-030-12029-0_46
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-12028-3
Online ISBN: 978-3-030-12029-0
eBook Packages: Computer ScienceComputer Science (R0)