Skip to main content
SpringerLink
Log in

Direct full quantification of the left ventricle via multitask regression and classification

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

Left ventricle (LV) quantitative indices, such as the areas of the cavity and myocardium, dimensions of the cavity, regional wall thickness, and phase classification, play a vital role in assessing the overall and local cardiac function in clinical practice. However, due to variations in the cardiac structures of different subjects and the inconvenience of manual feature extraction, it is difficult to accurately estimate left ventricle indices. To solve the above problem, this paper presents a multitask regression and classification network (MTRC-net) based on image representation to improve the accuracy of the quantified results. The network employs an autoencoder network to perform image representation, and then the representative images are fed into the multitask regression and classification network to extract the temporal and spatial features of the cardiac images, which can better help the MTRC-net to learn the potential image features, reduce the experimental errors and speed up the convergence of the model. In the multitask regression and classification network, a pseudo-3D network is used to compress the network model, and the circular hypothesis is applied to fully obtain the temporal and spatial information of the cardiac images. The proposed algorithm was verified on a dataset that includes images of 145 patients from the left ventricle quantification competition of MICCAI2018, and the results are as follows. The average absolute error of MAE in the Areas (cavity area and myocardium area) is 106 ± 88 mm2, the average absolute error of MAE in the Dims (directional dimensions of the cavity) region is 1.54 ± 1.40 mm, the average absolute error of MAE in the RWTs(regional wall thicknesses region) is 0.96 ± 0.70 mm, and the error rate of phase classification is 1.2%. The errors of each index are almost always smaller than those of the indices of the existing methods, and the experimental results illustrate the feasibility and effectiveness of the proposed method.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

Notes

  1. https://lvquan18.github.io/

References

  1. World Health Organization Global Health Observatory (GHO) dataset [EB/OL] (2020) https://www.who.int/news-room/factsheets/detail/cardiovascular-diseases-(cvds)https://www.who.int/news-room/factsheets/detail/cardiovascular-diseases-(cvds)

  2. Romaguera LV, Costa MGF, Romero FP, Filho CFFC (2017) Left ventricle segmentation in cardiac MRI images using fully convolutional neural networks. Comput-Aid Diagnos 10134:101342Z

    Article  Google Scholar 

  3. Hahnloser RHR, Sarpeshkar R, Mahowald MA, Douglas RJ, Sebastian SH (2000) Digital selection and analogue amplification coexist in a cortex-inspired silicon circuit. Nature 405(6789):947–951

    Article  Google Scholar 

  4. Paul AK, Shill PC, Rabin MRI, Murase K (2018) Rafiqul Islam Adaptive weighted fuzzy rule-based system for the risk level assessment of heart disease. Appl Intell 48(7):1739–1756

    Article  Google Scholar 

  5. Karamitsos TD, Francis JM, Myerson S, Selvanayagam JB, Neubauer S (2009) The role of cardiovascular magnetic resonance imaging in heart failure. J Am Coll Cardiol 54(15):1407–1424

    Article  Google Scholar 

  6. Xiuquan D, Tang R, Yin S, Zhang Y, Li S (2018) Direct segmentation-based full quantification for left ventricle via deep multi-task regression learning network. IEEE J Biomed Health Inform 23(3):942–948

    Google Scholar 

  7. Suinesiaputra A, Bluemke DA, Cowan BR, Friedrich MG, Kramer CM, Kwong R, Plein S, Schulz-Menger J, Westenberg JJM, Young AA, Nagel E (2015) Suinesiaputra quantification of LV function and mass by cardiovascular magnetic resonance:multi-center variability and consensus contours. J Cardiovas Magnet Reson 17(1):63

    Article  Google Scholar 

  8. Wang Y, Jia Y (2006) Segmentation of the left ventricle from cardiac MR images based on degenerated minimal surface diffusion and shape priors. In: 18th international conference on pattern recognition (ICPR’06), vol 4. IEEE, Hong Kong, pp 671–674

  9. Ayed IB, Chen H-M, Punithakumar K, Ross I, Li S (2012) Max-flow segmentation of the left ventricle by recovering subject-specific distributions via a bound of the Bhattacharyya measure. Med Image Anal 16(1):87–100

    Article  Google Scholar 

  10. Wang Y, Yuwei W, Jia Y (2013) Segmentation of the left ventricle in cardiac cine MRI using a shape-constrained snake model. Comput Vis Image Underst 117(9):990–1003

    Article  Google Scholar 

  11. Andreopoulos A, Tsotsos JK (2008) Efficient and generalizable statistical models of shape and appearance for analysis of cardiac MRI. Med Image Anal 12(3):335–357

    Article  Google Scholar 

  12. Senegas J, Cocosco CA, Netsch T (2004) Model-based segmentation of cardiac MRI cine sequences:a Bayesian formulation. In: Medical imaging 2004:image processing. International society for optics and photonics, San Diego, CA, vol 5370, pp 432–443

  13. Li Yupeng, Cao Guo, Qian Y u, Li Xuesong (2018) Active contours driven by non-local Gaussian distribution fitting energy for image segmentation. Appl Intell 48(12):4855–4870

    Article  Google Scholar 

  14. Ngo TA, Zhi L, Carneiro G (2017) Combining deep learning and level set for the automated segmentation of the left ventricle of the heart from cardiac cine magnetic resonance. Med Image Anal 35:159–171

    Article  Google Scholar 

  15. Ngo TA, Carneiro G (2013) Left ventricle segmentation from cardiac MRI combining level set methods with deep belief networks, IEEE, Australia

  16. Avendi MR, Kheradvar A, Jafarkhani H (2016) A combined deep-learning and deformable-model approach to fully automatic segmentation of the left ventricle in cardiac MRI. Med Image Anal 30:108–119

    Article  Google Scholar 

  17. Chen C, Qin C, Qiu H, Tarroni G, Duan J, Bai W, Rueckert D (2020) Deep learning for cardiac image segmentation: A review. Front Cardiovas Med 7:25

    Article  Google Scholar 

  18. Xiuquan D, Zhang W, Zhang H, Chen J, Zhang Y, Warrington JC, Brahm G, Li S (2018) Deep regression segmentation for cardiac bi-ventricle MR images. IEEE Access 6:3828–3838

    Article  Google Scholar 

  19. Ronneberger O, Fischer P, Brox T (2015) u-net: Convolutional networks for biomedical image segmentation. In: International conference on medical image computing and computer-assisted intervention. Springer, Cham, pp 234–241

  20. Kerfoot E, Clough J, Oksuz I, Lee J, King AP, Schnabel JA (2018) Left-ventricle quantification using residual U-Net. In: International workshop on statistical atlases and computational models of the heart. Springer, Cham, pp 371–380

  21. Guo F, Ng M, Wright G (2018) Cardiac MRI left ventricle segmentation and quantification: A framework combining U-Net and continuous max-flow, Springer, Cham

  22. Du X, Tang R, Yin S, Zhang Y, Li S (2018) Direct segmentation-based full quantification for left ventricle via deep multi-task regression learning network. IEEE J Biomed Health Inform 23(3):942–948

    Article  Google Scholar 

  23. Sun J, Li H, Fujita H, Fu B, Ai W (2020) Class-imbalanced dynamic financial distress prediction based on Adaboost-SVM ensemble combined with SMOTE and time weighting. Inform Fusion 54:128–144

    Article  Google Scholar 

  24. Zhang C, Bi J, Xu S, Ramentol E, Fan G, Qiao B, Fujita H (2019) Multi-Imbalance: An open-source software for multi-class imbalance learning. Knowl-Based Syst 174:137–143

    Article  Google Scholar 

  25. Wang Z, Salah MB, Gu B, Islam A, Goela A, Li S (2014) Direct estimation of cardiac biventricular volumes with an adapted bayesian formulation. IEEE Trans Biomed Eng 61(4):1251–1260

    Article  Google Scholar 

  26. Zhen X, Zhang H, Islam A, Bhaduri M, Chan I, Li S (2017) Direct and simultaneous estimation of cardiac four chamber volumes by multioutput sparse regression. Med Image Anal 2017(36):184–196

    Article  Google Scholar 

  27. Zhen X, Wang Z, Islamc A, Bhadurid M, Chand I, Li S (2016) Multi-scale deep networks and regression forests for direct bi-ventricular volume estimation. Med Image Anal 30:120– 129

    Article  Google Scholar 

  28. Wang H, Yang Y, Liu B, Fujita H (2019) A study of graph-based system for multi-view clustering. Knowl-Based Syst 163:1009–1019

    Article  Google Scholar 

  29. Xiao Q, Dai J, Luo J, Fujita H (2019) Multi-view manifold regularized learning-based method for prioritizing candidate disease miRNAs. Knowl-Based Syst 175:118–129

    Article  Google Scholar 

  30. Xue W, Lum A, Mercado A, Landis M, Warrington J, Li S (2017) Full quantification of left ventricle via deep multitask learning network respecting intra-and inter-task relatedness. In: International conference on medical image computing and computer-assisted intervention. Springer, Cham, pp 276–284

  31. Xue W, Brahm G, Pandey S, Leung S, Li S (2018) Full left ventricle quantification via deep multitask relationships learning. Med Image Anal 43:54–65

    Article  Google Scholar 

  32. Wang W, Wang Y, Wu Y, Lin T, Li S, Bo C (2019) Quantification of full left ventricular metrics via deep regression learning with contour-guidance. IEEE Access 7:47918–47928

    Article  Google Scholar 

  33. Xue W, Islam A, Bhaduri M, Li S (2017) Direct multitype cardiac indices estimation via joint representation and regression learning. IEEE Trans Med Imaging 36(10):2057–2067

    Article  Google Scholar 

  34. Alejandro D, Ferrante E (2018) Left ventricle quantification through spatio-temporal CNNs, Springer, Cham

  35. Wang X, Zheng Z, He Y, Yan F, Zeng Z, Yang Y (2020) Progressive Local Filter Pruning for Image Retrieval Acceleration. arXiv:2001.08878

  36. Chen W, Xie D, Zhang Y, Pu S (2019) All you need is a few shifts: Designing efficient convolutional neural networks for image classification. In: Conference on computer vision and pattern recognition, Long Beach, CA, USA, pp 7241–7250

  37. Du T, Bourdev L, Fergus R, Torresani L, Paluri M (2015) Learning spatiotemporal features with 3d convolutional networks. In: Proceedings of the IEEE international conference on computer vision. Venice, Italy, pp 4489–4497

  38. Qiu Z, Yao T, Mei T (2017) Learning spatio-temporal representation with pseudo-3d residual networks. In: Proceedings of the IEEE international conference on computer vision. Venice, Italy, pp 5533–5541

  39. Chen W, Wei H, Peng S, Sun J, Qiao X, Liu B (2019) HSN: Hybrid segmentation network for small cell lung cancer segmentation. IEEE Access 7:75591–75603

    Article  Google Scholar 

  40. Bengio Y, Courville A, Vincent P (2013) Representation learning: A review and new perspectives. IEEE Trans Pattern Anal Mach Intell 35(8):1798–1828

    Article  Google Scholar 

Download references

Acknowledgements

This work has been partially supported by the National Natural Science Foundation of China (No. 61472042 and No. 61802020) and the Beijing Natural Science Foundation (No.4174094). The experimental data came from Left Ventricle Full Quantification Challenge MICCAI 2018. The authors also would like to express appreciation to the anonymous reviewers and editors for their helpful comments that improved the article. We would like to thank American Journal Experts for providing linguistic assistance during the preparation of this article.

Author information

Authors and Affiliations

  1. School of Artificial Intelligence, Beijing Normal University, Beijing, China

    Xiaoying Huang, Yun Tian, Shifeng Zhao & Tao Liu

  2. Key laboratory of Carcinogenesis and Translational Research (Ministry of Education/Beijing), Department of Gynecologic Oncology, Peking University Cancer Hospital & Institute, Beijing, 100142, China

    Wei Wang

  3. Sixth Medical CenterChinese PLA General Hospital, Beijing, 100048, China

    Qingjun Wang

Authors
  1. Xiaoying Huang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yun Tian
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Shifeng Zhao
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Tao Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Wei Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Qingjun Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yun Tian.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Huang, X., Tian, Y., Zhao, S. et al. Direct full quantification of the left ventricle via multitask regression and classification. Appl Intell 51, 5745–5758 (2021). https://doi.org/10.1007/s10489-020-02130-3

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-020-02130-3

Keywords

Search

Navigation