Skip to main content

Abstract

Mechanical contraction and relaxation of the heart play an important role in evaluating healthy and diseased cardiac function. Mechanical patterns consist of complex non-linear 3D deformations that vary considerably between subjects and are difficult to observe on 2D images, which impacts the prediction accuracy of cardiac outcomes. In this work, we aim to capture 3D biventricular deformations at the end-diastolic (ED) and end-systolic (ES) phases of the cardiac cycle with a novel geometric deep learning approach. Our network consists of an encoder-decoder structure that works directly with light-weight point cloud data. We initially train our network on pairs of ED and ES point clouds stemming from a mixed population of subjects with the aim of accurately predicting ED outputs from ES inputs as well as ES outputs from ED inputs. We validate our network’s performance using the Chamfer distance (CD) and find that ED and ES predictions can be achieved with an average CD of 1.66 ± 0.62 mm on a dataset derived from the UK Biobank cohort with an underlying voxel size of \(1.8 \times 1.8 \times 8.0\) mm [8]. We derive structural and functional clinical metrics such as myocardial mass, ventricular volume, ejection fraction, and stroke volume from the predictions and find an average mean deviation from their respective gold standards of 1.6% and comparable standard deviations. Finally, we show our method’s ability to capture deformation differences between specific subpopulations in the dataset.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Beetz, M., Banerjee, A., Grau, V.: Biventricular surface reconstruction from cine MRI contours using point completion networks. In: 2021 IEEE 18th International Symposium on Biomedical Imaging (ISBI), pp. 105–109 (2021)

    Google Scholar 

  2. Bello, G.A., et al.: Deep-learning cardiac motion analysis for human survival prediction. Nat. Mach. Intell. 1(2), 95–104 (2019)

    Article  Google Scholar 

  3. Bernardini, F., Mittleman, J., Rushmeier, H., Silva, C., Taubin, G.: The ball-pivoting algorithm for surface reconstruction. IEEE Trans. Visual Comput. Graphics 5(4), 349–359 (1999)

    Article  Google Scholar 

  4. Chang, Y., Jung, C.: Automatic cardiac MRI segmentation and permutation-invariant pathology classification using deep neural networks and point clouds. Neurocomputing 418, 270–279 (2020)

    Article  Google Scholar 

  5. Krebs, J., Mansi, T., Ayache, N., Delingette, H.: Probabilistic motion modeling from medical image sequences: application to cardiac cine-MRI. In: Pop, M., et al. (eds.) STACOM 2019. LNCS, vol. 12009, pp. 176–185. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-39074-7_19

    Chapter  Google Scholar 

  6. Krebs, J., Mansi, T., Mailhé, B., Ayache, N., Delingette, H.: Unsupervised probabilistic deformation modeling for robust diffeomorphic registration. In: Stoyanov, D., et al. (eds.) DLMIA/ML-CDS -2018. LNCS, vol. 11045, pp. 101–109. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-00889-5_12

    Chapter  Google Scholar 

  7. Ossenberg-Engels, J., Grau, V.: Conditional generative adversarial networks for the prediction of cardiac contraction from individual frames. In: Pop, M., et al. (eds.) STACOM 2019. LNCS, vol. 12009, pp. 109–118. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-39074-7_12

    Chapter  Google Scholar 

  8. Petersen, S.E., et al.: UK Biobank’s cardiovascular magnetic resonance protocol. J. Cardiovasc. Magn. Reson. 18(1), 1–7 (2015)

    Article  Google Scholar 

  9. Qi, C.R., Yi, L., Su, H., Guibas, L.J.: PointNet++: deep hierarchical feature learning on point sets in a metric space. In: Advances in Neural Information Processing Systems, pp. 5099–5108 (2017)

    Google Scholar 

  10. WHO: Cardiovascular disease death rate (2019). https://www.who.int/en/news-room/fact-sheets/detail/cardiovascular-diseases-(cvds)

  11. Yang, Y., Feng, C., Shen, Y., Tian, D.: FoldingNet: interpretable unsupervised learning on 3D point clouds. arXiv preprint arXiv:1712.07262 (2017)

  12. Ye, M., et al.: PC-U net: learning to jointly reconstruct and segment the cardiac walls in 3D from CT data. In: Puyol Anton, E., et al. (eds.) STACOM 2020. LNCS, vol. 12592, pp. 117–126. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-68107-4_12

    Chapter  Google Scholar 

  13. Yuan, W., Khot, T., Held, D., Mertz, C., Hebert, M.: PCN: point completion network. In: 2018 International Conference on 3D Vision (3DV), pp. 728–737 (2018)

    Google Scholar 

Download references

Acknowledgments

This research has been conducted using the UK Biobank Resource under Application Number ‘40161’. The authors express no conflict of interest. The work of M. Beetz was supported by the Stiftung der Deutschen Wirtschaft (Foundation of German Business). The work of J. Ossenberg-Engels was supported by the Engineering and Physical Sciences Research Council (EPSRC) and Medical Research Council (MRC) [grant number EP/L016052/1]. The work of A. Banerjee was supported by the British Heart Foundation (BHF) Project under Grant HSR01230. The work of V. Grau was supported by the CompBioMed 2 Centre of Excellence in Computational Biomedicine (European Commission Horizon 2020 research and innovation programme, grant agreement No. 823712).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Marcel Beetz .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Beetz, M., Ossenberg-Engels, J., Banerjee, A., Grau, V. (2022). Predicting 3D Cardiac Deformations with Point Cloud Autoencoders. In: Puyol Antón, E., et al. Statistical Atlases and Computational Models of the Heart. Multi-Disease, Multi-View, and Multi-Center Right Ventricular Segmentation in Cardiac MRI Challenge. STACOM 2021. Lecture Notes in Computer Science(), vol 13131. Springer, Cham. https://doi.org/10.1007/978-3-030-93722-5_24

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-93722-5_24

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-93721-8

  • Online ISBN: 978-3-030-93722-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics