Abstract
Mechanical contraction and relaxation of the heart play an important role in evaluating healthy and diseased cardiac function. Mechanical patterns consist of complex non-linear 3D deformations that vary considerably between subjects and are difficult to observe on 2D images, which impacts the prediction accuracy of cardiac outcomes. In this work, we aim to capture 3D biventricular deformations at the end-diastolic (ED) and end-systolic (ES) phases of the cardiac cycle with a novel geometric deep learning approach. Our network consists of an encoder-decoder structure that works directly with light-weight point cloud data. We initially train our network on pairs of ED and ES point clouds stemming from a mixed population of subjects with the aim of accurately predicting ED outputs from ES inputs as well as ES outputs from ED inputs. We validate our network’s performance using the Chamfer distance (CD) and find that ED and ES predictions can be achieved with an average CD of 1.66 ± 0.62 mm on a dataset derived from the UK Biobank cohort with an underlying voxel size of \(1.8 \times 1.8 \times 8.0\) mm [8]. We derive structural and functional clinical metrics such as myocardial mass, ventricular volume, ejection fraction, and stroke volume from the predictions and find an average mean deviation from their respective gold standards of 1.6% and comparable standard deviations. Finally, we show our method’s ability to capture deformation differences between specific subpopulations in the dataset.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Beetz, M., Banerjee, A., Grau, V.: Biventricular surface reconstruction from cine MRI contours using point completion networks. In: 2021 IEEE 18th International Symposium on Biomedical Imaging (ISBI), pp. 105–109 (2021)
Bello, G.A., et al.: Deep-learning cardiac motion analysis for human survival prediction. Nat. Mach. Intell. 1(2), 95–104 (2019)
Bernardini, F., Mittleman, J., Rushmeier, H., Silva, C., Taubin, G.: The ball-pivoting algorithm for surface reconstruction. IEEE Trans. Visual Comput. Graphics 5(4), 349–359 (1999)
Chang, Y., Jung, C.: Automatic cardiac MRI segmentation and permutation-invariant pathology classification using deep neural networks and point clouds. Neurocomputing 418, 270–279 (2020)
Krebs, J., Mansi, T., Ayache, N., Delingette, H.: Probabilistic motion modeling from medical image sequences: application to cardiac cine-MRI. In: Pop, M., et al. (eds.) STACOM 2019. LNCS, vol. 12009, pp. 176–185. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-39074-7_19
Krebs, J., Mansi, T., Mailhé, B., Ayache, N., Delingette, H.: Unsupervised probabilistic deformation modeling for robust diffeomorphic registration. In: Stoyanov, D., et al. (eds.) DLMIA/ML-CDS -2018. LNCS, vol. 11045, pp. 101–109. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-00889-5_12
Ossenberg-Engels, J., Grau, V.: Conditional generative adversarial networks for the prediction of cardiac contraction from individual frames. In: Pop, M., et al. (eds.) STACOM 2019. LNCS, vol. 12009, pp. 109–118. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-39074-7_12
Petersen, S.E., et al.: UK Biobank’s cardiovascular magnetic resonance protocol. J. Cardiovasc. Magn. Reson. 18(1), 1–7 (2015)
Qi, C.R., Yi, L., Su, H., Guibas, L.J.: PointNet++: deep hierarchical feature learning on point sets in a metric space. In: Advances in Neural Information Processing Systems, pp. 5099–5108 (2017)
WHO: Cardiovascular disease death rate (2019). https://www.who.int/en/news-room/fact-sheets/detail/cardiovascular-diseases-(cvds)
Yang, Y., Feng, C., Shen, Y., Tian, D.: FoldingNet: interpretable unsupervised learning on 3D point clouds. arXiv preprint arXiv:1712.07262 (2017)
Ye, M., et al.: PC-U net: learning to jointly reconstruct and segment the cardiac walls in 3D from CT data. In: Puyol Anton, E., et al. (eds.) STACOM 2020. LNCS, vol. 12592, pp. 117–126. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-68107-4_12
Yuan, W., Khot, T., Held, D., Mertz, C., Hebert, M.: PCN: point completion network. In: 2018 International Conference on 3D Vision (3DV), pp. 728–737 (2018)
Acknowledgments
This research has been conducted using the UK Biobank Resource under Application Number ‘40161’. The authors express no conflict of interest. The work of M. Beetz was supported by the Stiftung der Deutschen Wirtschaft (Foundation of German Business). The work of J. Ossenberg-Engels was supported by the Engineering and Physical Sciences Research Council (EPSRC) and Medical Research Council (MRC) [grant number EP/L016052/1]. The work of A. Banerjee was supported by the British Heart Foundation (BHF) Project under Grant HSR01230. The work of V. Grau was supported by the CompBioMed 2 Centre of Excellence in Computational Biomedicine (European Commission Horizon 2020 research and innovation programme, grant agreement No. 823712).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 Springer Nature Switzerland AG
About this paper
Cite this paper
Beetz, M., Ossenberg-Engels, J., Banerjee, A., Grau, V. (2022). Predicting 3D Cardiac Deformations with Point Cloud Autoencoders. In: Puyol Antón, E., et al. Statistical Atlases and Computational Models of the Heart. Multi-Disease, Multi-View, and Multi-Center Right Ventricular Segmentation in Cardiac MRI Challenge. STACOM 2021. Lecture Notes in Computer Science(), vol 13131. Springer, Cham. https://doi.org/10.1007/978-3-030-93722-5_24
Download citation
DOI: https://doi.org/10.1007/978-3-030-93722-5_24
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-93721-8
Online ISBN: 978-3-030-93722-5
eBook Packages: Computer ScienceComputer Science (R0)