Abstract
Point Distribution Models (PDM) require a dataset in which point-to-point correspondence between the individual shapes has been established. However, in the medical domain, minimising radiation exposure and pathological deformations are reasons why healthy anatomies are often only available as partial observations. To exploit the partial shapes for learning shape models, previous methods required at least a few complete shapes and, either a robust registration method or a robust learning algorithm. Our proposed method implements the idea of multiple imputations from Bayesian statistics. We learn a PDM from a dataset consisting of only incomplete shapes and a single full template. For this, we first estimate the posterior distribution of point-to-point registrations for each partial observation. Then we construct the PDM from the set of registration distributions. We quantitatively evaluate our method on a 2D dataset of hands and a 3D dataset of femurs with known ground-truth. Furthermore, we showcase how to use our method on only partial clinical data to build a 3D statistical model of the human skull. The code is made open-source and the synthetic dataset publicly available .
Code available at https://github.com/unibas-gravis/shape-priors-from-pieces.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
- 2.
Available at the SICAS Medical Image Repository [12].
References
Ambellan, F., Zachow, S., von Tycowicz, C.: A surface-theoretic approach for statistical shape modeling. In: Shen, D., et al. (eds.) MICCAI 2019. LNCS, vol. 11767, pp. 21–29. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-32251-9_3
Egger, B., Schirmer, M.D., Dubost, F., Nardin, M.J., Rost, N.S., Golland, P.: Patient-specific conditional joint models of shape, image features and clinical indicators. In: Shen, D., et al. (eds.) MICCAI 2019. LNCS, vol. 11767, pp. 93–101. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-32251-9_11
Filzmoser, P., Maronna, R., Werner, M.: Outlier identification in high dimensions. Comput. Stat. Data Anal. 52(3), 1694–1711 (2008)
Gelman, A., Carlin, J.B., Stern, H.S., Dunson, D.B., Vehtari, A., Rubin, D.B.: Bayesian Data Analysis. CRC Press (2013)
Gerig, T., et al.: Morphable face models-an open framework. In: 2018 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018), pp. 75–82. IEEE (2018)
Görtler, J., Spinner, T., Streeb, D., Weiskopf, D., Deussen, O.: Uncertainty-aware principal component analysis. IEEE Trans. Visual Comput. Graphics 26(1), 822–831 (2019)
Gutierrez, B., Mateus, D., Shiban, E., Meyer, B., Lehmberg, J., Navab, N.: A sparse approach to build shape models with routine clinical data. In: 2014 IEEE 11th International Symposium on Biomedical Imaging (ISBI), pp. 258–261. IEEE (2014)
Hastie, T., Tibshirani, R., Friedman, J.: The Elements of Statistical Learning: Data Mining, Inference, and Prediction. Springer, New York (2009)
Hastings, W.K.: Monte Carlo sampling methods using Markov chains and their applications (1970)
Jingting, M., Lentzen, K., Honsdorf, J., Feng, L., Erdt, M.: Statistical shape modeling from Gaussian distributed incomplete data for image segmentation. In: Oyarzun Laura, C., et al. (eds.) CLIP 2015. LNCS, vol. 9401, pp. 113–121. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-31808-0_14
Kim, J., Çetin, M., Willsky, A.S.: Nonparametric shape priors for active contour-based image segmentation. Sig. Process. 87(12), 3021–3044 (2007)
Kistler, M., Bonaretti, S., Pfahrer, M., Niklaus, R., Büchler, P.: The virtual skeleton database: an open access repository for biomedical research and collaboration. J. Med. Internet Res. 15(11), e245 (2013)
Lüthi, M., Albrecht, T., Vetter, T.: Building shape models from lousy data. In: Yang, G.-Z., Hawkes, D., Rueckert, D., Noble, A., Taylor, C. (eds.) MICCAI 2009. LNCS, vol. 5762, pp. 1–8. Springer, Heidelberg (2009). https://doi.org/10.1007/978-3-642-04271-3_1
Lüthi, M., Gerig, T., Jud, C., Vetter, T.: Gaussian process morphable models. IEEE Trans. Pattern Anal. Mach. Intell. 40(8), 1860–1873 (2017)
Ma, J., Lin, F., Honsdorf, J., Lentzen, K., Wesarg, S., Erdt, M.: Weighted robust PCA for statistical shape modeling. In: Zheng, G., Liao, H., Jannin, P., Cattin, P., Lee, S.-L. (eds.) MIAR 2016. LNCS, vol. 9805, pp. 343–353. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-43775-0_31
Ma, J., Wang, A., Lin, F., Wesarg, S., Erdt, M.: A novel robust kernel principal component analysis for nonlinear statistical shape modeling from erroneous data. Comput. Med. Imaging Graph. 77, 101638 (2019)
Madsen, D., Morel-Forster, A., Kahr, P., Rahbani, D., Vetter, T., Lüthi, M.: A closest point proposal for MCMC-based probabilistic surface registration. In: Proceedings of the European Conference on Computer Vision (ECCV), August 2020
Madsen, D., Vetter, T., Lüthi, M.: Probabilistic Surface Reconstruction with Unknown Correspondence. In: Greenspan, H., et al. (eds.) CLIP/UNSURE -2019. LNCS, vol. 11840, pp. 3–11. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-32689-0_1
Morel-Forster, A., Gerig, T., Lüthi, M., Vetter, T.: Probabilistic fitting of active shape models. In: Reuter, M., Wachinger, C., Lombaert, H., Paniagua, B., Lüthi, M., Egger, B. (eds.) ShapeMI 2018. LNCS, vol. 11167, pp. 137–146. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-04747-4_13
Rubin, D.B.: Multiple imputations in sample surveys-a phenomenological Bayesian approach to nonresponse. In: Proceedings of the Survey Research Methods Section of the American Statistical Association, vol. 1, pp. 20–34. American Statistical Association (1978)
Styner, M.A., et al.: Evaluation of 3D correspondence methods for model building. In: Taylor, C., Noble, J.A. (eds.) IPMI 2003. LNCS, vol. 2732, pp. 63–75. Springer, Heidelberg (2003). https://doi.org/10.1007/978-3-540-45087-0_6
Tipping, M.E., Bishop, C.M.: Probabilistic principal component analysis. J. R. Stat. Soc. Ser. B (Stat. Methodol.) 61(3), 611–622 (1999)
Tsai, A., et al.: A shape-based approach to the segmentation of medical imagery using level sets. IEEE Trans. Med. Imaging 22(2), 137–154 (2003)
Xiao, D., et al.: Estimating reference bony shape model for personalized surgical reconstruction of posttraumatic facial defects. In: Shen, D., et al. (eds.) MICCAI 2019. LNCS, vol. 11768, pp. 327–335. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-32254-0_37
Yang, H., Liu, Z., Yang, X.: Right ventricle segmentation in short-axis MRI using a shape constrained dense connected U-Net. In: Shen, D., et al. (eds.) MICCAI 2019. LNCS, vol. 11765, pp. 532–540. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-32245-8_59
Yuan, Y.C.: Multiple imputation for missing data: concepts and new development. In: Proceedings of the Twenty-Fifth Annual SAS Users Group International Conference, vol. 267 (2000)
Yue, Q., Luo, X., Ye, Q., Xu, L., Zhuang, X.: Cardiac segmentation from LGE MRI using deep neural network incorporating shape and spatial priors. In: Shen, D., et al. (eds.) MICCAI 2019. LNCS, vol. 11765, pp. 559–567. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-32245-8_62
Zhou, X.-Y., Wang, Z.-Y., Li, P., Zheng, J.-Q., Yang, G.-Z.: One-stage shape instantiation from a single 2D image to 3D point cloud. In: Shen, D., et al. (eds.) MICCAI 2019. LNCS, vol. 11767, pp. 30–38. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-32251-9_4
Acknowledgements
This research is sponsored by the Gebert Rüf Foundation under the project GRS-029/17.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Madsen, D., Aellen, J., Morel-Forster, A., Vetter, T., Lüthi, M. (2020). Learning Shape Priors from Pieces. In: Reuter, M., Wachinger, C., Lombaert, H., Paniagua, B., Goksel, O., Rekik, I. (eds) Shape in Medical Imaging. ShapeMI 2020. Lecture Notes in Computer Science(), vol 12474. Springer, Cham. https://doi.org/10.1007/978-3-030-61056-2_3
Download citation
DOI: https://doi.org/10.1007/978-3-030-61056-2_3
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-61055-5
Online ISBN: 978-3-030-61056-2
eBook Packages: Computer ScienceComputer Science (R0)
