Abstract
We present an automated method for extrapolating missing regions in label data of the skull in an anatomically plausible manner. The ultimate goal is to design patient-specific cranial implants for correcting large, arbitrarily shaped defects of the skull that can, for example, result from trauma of the head.
Our approach utilizes a 3D statistical shape model (SSM) of the skull and a 2D generative adversarial network (GAN) that is trained in an unsupervised fashion from samples of healthy patients alone. By fitting the SSM to given input labels containing the skull defect, a first approximation of the healthy state of the patient is obtained. The GAN is then applied to further correct and smooth the output of the SSM in an anatomically plausible manner. Finally, the defect region is extracted using morphological operations and subtraction between the extrapolated healthy state of the patient and the defective input labels.
The method is trained and evaluated based on data from the MICCAI 2020 AutoImplant challenge. It produces state-of-the art results on regularly shaped cut-outs that were present in the training and testing data of the challenge. Furthermore, due to unsupervised nature of the approach, the method generalizes well to previously unseen defects of varying shapes that were only present in the hidden test dataset.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Li, J., Pepe, A., Gsaxner, C., von Campe, G., Egger, J.: A baseline approach for AutoImplant. In: The MICCAI 2020 Cranial Implant Design Challenge. arXiv: 2006.12449 (2020)
Fuessinger, M.A., et al.: Planning of skull reconstruction based on a statistical shape model combined with geometric morphometrics. Int. J. Comput. Assist. Radiol. Surg. 13(4), 519–529 (2017). https://doi.org/10.1007/s11548-017-1674-6
Goodfellow, I., et al.: Generative adversarial nets. In: Advances in Neural Information Processing Systems, vol. 27, pp. 2672–2680 (2014)
Kazeminia, S., et al.: GANs for medical image analysis. arXiv preprint arXiv:1809.06222 (2018)
Baur, C., Wiestler, B., Albarqouni, S., Navab, N.: Deep autoencoding models for unsupervised anomaly segmentation in brain MR images. In: Crimi, A., Bakas, S., Kuijf, H., Keyvan, F., Reyes, M., van Walsum, T. (eds.) BrainLes 2018. LNCS, vol. 11383, pp. 161–169. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-11723-8_16
Schlegl, T., Seeböck, P., Waldstein, S., Langs, G., Schmidt-Erfurth, U.: f-AnoGAN: fast unsupervised anomaly detection with generative adversarial networks. In: Medical Image Analysis, vol 54, pp. 30–44 (2019)
Yi, X., Babyn, P.: Sharpness-aware low-dose CT denoising using conditional generative adversarial network. J. Digit. Imaging 31, 655–669 (2018)
Hettich, G., et al.: Method for quantitative assessment of acetabular bone defects. J. Orthop. Res. 37, 181–189 (2019)
Lamecker, H., Seebaß, M., Hege, H.-C., Deuflhard, P.: A 3D statistical shape model of the pelvic bone for segmentation. In: Proceedings of SPIE Medical Imaging, vol. 5370, pp. 1341–1351 (2004)
Makhzani, A., Shlens, J., Jaitly, N., Goodfellow, I., Frey, B.: Adversarial autoencoders. arXiv preprint arXiv:1511.05644 (2015)
Radford, A., Metz, L., Chintala, S.: Unsupervised representation learning with deep convolutional generative adversarial networks. arXiv preprint arXiv:1511.06434 (2015)
Akcay, S., Atapour-Abarghouei, A., Breckon, T.P.: GANomaly: semi-supervised anomaly detection via adversarial training. In: Jawahar, C.V., Li, H., Mori, G., Schindler, K. (eds.) ACCV 2018. LNCS, vol. 11363, pp. 622–637. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-20893-6_39
Salimans, T., Goodfellow, I., Zaremba, W., Cheung, V., Radford, A., Chen, X.: Improved techniques for training GANs. In: Advances in Neural Information Processing Systems, pp. 2234–2242 (2016)
Isola, P., Zhu, J.Y., Zhou, T., Efros, A.A.: Image-to-image translation with conditional adversarial networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1125–1134 (2017)
Diederik, P.K., Lei Ba, J.: Adam: a method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014)
Seim, H., Kainmueller, D., Heller, M., Lamecker, H., Zachow, S, Hege, H.-C.: Automatic segmentation of the pelvic bones from CT data based on a statistical shape model. In: Eurographics Workshop on Visual Computing for Biomedicine, pp. 93–100 (2008)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Pimentel, P. et al. (2020). Automated Virtual Reconstruction of Large Skull Defects using Statistical Shape Models and Generative Adversarial Networks. In: Li, J., Egger, J. (eds) Towards the Automatization of Cranial Implant Design in Cranioplasty. AutoImplant 2020. Lecture Notes in Computer Science(), vol 12439. Springer, Cham. https://doi.org/10.1007/978-3-030-64327-0_3
Download citation
DOI: https://doi.org/10.1007/978-3-030-64327-0_3
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-64326-3
Online ISBN: 978-3-030-64327-0
eBook Packages: Computer ScienceComputer Science (R0)