Zusammenfassung
Despite the visually appealing results, most Deep Learning-based super-resolution approaches lack the comprehensibility that is required for medical applications. We propose a modified version of the locally linear guided filter for the application of super-resolution in medical imaging. The guidance map itself is learned end-to-end from multimodal inputs, while the actual data is only processed with known operators. This ensures comprehensibility of the results and simplifies the implementation of guarantees. We demonstrate the possibilities of our approach based on multi-modal MR and cross-modal CT and MR data. For both datasets, our approach performs clearly better than bicubic upsampling. For projection images, we achieve SSIMs of up to 0.99, while slice image data results in SSIMs of up to 0.98 for four-fold upsampling given an image of the respective other modality at full resolution. In addition, end-to-end learning of the guidance map considerably improves the quality of the results.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Literatur
Köhler T. Multi-frame super-resolution reconstruction with applications to medical imaging. Friedrich-Alexander-Universität Erlangen-Nürnberg; 2018.
Wang Y, Perazzi F, McWilliams B, et al. A fully progressive approach to single-image super-resolution. IEEE Conf Comput Vis Pattern Recognit Work. 2018; p. 864-873.
Maier A, Schebesch F, Syben C, et al. Precision learning: towards use of known operators in neural networks. Proc ICPR. 2017;Available from: http://arxiv.org/abs/1712.00374.
Syben C, Stimpel B, Lommen J, et al. Deriving neural network architectures using precision learning: parallel-to-fan beam conversion. Proc Ger Conf Pattern Recognit. 2018;.
He K, Sun J, Tang X. Guided image filtering. IEEE Trans Pattern Anal Mach Intell. 2013;35(6):1397-1409.
Wu H, Zheng S, Zhang J, et al. Fast end-to-end trainable guided filter. IEEE Conf Comput Vis Pattern Recognit. 2018;.
Ronneberger O, Fischer P, Brox T. U-net: convolutional networks for biomedical image segmentation. Proc MICCAI. 2015; p. 234-241.
Johnson J, Alahi A, Fei-Fei L. Perceptual losses for real-time style transfer and super-resolution. arXiv:160308155. 2016;.
Simonyan K, Zisserman A. Very deep convolutional networks for large-scale image recognition. arXiv:14091556. 2015;.
Pieper S, Halle M, Kikinis R. 3D slicer. Proc ISBI. 2004;2:632-635.
Stimpel B, Syben C, Würfl T, et al. MR to X-ray projection image synthesis. Proc Fifth Int Conf Image Form X-Ray Comput Tomogr. 2017;.
Lommen JM, Syben C, Stimpel B, et al. MR-projection imaging with perspective distortion as in X-ray fluoroscopy for interventional X/MR-hybrid applications. Proc 12th Interv MRI Symp. 2018; p. 54.
Maier A, Hofmann HG, Berger M, et al. CONRAD: a software framework for cone-beam imaging in radiology. Med Phys. 2013;40(11).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Fachmedien Wiesbaden GmbH, ein Teil von Springer Nature
About this paper
Cite this paper
Stimpel, B., Syben, C., Schirrmacher, F., Hoelter, P., Dörfler, A., Maier, A. (2019). Multi-Modal Super-Resolution with Deep Guided Filtering. In: Handels, H., Deserno, T., Maier, A., Maier-Hein, K., Palm, C., Tolxdorff, T. (eds) Bildverarbeitung für die Medizin 2019. Informatik aktuell. Springer Vieweg, Wiesbaden. https://doi.org/10.1007/978-3-658-25326-4_25
Download citation
DOI: https://doi.org/10.1007/978-3-658-25326-4_25
Published:
Publisher Name: Springer Vieweg, Wiesbaden
Print ISBN: 978-3-658-25325-7
Online ISBN: 978-3-658-25326-4
eBook Packages: Computer Science and Engineering (German Language)