Abstract
Accurate spatial estimation of brain iron concentration in-vivo is vital to elucidate the role of iron in neurodegenerative diseases, among other applications. However, ground truth quantitative iron maps of the brain can only be acquired post-mortem from ex-vivo samples. Quantitative magnetic resonance imaging (QMRI) methods are iron-sensitive and hold potential to quantitatively measure brain iron. We hypothesise interpretability methods can identify the most salient QMRI parameter(s) for iron prediction. In this study, a generative adversarial network with spatially adaptive normalisation layers (SPADE) was trained to synthesise maps of brain iron content from QMRI parameters, including those from relaxometry, diffusion and magnetisation transfer MRI. Ground truth maps of iron content were obtained by synchrotron radiation X-ray fluorescence (SRXRF). QMRI and SRXRF datasets were registered, and a distribution-based loss was proposed to address misalignment from multi-modal QMRI-to-SRXRF registration. To enable interpretation, channel attention was incorporated to learn feature importance for QMRI parameters. Attention weights were compared against occlusion and local interpretable model-agnostic explanations. Our model achieved dice scores of 0.97 and 0.95 for grey and white matter, respectively, when comparing tissue boundaries of synthesised vs. MRI images. Examining the contrast in predicted vs. ground truth iron maps, our model achieved 15.2% and 17.8% normalised absolute error for grey and white matter, respectively. All three interpretable methods ranked fractional anisotropy as the most salient, followed by myelin water fraction and magnetisation transfer ratio. The co-location of iron and myelin may explain the finding that myelin-related QMRI parameters are strong predictors of iron.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Ashraf, A., Clark, M, So, P.-W.: The aging of iron man. In: Frontiers in Aging Neuroscience 10, 65 (2018)
Ashraf, A., et al.: Iron dyshomeostasis, lipid peroxidation and perturbed expression of cystine/glutamate antiporter in Alzheimer’s disease: evidence of ferroptosis. Redox Biol. 32, 101494 (2020)
Dalmaz, O., Yurt, M., Çukur, T.: ResViT: residual vision transformers for multimodal medical image synthesis. IEEE Trans. Med. Imaging 41(10), 2598–2614 (2022)
Barros, A.D., et al.: Matching ex vivo MRI with iron histology: pearls and pitfalls. Front. Neuroan. 13, 68 (2019)
Dixon, S.J., et al.: Ferroptosis: an iron-dependent form of nonapoptotic cell death. Cell 149(5), 1060–1072 (2012)
Doucette, J., Kames, C., Rauscher, A.: DECAES - DEcomposition and component analysis of exponential signals. In: Zeitschrift Fur Medizinische Physik (2020). ISSN: 1876–4436. https://doi.org/10.1016/j.zemedi.2020.04.001
Hametner, S., et al.: The influence of brain iron and myelin on magnetic susceptibility and effective transverse relaxation-A biochemical and histological validation study. Neuroimage 179, 117–133 (2018)
Heusel, M., et al.: GANs trained by a two time-scale update rule converge to a local nash equilibrium. In: Advances in Neural Information Processing Systems, vol. 30 (2017)
Hu, J., Shen, L., Sun, G.: Squeeze-and-excitation networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 7132–7141 (2018)
Isola, P., et al.: Image-to-image translation with conditional adversarial networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1125–1134 (2017)
Karsa, A., Shmueli, K.: SEGUE: a speedy region-growing algorithm for unwrapping estimated phase. IEEE Trans. Med. Imaging 38(6), 1347–1357 (2018)
Klages, P., et al.: Patch-based generative adversarial neural network models for head and neck MR-only planning. Med. Phys. 47(2), 626–642 (2020)
Li, W., Bing, W., Liu, C.: Quantitative susceptibility mapping of human brain reflects spatial variation in tissue composition. Neuroimage 55(4), 1645–1656 (2011)
Liu, T., et al.: A novel background field removal method for MRI using projection onto dipole fields. NMR Biomed. 24(9), 1129–1136 (2011)
Mirza, M., Osindero, S.: Conditional generative adversarial nets. arXiv preprint arXiv:1411.1784 (2014)
Miyato, T., et al.: Spectral normalization for generative adversarial networks. arXiv preprint arXiv:1802.05957 (2018)
Park, T., et al.: Semantic image synthesis with spatially-adaptive normalization. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 2337–2346 (2019)
Ribeiro,M.T., Singh, S., Guestrin, C.: Why should i trust you? Explaining the Predictions of Any Classifier. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 1135–1144 (2016)
Saharia, C., et al.: Palette: image-to-image diffusion models. In: ACM SIGGRAPH 2022 Conference Proceedings, pp. 1–10 (2022)
Shin, H.-G., et al.: \(\chi \)-separation: magnetic susceptibility source separation toward iron and myelin mapping in the brain. Neuroimage 240, 118371 (2021)
Stüber, C., et al.: Myelin and iron concentration in the human brain: a quantitative study of MRI contrast. Neuroimage 93, 95–106 (2014)
Walker, T., et al.: Dissociation between iron accumulation and ferritin upregulation in the aged substantia NIGRA: attenuation by dietary restriction. Aging (Albany NY) 8(10), 2488 (2016)
Wang, T.-C., et al.: High-resolution image synthesis and semantic manipulation with conditional GANs. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 8798–8807 (2018)
Woo, S., et al.: CBAM: convolutional block attention module. In: Proceedings of the European Conference on Computer Vision (ECCV), pp. 3–19 (2018)
Yan, W., et al.: The domain shift problem of medical image segmentation and vendor-adaptation by Unet-GAN. In: Shen, D., et al. (eds.) MICCAI 2019. LNCS, vol. 11765, pp. 623–631. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-32245-8_69
Yang, Q., et al.: MRI cross-modality image-to-image translation. Sci. Rep. 10(1), 3753 (2020)
You, C., et al.: CT super-resolution GAN constrained by the identical, residual, and cycle learning ensemble (GAN-CIRCLE). IEEE Trans. Med. Imaging 39(1), 188–203 (2019)
Zeiler, M.D., Fergus, R.: Visualizing and understanding convolutional networks. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014. LNCS, vol. 8689, pp. 818–833. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-10590-1_53
Zhang, H., et al.: mixup: beyond empirical risk minimization. arXiv preprint arXiv:1710.09412 (2017)
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Munroe, L. et al. (2023). Synthesising Brain Iron Maps from Quantitative Magnetic Resonance Images Using Interpretable Generative Adversarial Networks. In: Woo, J., et al. Medical Image Computing and Computer Assisted Intervention – MICCAI 2023 Workshops. MICCAI 2023. Lecture Notes in Computer Science, vol 14394. Springer, Cham. https://doi.org/10.1007/978-3-031-47425-5_20
Download citation
DOI: https://doi.org/10.1007/978-3-031-47425-5_20
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-47424-8
Online ISBN: 978-3-031-47425-5
eBook Packages: Computer ScienceComputer Science (R0)