Skip to main content

Synthesising Brain Iron Maps from Quantitative Magnetic Resonance Images Using Interpretable Generative Adversarial Networks

  • Conference paper
  • First Online:
Medical Image Computing and Computer Assisted Intervention – MICCAI 2023 Workshops (MICCAI 2023)

Abstract

Accurate spatial estimation of brain iron concentration in-vivo is vital to elucidate the role of iron in neurodegenerative diseases, among other applications. However, ground truth quantitative iron maps of the brain can only be acquired post-mortem from ex-vivo samples. Quantitative magnetic resonance imaging (QMRI) methods are iron-sensitive and hold potential to quantitatively measure brain iron. We hypothesise interpretability methods can identify the most salient QMRI parameter(s) for iron prediction. In this study, a generative adversarial network with spatially adaptive normalisation layers (SPADE) was trained to synthesise maps of brain iron content from QMRI parameters, including those from relaxometry, diffusion and magnetisation transfer MRI. Ground truth maps of iron content were obtained by synchrotron radiation X-ray fluorescence (SRXRF). QMRI and SRXRF datasets were registered, and a distribution-based loss was proposed to address misalignment from multi-modal QMRI-to-SRXRF registration. To enable interpretation, channel attention was incorporated to learn feature importance for QMRI parameters. Attention weights were compared against occlusion and local interpretable model-agnostic explanations. Our model achieved dice scores of 0.97 and 0.95 for grey and white matter, respectively, when comparing tissue boundaries of synthesised vs. MRI images. Examining the contrast in predicted vs. ground truth iron maps, our model achieved 15.2% and 17.8% normalised absolute error for grey and white matter, respectively. All three interpretable methods ranked fractional anisotropy as the most salient, followed by myelin water fraction and magnetisation transfer ratio. The co-location of iron and myelin may explain the finding that myelin-related QMRI parameters are strong predictors of iron.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 59.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 74.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Ashraf, A., Clark, M, So, P.-W.: The aging of iron man. In: Frontiers in Aging Neuroscience 10, 65 (2018)

    Google Scholar 

  2. Ashraf, A., et al.: Iron dyshomeostasis, lipid peroxidation and perturbed expression of cystine/glutamate antiporter in Alzheimer’s disease: evidence of ferroptosis. Redox Biol. 32, 101494 (2020)

    Article  Google Scholar 

  3. Dalmaz, O., Yurt, M., Çukur, T.: ResViT: residual vision transformers for multimodal medical image synthesis. IEEE Trans. Med. Imaging 41(10), 2598–2614 (2022)

    Article  Google Scholar 

  4. Barros, A.D., et al.: Matching ex vivo MRI with iron histology: pearls and pitfalls. Front. Neuroan. 13, 68 (2019)

    Article  Google Scholar 

  5. Dixon, S.J., et al.: Ferroptosis: an iron-dependent form of nonapoptotic cell death. Cell 149(5), 1060–1072 (2012)

    Article  Google Scholar 

  6. Doucette, J., Kames, C., Rauscher, A.: DECAES - DEcomposition and component analysis of exponential signals. In: Zeitschrift Fur Medizinische Physik (2020). ISSN: 1876–4436. https://doi.org/10.1016/j.zemedi.2020.04.001

  7. Hametner, S., et al.: The influence of brain iron and myelin on magnetic susceptibility and effective transverse relaxation-A biochemical and histological validation study. Neuroimage 179, 117–133 (2018)

    Article  Google Scholar 

  8. Heusel, M., et al.: GANs trained by a two time-scale update rule converge to a local nash equilibrium. In: Advances in Neural Information Processing Systems, vol. 30 (2017)

    Google Scholar 

  9. Hu, J., Shen, L., Sun, G.: Squeeze-and-excitation networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 7132–7141 (2018)

    Google Scholar 

  10. Isola, P., et al.: Image-to-image translation with conditional adversarial networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1125–1134 (2017)

    Google Scholar 

  11. Karsa, A., Shmueli, K.: SEGUE: a speedy region-growing algorithm for unwrapping estimated phase. IEEE Trans. Med. Imaging 38(6), 1347–1357 (2018)

    Article  Google Scholar 

  12. Klages, P., et al.: Patch-based generative adversarial neural network models for head and neck MR-only planning. Med. Phys. 47(2), 626–642 (2020)

    Article  Google Scholar 

  13. Li, W., Bing, W., Liu, C.: Quantitative susceptibility mapping of human brain reflects spatial variation in tissue composition. Neuroimage 55(4), 1645–1656 (2011)

    Article  Google Scholar 

  14. Liu, T., et al.: A novel background field removal method for MRI using projection onto dipole fields. NMR Biomed. 24(9), 1129–1136 (2011)

    Article  Google Scholar 

  15. Mirza, M., Osindero, S.: Conditional generative adversarial nets. arXiv preprint arXiv:1411.1784 (2014)

  16. Miyato, T., et al.: Spectral normalization for generative adversarial networks. arXiv preprint arXiv:1802.05957 (2018)

  17. Park, T., et al.: Semantic image synthesis with spatially-adaptive normalization. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 2337–2346 (2019)

    Google Scholar 

  18. Ribeiro,M.T., Singh, S., Guestrin, C.: Why should i trust you? Explaining the Predictions of Any Classifier. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 1135–1144 (2016)

    Google Scholar 

  19. Saharia, C., et al.: Palette: image-to-image diffusion models. In: ACM SIGGRAPH 2022 Conference Proceedings, pp. 1–10 (2022)

    Google Scholar 

  20. Shin, H.-G., et al.: \(\chi \)-separation: magnetic susceptibility source separation toward iron and myelin mapping in the brain. Neuroimage 240, 118371 (2021)

    Article  Google Scholar 

  21. Stüber, C., et al.: Myelin and iron concentration in the human brain: a quantitative study of MRI contrast. Neuroimage 93, 95–106 (2014)

    Article  Google Scholar 

  22. Walker, T., et al.: Dissociation between iron accumulation and ferritin upregulation in the aged substantia NIGRA: attenuation by dietary restriction. Aging (Albany NY) 8(10), 2488 (2016)

    Article  Google Scholar 

  23. Wang, T.-C., et al.: High-resolution image synthesis and semantic manipulation with conditional GANs. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 8798–8807 (2018)

    Google Scholar 

  24. Woo, S., et al.: CBAM: convolutional block attention module. In: Proceedings of the European Conference on Computer Vision (ECCV), pp. 3–19 (2018)

    Google Scholar 

  25. Yan, W., et al.: The domain shift problem of medical image segmentation and vendor-adaptation by Unet-GAN. In: Shen, D., et al. (eds.) MICCAI 2019. LNCS, vol. 11765, pp. 623–631. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-32245-8_69

    Chapter  Google Scholar 

  26. Yang, Q., et al.: MRI cross-modality image-to-image translation. Sci. Rep. 10(1), 3753 (2020)

    Article  MathSciNet  Google Scholar 

  27. You, C., et al.: CT super-resolution GAN constrained by the identical, residual, and cycle learning ensemble (GAN-CIRCLE). IEEE Trans. Med. Imaging 39(1), 188–203 (2019)

    Article  Google Scholar 

  28. Zeiler, M.D., Fergus, R.: Visualizing and understanding convolutional networks. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014. LNCS, vol. 8689, pp. 818–833. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-10590-1_53

    Chapter  Google Scholar 

  29. Zhang, H., et al.: mixup: beyond empirical risk minimization. arXiv preprint arXiv:1710.09412 (2017)

Download references

Author information

Authors and Affiliations

Authors

Corresponding authors

Correspondence to Lindsay Munroe or Po-Wah So .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Munroe, L. et al. (2023). Synthesising Brain Iron Maps from Quantitative Magnetic Resonance Images Using Interpretable Generative Adversarial Networks. In: Woo, J., et al. Medical Image Computing and Computer Assisted Intervention – MICCAI 2023 Workshops. MICCAI 2023. Lecture Notes in Computer Science, vol 14394. Springer, Cham. https://doi.org/10.1007/978-3-031-47425-5_20

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-47425-5_20

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-47424-8

  • Online ISBN: 978-3-031-47425-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics