Abstract
Magnetic Resonance Imaging (MRI) is a leading diagnostic modality for a wide range of exams, where multiple contrast images are often acquired for characterizing different tissues. However, acquiring high-resolution MRI typically extends scan time, which can introduce motion artifacts. Super-resolution of MRI therefore emerges as a promising approach to mitigate these challenges. Earlier studies have investigated the use of multiple contrasts for MRI super-resolution (MCSR), whereas majority of them did not fully exploit the rich contrast-invariant structural information. To fully utilize such crucial prior knowledge of multi-contrast MRI, in this work, we propose a novel structure-guided MCSR (SGSR) framework based on a new spatio-frequency co-query attention (CQA) mechanism. Specifically, CQA performs attention on features of multiple contrasts with a shared structural query, which is particularly designed to extract, fuse, and refine the common structures from different contrasts. We further propose a novel frequency-domain CQA module in addition to the spatial domain, to enable more fine-grained structural refinement. Extensive experiments on fastMRI knee data and low-field brain MRI show that SGSR outperforms state-of-the-art MCSR methods with statistical significance.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Du, T., et al.: Adaptive convolutional neural networks for accelerating magnetic resonance imaging via k-space data interpolation 72, 102098 (2021). https://doi.org/10.1016/j.media.2021.102098
Feng, C.M., Fu, H., Yuan, S., Xu, Y.: Multi-contrast MRI super-resolution via a multi-stage integration network. In: MICCAI 2021, pp. 140–149 (2021). https://doi.org/10.1007/978-3-030-87231-1_14
Feng, C.M., Yan, Y., Chen, G., Xu, Y., Hu, Y., Shao, L., Fu, H.: Multimodal transformer for accelerated MR imaging 42(10), 2804–2816 (2022). https://doi.org/10.1109/TMI.2022.3180228. https://ieeexplore.ieee.org/abstract/document/9796552, conference Name: IEEE Transactions on Medical Imaging
Feng, et al .: Exploring separable attention for multi-contrast MR image super-resolution. IEEE Trans. Neural Netw. Learn. Syst. 1–12. https://doi.org/10.1109/TNNLS.2023.3253557
00000000 Guo, P., Mei, Y., Zhou, J., Jiang, S., Patel, V.M.: ReconFormer: accelerated MRI reconstruction using recurrent transformer 43(1), 582–593 (2023). https://doi.org/10.1109/TMI.2023.3314747. https://ieeexplore.ieee.org/abstract/document/10251064, conference Name: IEEE Transactions on Medical Imaging
Huang, S., et al.: Accurate multi-contrast MRI super-resolution via a dual cross-attention transformer network. In: MICCAI 2023, pp. 313–322 (2023). https://doi.org/10.1007/978-3-031-43999-5_30
Li, G., Lyu, J., Wang, C., Dou, Q., Qin, J.: WavTrans: synergizing wavelet and cross-attention transformer for multi-contrast MRI super-resolution. In: MICCAI 2022, pp. 463–473 (2022). https://doi.org/10.1007/978-3-031-16446-0_44
Li, G., et al.: Rethinking multi-contrast MRI super-resolution: rectangle-window cross-attention transformer and arbitrary-scale upsampling, pp. 21230–21240 (2023)
Liang, J., Cao, J., Sun, G., Zhang, K., Van Gool, L., Timofte, R.: SwinIR: image restoration using swin transformer. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 1833–1844 (2021)
Lu, L., Li, W., Tao, X., Lu, J., Jia, J.: MASA-SR: matching acceleration and spatial adaptation for reference-based image super-resolution. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 6368–6377 (2021)
Lyu, J., Sui, B., Wang, C., Tian, Y., Dou, Q., Qin, J.: DuDoCAF: dual-domain cross-attention fusion with recurrent transformer for fast multi-contrast MR imaging. In: Medical Image Computing and Computer Assisted Intervention MICCAI 2022, pp. 474–484 (2022). https://doi.org/10.1007/978-3-031-16446-0_45
Lyu, M., et al.: M4raw: a multi-contrast, multi-repetition, multi-channel MRI k-space dataset for low-field MRI research 10(1), 264 (264). https://doi.org/10.1038/s41597-023-02181-4, publisher: Nature Publishing Group
Lyu, Q., et al.: Multi-contrast super-resolution MRI through a progressive network. IEEE Trans. Med. Imag. 39(9), 2738–2749 (2020)
Sun, L., Fan, Z., Fu, X., Huang, Y., Ding, X., Paisley, J.: A deep information sharing network for multi-contrast compressed sensing MRI reconstruction 28(12), 6141–6153 (2019). https://doi.org/10.1109/TIP.2019.2925288. https://ieeexplore.ieee.org/abstract/document/8758456, conference Name: IEEE Transactions on Image Processing
Yang, F., Yang, H., Fu, J., Lu, H., Guo, B.: Learning texture transformer network for image super-resolution. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 5791–5800 (2020)
Zbontar, J., et al.: fastMRI: an open dataset and benchmarks for accelerated MRI (2018). https://doi.org/10.48550/arXiv.1811.08839. http://arxiv.org/abs/1811.08839
Zhang, X., Zeng, H., Guo, S., Zhang, L.: Efficient long-range attention network for image super-resolution. In: ECCV 2022, pp. 649–667 (2022). https://doi.org/10.1007/978-3-031-19790-1_39
Zhao, L., et al.: JoJoNet: joint-contrast and joint-sampling-and-reconstruction network for multi-contrast MR (2022). https://doi.org/10.48550/arXiv.2210.12548. http://arxiv.org/abs/2210.12548
Zhou, B., Zhou, S.K.: DuDoRNet: learning a dual-domain recurrent network for fast MRI reconstruction with deep t1 prior, pp. 4273–4282 (2020)
Acknowledgements
This work was partially supported by the Engineering and Physical Sciences Research Council [grant number EP/X039277/1].
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
1 Electronic supplementary material
Below is the link to the electronic supplementary material.
Rights and permissions
Copyright information
© 2025 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Zheng, S., Wang, Y., Du, S., Qin, C. (2025). SGSR: Structure-Guided Multi-contrast MRI Super-Resolution via Spatio-Frequency Co-Query Attention. In: Xu, X., Cui, Z., Rekik, I., Ouyang, X., Sun, K. (eds) Machine Learning in Medical Imaging. MLMI 2024. Lecture Notes in Computer Science, vol 15241. Springer, Cham. https://doi.org/10.1007/978-3-031-73284-3_38
Download citation
DOI: https://doi.org/10.1007/978-3-031-73284-3_38
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-73283-6
Online ISBN: 978-3-031-73284-3
eBook Packages: Computer ScienceComputer Science (R0)
