Abstract
Timely determination of whether there is intracerebral hemorrhage after thrombectomy is essential for follow-up treatment. But, this is extremely challenging with standard single-energy CT (SECT), because blood and contrast agents (injected during thrombectomy) have similar CT values under a single energy spectrum. In contrast, dual-energy CT (DECT) employs two different energy spectra, thus allowing to differentiate between hemorrhage and contrast extravasation in real time, based on energy-related attenuation characteristics between blood and contrast. However, compared to SECT scanners, DECT scanners have limited popularity due to high price. To address this dilemma, in this paper we first attempt to generate pseudo DECT images from a SECT image for real-time diagnosis of hemorrhage. More specifically, we propose a SECT-to-DECT generative adversarial network (S2DGAN), which is a 3D transformer-based multi-task learning framework equipped with a shared attention mechanism. Among them, the transformer-based architecture can guide S2DGAN to focus more on high-density areas (crucial for hemorrhage diagnosis) during the generation. Meanwhile, the introduced multi-task learning strategy and shared attention mechanism enable S2DGAN to model dependencies between interconnected generation tasks, improving generation performance while significantly reducing model parameters and computational complexity. Validated on clinical data, S2DGAN can generate DECT images better than state of-the-art methods and achieve an accuracy of \(90\%\) in hemorrhage diagnosis based only on SECT images.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Shao, Y., Xu, Y., Li, Y., Wen, X., He, X.: A new classification system for postinterventional cerebral hyperdensity: the influence on hemorrhagic transformation and clinical prognosis in acute stroke. Neural Plasticity, 2021 (2021)
Lyu, T., et al.: Estimating dual-energy CT imaging from single-energy CT data with material decomposition convolutional neural network. Med. Image Anal. 70, 102001 (2021)
Xiang, L., et al.: Deep auto-context convolutional neural networks for standard-dose PET image estimation from low-dose PET/MRI. Neurocomputing 267, 406–416 (2017)
Wang, Y., et al.: 3D conditional generative adversarial networks for high-quality PET image estimation at low dose. Neuroimage 174, 550–562 (2018)
Armanious, K., et al.: MedGAN: medical image translation using GANs. Comput. Med. Imaging Graph. 79, 101684 (2020)
Cao, B., Zhang, H., Wang, N., Gao, X., Shen, D.: Auto-GAN: self-supervised collaborative learning for medical image synthesis. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 34, no. 07, pp. 10486–10493 (2020)
Frid-Adar, M., Diamant, I., Klang, E., Amitai, M., Goldberger, J., Greenspan, H.: GAN-based synthetic medical image augmentation for increased CNN performance in liver lesion classification. Neurocomputing 321, 321–331 (2018)
Pan, Y., Liu, M., Xia, Y., Shen, D.: Disease-image-specific learning for diagnosis-oriented neuroimage synthesis with incomplete multi-modality data. IEEE Trans. Pattern Anal. Mach. Intell. 27(5), 1675–1686 (2021)
Wu, G., Jia, H., Wang, Q., Shen, D.: SharpMean: groupwise registration guided by sharp mean image and tree-based registration. Neuroimage 56(4), 1968–1981 (2011)
Jia, H., Wu, G., Wang, Q., Shen, D.: ABSORB: atlas building by self-organized registration and bundling. Neuroimage 51(3), 1057–1070 (2010)
Jia, H., Yap, P., Shen, D.: Iterative multi-atlas-based multi-image segmentation with tree-based registration. Neuroimage 59(1), 422–430 (2012)
Vaswani, A., et al.: Attention is all you need. Adv. Neural Inf. Process. Syst. 30, 5999–6009 (2017)
Luo, Y., et al.: 3D transformer-GAN for high-quality PET reconstruction. In: de Bruijne, M., et al. (eds.) MICCAI 2021. LNCS, vol. 12906, pp. 276–285. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-87231-1_27
Pan, K., Cheng, P., Huang, Z., Lin, L., Tang, X.: Transformer-based T2-weighted MRI synthesis from T1-weighted images. In: 2022 44th Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), pp. 5062–5065 (2022)
Lee, K., Chang, H., Jiang, L., Zhang, H., Tu, Z., Liu, C.: VitGAN: training GANs with vision transformers. arXiv preprint arXiv:2107.04589 (2021)
Jiang, Y., Chang, S., Wang, Z.: TransGAN: two transformers can make one strong GAN. arXiv preprint arXiv:2102.07074, 1(3) (2021)
Peiris, H., Hayat, M., Chen, Z., Egan, G., Harandi, M.: A robust volumetric transformer for accurate 3D tumor segmentation. In: Wang, L., Dou, Q., Fletcher, P.T., Speidel, S., Li, S. (eds.) Medical Image Computing and Computer Assisted Intervention – MICCAI 2022. MICCAI 2022. LNCS, vol. 13435, pp. 162–172. Springer, Cham (2022). https://doi.org/10.1007/978-3-031-16443-9_16
Bhattacharjee, D., Zhang, T., Sustrunk, S., Salzmann, M.: MulT: an end-to-end multitask learning transformer. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 12031–12041 (2022)
Liu, Z., et al.: Swin transformer: hierarchical vision transformer using shifted windows. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 10012–10022 (2021)
Chen, L., Papandreou, G., Kokkinos, I., Murphy, K., Yuille, A.: Deeplab: semantic image segmentation with deep convolutional nets, Atrous convolution, and fully connected CRFs. IEEE Trans. Pattern Anal. Mach. Intell. 40, 834–848 (2017)
Chen, Z., Badrinarayanan, V., Lee, C.Y., Rabinovich, A.: Gradnorm: gradient normalization for adaptive loss balancing in deep multitask networks. In: International Conference on Machine Learning, pp. 794–803 (2018)
Bodanapally, U., et al.: Dual-energy CT in hemorrhagic progression of cerebral contusion: overestimation of hematoma volumes on standard 120-kv images and rectification with virtual high-energy monochromatic images after contrast-enhanced whole-body imaging. Am. J. Neuroradiol. 39(4), 658–662 (2018)
Chen, J., Wei, J., Li, R.: TarGAN: target-aware generative adversarial networks for multi-modality medical image translation. In: International Conference on Medical Image Computing and Computer-Assisted Intervention, pp. 24–33 (2021)
Acknowledgment
This work was supported in part by National Natural Science Foundation of China (No. 62131015), Science and Technology Commission of Shanghai Municipality (STCSM) (No. 21010502600), The Key R &D Program of Guangdong Province, China (No. 2021B0101420006), and the China Postdoctoral Science Foundation (Nos. BX2021333, 2021M703340). This work was completed under the close collaboration between C. Jiang and Y. Pan, and they contributed equally to this work.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Jiang, C. et al. (2023). S2DGAN: Generating Dual-energy CT from Single-energy CT for Real-time Determination of Intracerebral Hemorrhage. In: Frangi, A., de Bruijne, M., Wassermann, D., Navab, N. (eds) Information Processing in Medical Imaging. IPMI 2023. Lecture Notes in Computer Science, vol 13939. Springer, Cham. https://doi.org/10.1007/978-3-031-34048-2_29
Download citation
DOI: https://doi.org/10.1007/978-3-031-34048-2_29
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-34047-5
Online ISBN: 978-3-031-34048-2
eBook Packages: Computer ScienceComputer Science (R0)