Abstract
Intracranial hemorrhage (ICH) is a potentially life-threatening emergency due to various causes. Rapid and accurate diagnosis of ICH is critical to deliver timely treatments and improve patients’ survival rates. Although deep learning techniques have become the state-of-the-art in medical image processing and analysis, large training datasets with high-quality annotations that are expensive to acquire are often necessary for supervised learning. This is especially true for image segmentation tasks. To facilitate ICH treatment decisions and tackle this issue, we proposed a novel weakly supervised ICH segmentation method utilizing a hierarchical combination of self-attention maps obtained from a Swin transformer, which is trained through an ICH classification task with categorical labels. We developed and validated the proposed technique using two public clinical CT datasets (RSNA 2019 Brain CT hemorrhage & PhysioNet). As an exploratory study, we compared two different learning strategies (binary classification vs. full ICH subtyping) to investigate their impacts on self-attention and our weakly-supervised ICH segmentation method. As the first to perform ICH detection and weakly supervised segmentation with a Swin transformer, our algorithm achieved a Dice score of 0.407\(\,\pm \,\)0.225 for ICH segmentation while delivering high accuracy in ICH detection (AUC = 0.974).
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Apostolaki-Hansson, T., Ullberg, T., Pihlsgård, M., Norrving, B., Petersson, J.: Prognosis of intracerebral hemorrhage related to antithrombotic use: an observational study from the Swedish stroke register (riksstroke). Stroke 52(3), 966–974 (2021)
Chefer, H., Gur, S., Wolf, L.: Transformer interpretability beyond attention visualization. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 782–791 (2021)
Cho, J., et al.: Improving sensitivity on identification and delineation of intracranial hemorrhage lesion using cascaded deep learning models. J. Digit. Imaging 32 450–461 (2018)
Dai, Y., Gao, Y., Liu, F.: Transmed: transformers advance multi-modal medical image classification. Diagnostics 11(8), 1384 (2021)
Dalmaz, O., Yurt, M., Çukur, T.: Resvit: Residual vision transformers for multi-modal medical image synthesis. IEEE Trans. Med. Imaging, 1 (2022)
Dosovitskiy, A., et al.: An image is worth 16x16 words: Transformers for image recognition at scale. In: International Conference on Learning Representations (2021)
Flanders, A.E., et al.: Construction of a machine learning dataset through collaboration: the RSNA 2019 brain CT hemorrhage challenge. Radiol.: Artif. Intell. 2(3) (2020)
Gu, Y., Yang, K., Fu, S., Chen, S., Li, X., Marsic, I.: Multimodal affective analysis using hierarchical attention strategy with word-level alignment. In: Proceedings of the Conference Association for Computational Linguistics Meeting vol. 2018, p. 2225. NIH Public Access (2018)
Hssayeni, M.D., Croock, M.S., Salman, A.D., Al-khafaji, H.F., Yahya, Z.A., Ghoraani, B.: Intracranial hemorrhage segmentation using a deep convolutional model. Data 5(1), 14 (2020)
Lin, T.Y., Goyal, P., Girshick, R., He, K., Dollár, P.: Focal loss for dense object detection. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 2980–2988 (2017)
Liu, Z., et al.: Swin transformer: Hierarchical vision transformer using shifted windows. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 10012–10022 (2021)
Nemcek, J., Vicar, T., Jakubicek, R.: Weakly supervised deep learning-based intracranial hemorrhage localization. arXiv preprint arXiv:2105.00781 (2021)
Qureshi, A., Palesch, Y.: Antihypertensive treatment of acute cerebral hemorrhage (ATACH) ii: design, methods, and rationale. Neurocrit. Care 15(3), 559–576 (2011)
Rajashekar, D., Liang, J.W.: Intracerebral hemorrhage. In: StatPearls [Internet]. StatPearls Publishing (2021)
Salehinejad, H., et al.: A real-world demonstration of machine learning generalizability in the detection of intracranial hemorrhage on head computerized tomography. Scientific Reports 11(17051) (2021)
Selvaraju, R.R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., Batra, D.: Grad-cam: Visual explanations from deep networks via gradient-based localization. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 618–626 (2017)
Sindagi, V.A., Patel, V.M.: Ha-CNN: Hierarchical attention-based crowd counting network. IEEE Trans. Image Process. 29, 323–335 (2019)
Wightman, R.: Pytorch image models. https://github.com/rwightman/pytorch-image-models (2019)
Wu, K., Du, B., Luo, M., Wen, H., Shen, Y., Feng, J.: Weakly supervised brain lesion segmentation via attentional representation learning. In: Shen, D. (ed.) MICCAI 2019. LNCS, vol. 11766, pp. 211–219. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-32248-9_24
Yang, Z., Yang, D., Dyer, C., He, X., Smola, A., Hovy, E.: Hierarchical attention networks for document classification. In: Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pp. 1480–1489 (2016)
Ye, H., et al.: Precise diagnosis of intracranial hemorrhage and subtypes using a three-dimensional joint convolutional and recurrent neural network. Eur. Radiol. 29(11), 6191–6201 (2019). https://doi.org/10.1007/s00330-019-06163-2
Zhou, Z.H.: A brief introduction to weakly supervised learning. Natl. Sci. Rev. 5(1), 44–53 (2017)
Acknowledgement
This work was supported by a Fonds de recherche du Québec - Nature et technologies (FRQNT) Team Research Project Grant (2022-PR296459).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Rasoulian, A., Salari, S., Xiao, Y. (2022). Weakly Supervised Intracranial Hemorrhage Segmentation Using Hierarchical Combination of Attention Maps from a Swin Transformer. In: Abdulkadir, A., et al. Machine Learning in Clinical Neuroimaging. MLCN 2022. Lecture Notes in Computer Science, vol 13596. Springer, Cham. https://doi.org/10.1007/978-3-031-17899-3_7
Download citation
DOI: https://doi.org/10.1007/978-3-031-17899-3_7
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-17898-6
Online ISBN: 978-3-031-17899-3
eBook Packages: Computer ScienceComputer Science (R0)