Skip to main content
SpringerLink
Log in

Swin Transformer for COVID-19 Infection Percentage Estimation from CT-Scans

  • Conference paper
  • First Online:
Image Analysis and Processing. ICIAP 2022 Workshops (ICIAP 2022)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 13374))

Included in the following conference series:

Abstract

Coronavirus disease 2019 (COVID-19) is an infectious disease that has spread globally, disrupting the health care system and claiming millions of lives worldwide. Because of the high number of Covid-19 infections, it has been challenging for medical professionals to manage this crisis. Estimating the Covid-19 percentage can help medical staff categorize patients by severity and prioritize accordingly. With this approach, the intensive care unit (ICU) can free up resuscitation beds for the critical cases and provide other treatments for less severe cases to efficiently manage the healthcare system during a crisis. In this paper, we present a transformer-based method to estimate covid-19 infection percentage for monitoring the evolution of the patient state from computed tomography scans (CT-scans). We used a particular Transformer architecture called Swin Transformer as a backbone network to extract the feature from the CT slice and pass it through multi-layer perceptron (MLP) to obtain covid-19 infection percentage. We evaluated our approach on the covid-19 infection percentage estimation challenge dataset, annotated by two expert radiologists. The experimental results show that the proposed method achieves promising performance with a mean absolute error (MAE) of 4.5042, Pearson correlation coefficient (PC) of 0.9490, root mean square error (RMSE) of 8.0964 on the given Val set leaderboard and a MAE of 3.5569, PC of 0.8547 and RMSE of 7.5102 on the given Test set Leaderboard. These promising results demonstrate the high potential of Swin Transformer architecture for this image regression task of covid-19 infection percentage estimation from CT-scans. The source code of this project can be found at: https://github.com/suman560/Covid-19-infection-percentage-estimation.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Abhishek, T.: Tez: a simple PyTorch trainer. https://github.com/abhishekkrthakur/tez

  2. Bougourzi, F., Contino, R., Distante, C., Taleb-Ahmed, A.: CNR-IEMN: a deep learning based approach to recognise Covid-19 from CT-scan. In: 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), ICASSP 2021, pp. 8568–8572. IEEE (2021)

    Google Scholar 

  3. Bougourzi, F., Contino, R., Distante, C., Taleb-Ahmed, A.: Recognition of Covid-19 from CT scans using two-stage deep-learning-based approach: CNR-IEMN. Sensors 21(17), 5878 (2021)

    Article  Google Scholar 

  4. Bougourzi, F., Distante, C., Ouafi, A., Dornaika, F., Hadid, A., Taleb-Ahmed, A.: Per-Covid-19: a benchmark dataset for Covid-19 percentage estimation from CT-scans. J. Imaging 7(9), 189 (2021)

    Article  Google Scholar 

  5. Buslaev, A., Iglovikov, V.I., Khvedchenya, E., Parinov, A., Druzhinin, M., Kalinin, A.A.: Albumentations: fast and flexible image augmentations. Information 11(2) (2020). https://doi.org/10.3390/info11020125. https://www.mdpi.com/2078-2489/11/2/125

  6. Dosovitskiy, A., et al.: An image is worth 16x16 words: transformers for image recognition at scale. arXiv preprint arXiv:2010.11929 (2020)

  7. Fan, D.P., et al.: Inf-Net: automatic Covid-19 lung infection segmentation from CT images. IEEE Trans. Med. Imaging 39(8), 2626–2637 (2020)

    Article  Google Scholar 

  8. Goceri, E., Goceri, N.: Deep learning in medical image analysis: recent advances and future trends (2017)

    Google Scholar 

  9. Jalaber, C., Lapotre, T., Morcet-Delattre, T., Ribet, F., Jouneau, S., Lederlin, M.: Chest CT in Covid-19 pneumonia: a review of current knowledge. Diagn. Interv. Imaging 101(7–8), 431–437 (2020)

    Article  Google Scholar 

  10. Kucirka, L.M., Lauer, S.A., Laeyendecker, O., Boon, D., Lessler, J.: Variation in false-negative rate of reverse transcriptase polymerase chain reaction-based SARS-CoV-2 tests by time since exposure. Ann. Intern. Med. 173(4), 262–267 (2020)

    Article  Google Scholar 

  11. Lacerda, P., Barros, B., Albuquerque, C., Conci, A.: Hyperparameter optimization for Covid-19 pneumonia diagnosis based on chest CT. Sensors 21(6), 2174 (2021)

    Article  Google Scholar 

  12. Lassau, N., et al.: Integrating deep learning CT-scan model, biological and clinical variables to predict severity of Covid-19 patients. Nat. Commun. 12(1), 1–11 (2021)

    Article  Google Scholar 

  13. Lei, J., Li, J., Li, X., Qi, X.: CT imaging of the 2019 novel coronavirus (2019-nCoV) pneumonia. Radiology 295(1), 18 (2020)

    Article  Google Scholar 

  14. Litjens, G.: A survey on deep learning in medical image analysis. Med. Image Anal. 42, 60–88 (2017)

    Article  Google Scholar 

  15. Liu, Z., et al.: Swin transformer: hierarchical vision transformer using shifted windows. arXiv preprint arXiv:2103.14030 (2021)

  16. Paszke, A., et al.: PyTorch: an imperative style, high-performance deep learning library. Adv. Neural. Inf. Process. Syst. 32, 8026–8037 (2019)

    Google Scholar 

  17. Stefano, A., Comelli, A.: Customized efficient neural network for Covid-19 infected region identification in CT images. J. Imaging 7(8), 131 (2021)

    Article  Google Scholar 

  18. Vaishya, R., Javaid, M., Khan, I.H., Haleem, A.: Artificial intelligence (AI) applications for Covid-19 pandemic. Diab. Metab. Syndr. Clin. Res. Rev. 14(4), 337–339 (2020)

    Google Scholar 

  19. Vantaggiato, E., Paladini, E., Bougourzi, F., Distante, C., Hadid, A., Taleb-Ahmed, A.: Covid-19 recognition using ensemble-CNNs in two new chest X-ray databases. Sensors 21(5), 1742 (2021)

    Article  Google Scholar 

  20. Vaswani, A., et al.: Attention is all you need. In: Advances in Neural Information Processing Systems, pp. 5998–6008 (2017)

    Google Scholar 

  21. Voulodimos, A., Doulamis, N., Doulamis, A., Protopapadakis, E.: Deep learning for computer vision: a brief review. Comput. Intell. Neurosci. 2018, 1–14 (2018)

    Google Scholar 

  22. Voulodimos, A., Protopapadakis, E., Katsamenis, I., Doulamis, A., Doulamis, N.: A few-shot U-Net deep learning model for Covid-19 infected area segmentation in CT images. Sensors 21(6), 2215 (2021)

    Article  Google Scholar 

  23. Wang, G., et al.: A deep-learning pipeline for the diagnosis and discrimination of viral, non-viral and Covid-19 pneumonia from chest X-ray images. Nat. Biomed. Eng. 5(6), 509–521 (2021)

    Article  Google Scholar 

  24. Wang, L., Lin, Z.Q., Wong, A.: Covid-Net: a tailored deep convolutional neural network design for detection of Covid-19 cases from chest X-ray images. Sci. Rep. 10(1), 1–12 (2020)

    Google Scholar 

  25. Wang, X., et al.: A weakly-supervised framework for Covid-19 classification and lesion localization from chest CT. IEEE Trans. Med. Imaging 39(8), 2615–2625 (2020)

    Article  Google Scholar 

  26. Wightman, R.: PyTorch image models (2019). https://doi.org/10.5281/zenodo.4414861. https://github.com/rwightman/pytorch-image-models

  27. Zhao, X., et al.: D2A U-Net: automatic segmentation of Covid-19 lesions from CT slices with dilated convolution and dual attention mechanism. arXiv preprint arXiv:2102.05210 (2021)

Download references

Author information

Authors and Affiliations

  1. Taiyuan University of Technology, Taiyuan, China

    Suman Chaudhary, Wanting Yang & Yan Qiang

Authors
  1. Suman Chaudhary
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Wanting Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yan Qiang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Suman Chaudhary .

Editor information

Editors and Affiliations

  1. National Research Council, Lecce, Italy

    Pier Luigi Mazzeo

  2. Università Politecnica delle Marche, Ancona, Italy

    Emanuele Frontoni

  3. Boston University, Boston, MA, USA

    Stan Sclaroff

  4. National Research Council, Lecce, Italy

    Cosimo Distante

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Chaudhary, S., Yang, W., Qiang, Y. (2022). Swin Transformer for COVID-19 Infection Percentage Estimation from CT-Scans. In: Mazzeo, P.L., Frontoni, E., Sclaroff, S., Distante, C. (eds) Image Analysis and Processing. ICIAP 2022 Workshops. ICIAP 2022. Lecture Notes in Computer Science, vol 13374. Springer, Cham. https://doi.org/10.1007/978-3-031-13324-4_44

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-13324-4_44

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-13323-7

  • Online ISBN: 978-3-031-13324-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation