Skip to main content

Explainable Deep Ensemble to Diagnose COVID-19 from CT Scans

  • Conference paper
  • First Online:
Fuzzy Logic and Technology, and Aggregation Operators (EUSFLAT 2023, AGOP 2023)

Abstract

Research on identification methods for the Coronavirus Disease 2019 (COVID-19) has increased in the last years and the need for automated detection methods has surged as well. Computed Tomography scan images have demonstrated to contain useful and sufficient information to detect COVID-19 by using machine learning and computational intelligence techniques. However, in order to expand their adoption in medical clinics, COVID-19 detection approaches need to drive the experts in the overall comprehension of the classification, to check the validity and meaningfulness of the prediction results. Herein, we propose a deep learning approach based on an ensemble of convolutional neural networks with the aim of detecting, very accurately and in an explainable way, COVID-19 patients by leveraging CT scan images. We also take advantage of transfer learning and apply the aforementioned deep ensemble to a large publicly available dataset, by clustering the images per lung lobe. Our results show good classification performance, good generalization potentials, as well as quite interpretable outcomes.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://doi.org/10.17632/8h65ywD2jr.3.

  2. 2.

    https://github.com/abdkhanstd/COVID-19.

  3. 3.

    https://www.tensorflow.org/.

  4. 4.

    https://bit.ly/34QJUSd.

  5. 5.

    https://keras.io/.

References

  1. Explainable AI to improve acceptance of convolutional neural networks for automatic classification of dopamine transporter spect in the diagnosis of clinically uncertain parkinsonian syndromes. Eur. J. Nucl. Med. Mol. Imaging 49(4), 1176–1186 (2022)

    Google Scholar 

  2. Ahuja, S., Panigrahi, B., Dey, N., et al.: Deep transfer learning-based automated detection of COVID-19 from lung CT scan slices. Appl. Intell. 51, 571–585 (2020)

    Article  Google Scholar 

  3. Ardakani, A.A., Kanafi, A.R., Acharya, U.R., Khadem, N., Mohammadi, A.: Application of deep learning technique to manage COVID-19 in routine clinical practice using CT images: results of 10 convolutional neural networks. Comput. Biol. Med. 121, 103795 (2020)

    Google Scholar 

  4. Aversano, L., Bernardi, M.L., Cimitile, M., Pecori, R.: Deep neural networks ensemble to detect COVID-19 from CT scans. Pattern Recognit. 120, 108135 (2021)

    Google Scholar 

  5. Bhandari, M., Shahi, T.B., Siku, B., Neupane, A.: Explanatory classification of CXR images into COVID-19, pneumonia and tuberculosis using deep learning and XAI. Comput. Biol. Med. 150, 106156 (2022)

    Google Scholar 

  6. Bose, A., Mali, K.: Type-reduced vague possibilistic fuzzy clustering for medical images. Pattern Recogn. 112, 107784 (2021)

    Google Scholar 

  7. Chollet, F.: Xception: Deep learning with depthwise separable convolutions. In: 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1800–1807 (2017)

    Google Scholar 

  8. Chung, J., et al.: Prediction of oxygen requirement in patients with COVID-19 using a pre-trained chest radiograph XAI model: efficient development of auditable risk prediction models via a fine-tuning approach. Sci. Rep. 12(1), 21164 (2022)

    Article  Google Scholar 

  9. Chung, M., et al.: CT imaging features of 2019 novel coronavirus (2019-nCoV). Radiology 295(1), 202–207 (2020)

    Article  Google Scholar 

  10. Colombi, D., et al.: Well-aerated lung on admitting chest CT to predict adverse outcome in COVID-19 pneumonia. Radiology 296(2), E86–E96 (2020)

    Article  Google Scholar 

  11. Dipto, S.M., Afifa, I., Sagor, M.K., Reza, M.T., Alam, M.A.: Interpretable COVID-19 classification leveraging ensemble neural network and XAI. In: Rojas, I., Castillo-Secilla, D., Herrera, L.J., Pomares, H. (eds.) BIOMESIP 2021. LNCS, vol. 12940, pp. 380–391. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-88163-4_33

    Chapter  Google Scholar 

  12. Gifani, P., Shalbaf, A., Vafaeezadeh, M.: Automated detection of COVID-19 using ensemble of transfer learning with deep convolutional neural network based on ct scans. Int. J. Comput. Assist. Radiol. Surg. 16(1), 115–123 (2021)

    Article  Google Scholar 

  13. Gitman, I., Lang, H., Zhang, P., Xiao, L.: Understanding the role of momentum in stochastic gradient methods. In: Wallach, H., Larochelle, H., Beygelzimer, A., d’Alché-Buc, F., Fox, E., Garnett, R. (eds.) Advances in Neural Information Processing Systems, vol. 32. Curran Associates, Inc. (2019)

    Google Scholar 

  14. Hasan, A.M., AL-Jawad, M.M., Jalab, H.A., Shaiba, H., Ibrahim, R.W., AL-Shamasneh, A.R.: Classification of COVID-19 coronavirus, pneumonia and healthy lungs in CT scans using q-deformed entropy and deep learning features. Entropy 22(5), 517 (2020)

    Article  Google Scholar 

  15. Hassan, M.M., AlQahtani, S.A., Alelaiwi, A., Papa, J.P.: Explaining COVID-19 diagnosis with Taylor decompositions. Neural Comput. Appl. (2022). S.I.: Deep Learning in Multimodal Medical Imaging for Cancer Detection

    Google Scholar 

  16. He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 770–778 (2016)

    Google Scholar 

  17. Holzinger, A., Langs, G., Denk, H., Zatloukal, K., Müller, H.: Causability and explainability of artificial intelligence in medicine. WIREs Data Min. Knowl. Discov. 9(4), e1312 (2019)

    Google Scholar 

  18. Howard, A.G., et al.: MobileNets: efficient convolutional neural networks for mobile vision applications (2017)

    Google Scholar 

  19. Hu, S., et al.: Weakly supervised deep learning for COVID-19 infection detection and classification from CT images. IEEE Access 8, 118869–118883 (2020)

    Article  Google Scholar 

  20. Jeon, B., Jang, Y., Shim, H., Chang, H.J.: Identification of coronary arteries in CT images by Bayesian analysis of geometric relations among anatomical landmarks. Pattern Recogn. 96, 106958 (2019)

    Google Scholar 

  21. Kwee, T.C., Kwee, R.M.: Chest CT in covid-19: what the radiologist needs to know. RadioGraphics 40(7), 1848–1865 (2020). pMID: 33095680

    Article  Google Scholar 

  22. Li, L., et al.: Using artificial intelligence to detect COVID-19 and community-acquired pneumonia based on pulmonary CT: evaluation of the diagnostic accuracy. Radiology 296(2), E65–E71 (2020)

    Article  Google Scholar 

  23. Roy, S., et al.: Deep learning for classification and localization of COVID-19 markers in point-of-care lung ultrasound. IEEE Trans. Med. Imaging 39(8), 2676–2687 (2020)

    Article  Google Scholar 

  24. Santosh, K.C.: AI-driven tools for coronavirus outbreak: need of active learning and cross-population train/test models on multitudinal/multimodal data. J. Med. Syst. 44(5), 93 (2020)

    Article  Google Scholar 

  25. Selvaraju, R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., Batra, D.: Grad-CAM: visual explanations from deep networks via gradient-based localization. arXiv preprint arXiv:1610.02391 (2016)

  26. Shastri, S., Singh, K., Kumar, S., Kour, P., Mansotra, V.: Deep-LSTM ensemble framework to forecast COVID-19: an insight to the global pandemic. Int. J. Inf. Technol. 13, 1291–1301 (2021)

    Google Scholar 

  27. Silva, P., et al.: COVID-19 detection in CT images with deep learning: a voting-based scheme and cross-datasets analysis. Inf. Med. Unlock. 20, 100427 (2020)

    Google Scholar 

  28. Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. In: Bengio, Y., LeCun, Y. (eds.) 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, 7–9 May 2015, Conference Track Proceedings (2015)

    Google Scholar 

  29. Tamburis, O., Mangia, M., Contenti, M., Mercurio, G., Rossi Mori, A.: The LITIS conceptual framework: measuring eHealth readiness and adoption dynamics across the healthcare organizations. Heal. Technol. 2(2), 97–112 (2012)

    Article  Google Scholar 

  30. Xiaowei, X., et al.: Deep learning system to screen coronavirus disease 2019 pneumoniax (2020)

    Google Scholar 

  31. Ye, Q., Xia, J., Yang, G.: Explainable AI for COVID-19 CT classifiers: an initial comparison study. In: 2021 IEEE 34th International Symposium on Computer-Based Medical Systems (CBMS), pp. 521–526 (2021)

    Google Scholar 

  32. Zhou, B., Khosla, A., Lapedriza, A., Oliva, A., Torralba, A.: Learning deep features for discriminative localization. In: IEEE Conference on Computer Vision and Pattern Recognition. IEEE Computer Society (2016)

    Google Scholar 

  33. Zhou, T., Lu, H., Yang, Z., Qiu, S., Huo, B., Dong, Y.: The ensemble deep learning model for novel COVID-19 on CT images. Appl. Soft Comput. 98, 106885 (2021)

    Google Scholar 

  34. Zou, L., et al.: Ensemble image explainable AI (XAI) algorithm for severe community-acquired pneumonia and COVID-19 respiratory infections. IEEE Trans. Artif. Intell. 4(2), 242–254 (2023). https://doi.org/10.1109/TAI.2022.3153754

    Article  Google Scholar 

Download references

Acknowledgments

The authors are grateful to Dr. Gaetana Cremone, Department of Radiology, “G. Fucito” Hospital, Mercato San Severino, SA, Italy, for her contribution in the evaluation of the explainability results. Prof. Riccardo Pecori is a member of the INdAM GNCS research group.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Riccardo Pecori .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Aversano, L., Bernardi, M.L., Cimitile, M., Pecori, R., Verdone, C. (2023). Explainable Deep Ensemble to Diagnose COVID-19 from CT Scans. In: Massanet, S., Montes, S., Ruiz-Aguilera, D., González-Hidalgo, M. (eds) Fuzzy Logic and Technology, and Aggregation Operators. EUSFLAT AGOP 2023 2023. Lecture Notes in Computer Science, vol 14069. Springer, Cham. https://doi.org/10.1007/978-3-031-39965-7_53

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-39965-7_53

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-39964-0

  • Online ISBN: 978-3-031-39965-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics