Abstract
Deep learning plays a crucial role in identifying COVID-19 patients from computed tomography (CT) scans by leveraging its ability to analyze vast amounts of image data and extract patterns indicative of the disease. While deep learning-based models have consistently achieved state-of-the-art performance, the incorporation of relevant handcrafted features alongside deep learning-based features has the potential to enhance overall performance even further. Therefore, this paper proposes a hybrid approach that combines handcrafted and deep learning features from CT scan images for accurate COVID-19 classification. Handcrafted features capturing image statistics are derived through radiomics, while deep learning features are extracted using the Xception model. Preprocessing techniques like binary thresholding and segmentation are used to remove noises and locate the proper diseased area to enhance COVID-19 diagnosis. The approach is evaluated on a dataset of 2482 CT scan images and outperforms state-of-the-art techniques with an accuracy of 0.98, a positive predictive value (PPV) of 0.99, sensitivity of 0.99, specificity of 0.98, and an \(F_1\)-score of 0.99. The combined use of radiomics and deep learning features can make it a promising tool for COVID-19 diagnosis and monitoring, offering support for clinical decision-making and potentially benefiting other respiratory diseases.
Similar content being viewed by others
Data availability
The dataset for the current study is available at: www.kaggle.com/plameneduardo/sarscov2-ctscan-dataset and unseen dataset is available at : https://github.com/UCSD-AI4H/COVID-CT.
References
Abbas A, Abdelsamea MM, Gaber MM (2021) Classification of COVID-19 in chest X-ray images using DeTraC deep convolutional neural network. Appl Intell 51(2):854–864
Ahmad M, Bajwa UI, Mehmood Y, Anwar MW (2023) Lightweight ResGRU: a deep learning-based prediction of SARS-CoV-2 (COVID-19) and its severity classification using multimodal chest radiography images. Neural Comput Appl 35(13):9637–9655
Angelov P, Soares E (2020) Towards explainable deep neural networks (xDNN). Neural Netw 130:185–194
Cai Q, Du S-Y, Gao S, Huang G-L, Zhang Z, Li S et al (2020) A model based on CT radiomic features for predicting RT-PCR becoming negative in coronavirus disease 2019 (COVID-19) patients. BMC Med Imaging 20(1):1–10
Chen H, Zeng M, Wang X, Su L, Xia Y, Yang Q, Liu D (2021) A CTbased radiomics nomogram for predicting prognosis of coronavirus disease 2019 (COVID-19) radiomics nomogram predicting COVID-19. Br J Radiol 94(1117):20200634
Chen Y, Wang Y, Zhang Y, Zhang N, Zhao S, Zeng H, Song B (2020) A quantitative and radiomics approach to monitoring ARDS in COVID-19 patients based on chest CT: a retrospective cohort study. Int J Med Sci 17(12):1773
Cheng S, Fang M, Cui C, Chen X, Yin G, Prasad SK, Zhao S (2018) LGE-CMR-derived texture features reflect poor prognosis in hypertrophic cardiomyopathy patients with systolic dysfunction: preliminary results. Eur Radiol 28(11):4615–4624
Chollet F (2017) Xception: Deep learning with depthwise separable convolutions. In Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 1251–1258
Chutia U, Tewari AS, Singh JP (2023) Collapsed lung disease classification by coupling denoising algorithms and deep learning techniques. Netw Model Anal Health Inform Bioinform 13(1):1
Chutia U, Tewari AS, Singh JP (2024) Classification of lung diseases using an attention-based modified DenseNet model. J Imaging Inform Med. https://doi.org/10.1007/s10278-024-01005-0
Delli Pizzi A, Chiarelli AM, Chiacchiaretta P, Valdesi C, Croce P, Mastrodicasa D et al (2021) Radiomics-based machine learning differentiates “ground-glass’’ opacities due to COVID-19 from acute non-COVID-19 lung disease. Sci Reports 11(1):1–9
Dong D, Tang L, Li Z-Y, Fang M-J, Gao J-B, Shan X-H et al (2019) Development and validation of an individualized nomogram to identify occult peritoneal metastasis in patients with advanced gastric cancer. Ann Oncol 30(3):431–438
Fang X, Li X, Bian Y, Ji X, Lu J (2020) Radiomics nomogram for the prediction of 2019 novel coronavirus pneumonia caused by SARS-CoV-2. Eur Radiol 30(12):6888–6901
Garain A, Basu A, Giampaolo F, Velasquez JD, Sarkar R (2021) Detection of COVID-19 from CT scan images: a spiking neural network-based approach. Neural Comput Appl 33(19):12591–12604
Ghayvat H, Awais M, Bashir A, Pandya S, Zuhair M, Rashid M, Nebhen J (2022) AI-enabled radiologist in the loop: novel AI-based framework to augment radiologist performance for COVID-19 chest CT medical image annotation and classification from pneumonia. Neural Comput Appl 35(20):14591–14609
Guiot J, Vaidyanathan A, Deprez L, Zerka F, Danthine D, Frix A-N et al (2020) Development and validation of an automated radiomic CT signature for detecting COVID-19. Diagnostics 11(1):41
Hariri M, Avşar E (2023) COVID-19 and pneumonia diagnosis from chest Xray images using convolutional neural networks. Netw Model Anal Health Inform Bioinform 12(1):17
Homayounieh F, Ebrahimian S, Babaei R, Mobin HK, Zhang E, Bizzo BC et al (2020) CT radiomics, radiologists, and clinical information in predicting outcome of patients with COVID-19 pneumonia. Radiol Cardiothorac Imaging 2(4):e200322
Huang Y, Zhang Z, Liu S, Li X, Yang Y, Ma J, He B (2021) CT-based radiomics combined with signs: a valuable tool to help radiologist discriminate COVID-19 and influenza pneumonia. BMC Med Imaging 21(1):1–12
Ibrahim MR, Youssef SM, Fathalla KM (2021) Abnormality detection and intelligent severity assessment of human chest computed tomography scans using deep learning: a case study on SARS-COV-2 assessment. J Ambient Intell Humaniz Comput. 14(5):5665–5688
Jaisakthi S, Desingu K, Mirunalini P, Pavya S, Priyadharshini N (2023) A deep learning approach for nucleus segmentation and tumor classification from lung histopathological images. Netw Model Anal Health Inform Bioinform 12(1):22
Joshi RC, Yadav S, Pathak VK, Malhotra HS, Khokhar HVS, Parihar A et al (2021) A deep learning-based COVID-19 automatic diagnostic framework using chest X-ray images. Biocybern Biomed Eng 41(1):239–254
Kassania SH, Kassanib PH, Wesolowskic MJ, Schneidera KA, Detersa R (2021) Automatic detection of coronavirus disease (COVID-19) in X-ray and CT images: a machine learning based approach. Biocybern Biomed Eng 41(3):867–879
Khanna VV, Chadaga K, Sampathila N, Prabhu S, Chadaga R, Umakanth S (2022) Diagnosing COVID-19 using artificial intelligence: a comprehensive review. Netw Model Anal Health Inform Bioinform 11(1):25
Kim JY, Ro K, You S, Nam BR, Yook S, Park HS et al (2019) Development of an automatic muscle atrophy measuring algorithm to calculate the ratio of supraspinatus in supraspinous fossa using deep learning. Comput Methods Program Biomed 182:105063
Kolossváry M, Karády J, Szilveszter B, Kitslaar P, Hoffmann U, Merkely B, Maurovich-Horvat P (2017) Radiomic features are superior to conventional quantitative computed tomographic metrics to identify coronary plaques with napkin-ring sign. Circ Cardiovasc Imaging 10(12):e006843
Lambin P, Rios-Velazquez E, Leijenaar R, Carvalho S, Van Stiphout RG, Granton P et al (2012) Radiomics: extracting more information from medical images using advanced feature analysis. Eur J Cancer 48(4):441–446
Li M, Zhang Z, Cao W, Liu Y, Du B, Chen C et al (2021) Identifying novel factors associated with COVID-19 transmission and fatality using the machine learning approach. Sci Total Environ 764:142810
Li Z, Hou Z, Chen C, Hao Z, An Y, Liang S, Lu B (2019) Automatic cardiothoracic ratio calculation with deep learning. IEEE Access 7:37749–37756
Liu H, Ren H, Wu Z, Xu H, Zhang S, Li J et al (2021) CT radiomics facilitates more accurate diagnosis of COVID-19 pneumonia: compared with CO-RADS. J Transl Med 19(1):1–12
Loey M, Manogaran G, Khalifa NEM (2020) A deep transfer learning model with classical data augmentation and CGAN to detect COVID-19 from chest CT radiography digital images. Neural Comput Appl. https://doi.org/10.1007/s00521-020-05437-x
Madhavan MV, Khamparia A, Gupta D, Pande S, Tiwari P, Hossain MS (2021) Res-CovNet: an internet of medical health things driven COVID-19 framework using transfer learning. Neural Comput Appl 35(19):13907–13920
Minaee S, Kafieh R, Sonka M, Yazdani S, Soufi GJ (2020) Deep-COVID: predicting COVID-19 from chest X-ray images using deep transfer learning. Med Image Anal 65:101794
Mishra NK, Singh P, Joshi SD (2021) Automated detection of COVID-19 from CT scan using convolutional neural network. Biocybern Biomed Eng 41(2):572–588
Mobiny A, Cicalese PA, Zare S, Yuan P, Abavisani M, Wu CC, et al. (2020) Radiologist-level COVID-19 detection using CT scans with detail-oriented capsule networks. arXiv preprint arXiv:2004.07407
Munusamy H, Muthukumar KJ, Gnanaprakasam S, Shanmugakani TR, Sekar A (2021) FractalCovNet architecture for COVID-19 chest X-ray image classification and CT-scan image segmentation. Biocybern Biomed Eng 41(3):1025–1038
Nam JG, Park S, Hwang EJ, Lee JH, Jin K-N, Lim KY et al (2019) Development and validation of deep learning-based automatic detection algorithm for malignant pulmonary nodules on chest radiographs. Radiology 290(1):218–228
Ni Q, Sun ZY, Qi L, Chen W, Yang Y, Wang L et al (2020) A deep learning approach to characterize 2019 coronavirus disease (COVID-19) pneumonia in chest CT images. Eur Radiol 30(12):6517–6527
Nour M, Cömert Z, Polat K (2020) A novel medical diagnosis model for COVID- 19 infection detection based on deep features and Bayesian optimization. Appl Soft Comput 97:106580
Panwar H, Gupta P, Siddiqui MK, Morales-Menendez R, Bhardwaj P, Singh V (2020) A deep learning and grad-CAM based color visualization approach for fast detection of COVID-19 cases using chest X-ray and CT-scan images. Chaos Solitons Fractals 140:110190
Park SH (2019) Diagnostic case-control versus diagnostic cohort studies for clinical validation of artificial intelligence algorithm performance. Radiology 290(1):272–273
Park SH, Han K (2018) Methodologic guide for evaluating clinical performance and effect of artificial intelligence technology for medical diagnosis and prediction. Radiology 286(3):800–809
Qiu J, Peng S, Yin J, Wang J, Jiang J, Li Z, Zhang W (2021) A radiomics signature to quantitatively analyze COVID-19-infected pulmonary lesions. Interdiscipl Sci Comput Life Sci 13(1):61–72
Rodrigues A, Rodrigues N, Santinha J, Lisitskaya MV, Uysal A, Matos C, Papanikolaou N (2023) Value of handcrafted and deep radiomic features towards training robust machine learning classifiers for prediction of prostate cancer disease aggressiveness. Sci Reports 13(1):6206
Sahin ME, Ulutas H, Yuce E, Erkoc MF (2023) Detection and classification of COVID-19 by using faster R-CNN and mask R-CNN on CT images. Neural Comput Appl 35(18):13597–13611
Sharma A, Kumar S, Singh SN (2019) Brain tumor segmentation using DE embedded OTSU method and neural network. Multidimensional Syst Signal Process 30:1263–1291
Shi F, Wang J, Shi J, Wu Z, Wang Q, Tang Z, Shen D (2020) Review of artificial intelligence techniques in imaging data acquisition, segmentation, and diagnosis for COVID-19. IEEE Rev Biomed Eng 14:4–15
Shibly KH, Dey SK, Islam MT-U, Rahman MM (2020) COVID faster R-CNN: a novel framework to diagnose novel coronavirus disease (COVID-19) in X-ray images. Inform Med Unlocked 20:100405
Shiri I, Sorouri M, Geramifar P, Nazari M, Abdollahi M, Salimi Y et al (2021) Machine learning-based prognostic modeling using clinical data and quantitative radiomic features from chest CT images in COVID-19 patients. Comput Biol Med 132:104304
Soares E, Angelov P (2020) SARS-COV-2 CT-scan dataset. Kaggle. Retrieved from https://www.kaggle.com/dsv/119987010.34740/KAGGLE/DSV/1199870
Suri JS, Agarwal S, Gupta SK, Puvvula A, Biswas M, Saba L et al (2021) A narrative review on characterization of acute respiratory distress syndrome in COVID-19-infected lungs using artificial intelligence. Comput Biol Med 130:104210
Van Griethuysen JJ, Fedorov A, Parmar C, Hosny A, Aucoin N, Narayan V, Aerts HJ (2017) Computational radiomics system to decode the radiographic phenotype. Cancer Res 77(21):e104–e107
Wang S, Dong D, Li L, Li H, Bai Y, Hu Y et al (2021) A deep learning radiomics model to identify poor outcome in COVID-19 patients with underlying health conditions: a multicenter study. IEEE J Biomed Health Inform 25(7):2353–2362
Wu Q, Wang S, Li L, Qian W, Hu Y, Li L et al (2020) Radiomics analysis of computed tomography helps predict poor prognostic outcome in COVID-19. Theranostics 10(16):7231
Xie Z, Sun H, Wang J, Xu H, Li S, Zhao C et al (2021) A novel CT-based radiomics in the distinction of severity of coronavirus disease 2019 (COVID-19) pneumonia. BMC Infect Dis 21(1):1–11
Yao C, Chen H-J (2009) Automated retinal blood vessels segmentation based on simplified PCNN and fast 2D-Otsu algorithm. J Central South Univ Technol 16(4):640–646
Zhang X, Wang D, Shao J, Tian S, Tan W, Ma Y et al (2021) A deep learning integrated radiomics model for identification of coronavirus disease 2019 using computed tomography. Sci Reports 11(1):1–12
Zhao J, Zhang Y, He X, Xie P (2020) COVID-CT-dataset: a CT scan dataset about COVID-19. arXiv preprint arXiv:2003.13865
Acknowledgements
We would like to extend our heartfelt gratitude to Dr. Vikash Kumar Raj, Senior Medical Officer (SMO) at the National Institute of Technology Patna, for his invaluable input and guidance throughout our study. His expertise and insights have played a crucial role in shaping our approach and addressing various issues.
Author information
Authors and Affiliations
Contributions
All the authors contributed equally.
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that there is no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Dalal, S., Singh, J.P., Tiwari, A.K. et al. Identification of COVID-19 with CT scans using radiomics and DL-based features. Netw Model Anal Health Inform Bioinforma 13, 14 (2024). https://doi.org/10.1007/s13721-024-00448-3
Received:
Revised:
Accepted:
Published:
DOI: https://doi.org/10.1007/s13721-024-00448-3