ABSTRACT
The diagnosis of COVID-19 and understanding the condition of the patients who have critical responses is crucial to stop the rapid propagation of such disease. Consequently, diminishing adverse impacts that affected various industrial divisions, especially healthcare. Deep learning methods have proven their great capabilities in studying and analyzing computed tomography (CT) images containing COVID-19. Most related studies utilized the spatial information of CT images to train deep learning models. Nevertheless, training these models with spatial-temporal images could enhance diagnostic accuracy. This paper proposes a computer-assisted diagnostic (CAD) system for COVID-19 diagnosis using three deep learning models trained with spectral-temporal images. First, it uses the multilevel discrete wavelet transform (DWT) to analyze the original CT images and obtain the spectral-temporal images. Then, it uses these images from different DWT levels to train three ResNets deep learning models. Afterward, for each ResNet trained with images of each DWT level, it extracts deep features. Next, for each ResNet, it fuses these deep features and then uses a feature selection approach to reduce their dimension. Finally, support vector machine (SVM) classifiers are used to perform classification. The performance of the proposed CAD proves that training ResNets with spectral-temporal images is better than using CT images. Also, the fusion and feature selection steps have enhanced the diagnostic accuracy, thus the proposed CAD could be employed to help radiologists in COVID-19 inspection.
- Who coronavirus disease (covid-19) dashboard. [Online]. Available: https://covid19.who.int/ (2021)Google Scholar
- J. A. Siordia Jr, “Epidemiology and clinical features of COVID-19: A review of current literature,” Journal of Clinical Virology, vol. 127, p. 104357, 2020.Google ScholarCross Ref
- H. Nishiura , “Estimation of the asymptomatic ratio of novel coronavirus infections (COVID-19),” International journal of infectious diseases, vol. 94, p. 154, 2020.Google ScholarCross Ref
- Y. Artik , “Comparison of COVID-19 laboratory diagnosis by commercial kits: Effectivity of RT-PCR to the RT-LAMP,” Journal of medical virology, 2022.Google ScholarCross Ref
- X. Wang , “Comparison of nasopharyngeal and oropharyngeal swabs for SARS-CoV-2 detection in 353 patients received tests with both specimens simultaneously,” International Journal of Infectious Diseases, vol. 94, pp. 107–109, 2020.Google ScholarCross Ref
- S. Armstrong, “Covid-19: Tests on students are highly inaccurate, early findings show.” British Medical Journal Publishing Group, 2020.Google Scholar
- M. Chung , “CT imaging features of 2019 novel coronavirus (2019-nCoV),” Radiology, vol. 295, no. 1, pp. 202–207, 2020.Google Scholar
- L. A. Rousan, E. Elobeid, M. Karrar, and Y. Khader, “Chest x-ray findings and temporal lung changes in patients with COVID-19 pneumonia,” BMC Pulmonary Medicine, vol. 20, no. 1, pp. 1–9, 2020.Google ScholarCross Ref
- A. S. Kardos , “The diagnostic performance of deep-learning-based CT severity score to identify COVID-19 pneumonia,” The British Journal of Radiology, vol. 95, no. 1129, p. 20210759, 2022.Google ScholarCross Ref
- O. Attallah, “An Effective Mental Stress State Detection and Evaluation System Using Minimum Number of Frontal Brain Electrodes,” Diagnostics, vol. 10, no. 5, pp. 292–327, 2020.Google ScholarCross Ref
- O. Attallah, “MB-AI-His: Histopathological Diagnosis of Pediatric Medulloblastoma and Its Subtypes via AI,” Diagnostics, vol. 11, no. 2, pp. 359–384, 2021.Google ScholarCross Ref
- O. Attallah, “CoMB-Deep: Composite Deep Learning-based Pipeline for Classifying Childhood Medulloblastoma and its Classes,” Frontiers in Neuroinformatics, vol. 15, p. 663592, 2021.Google ScholarCross Ref
- O. Attallah, “DIAROP: Automated Deep Learning-Based Diagnostic Tool for Retinopathy of Prematurity,” Diagnostics, vol. 11, no. 11, p. 2034, 2021.Google ScholarCross Ref
- O. Attallah and S. Zaghlool, “AI-Based Pipeline for Classifying Pediatric Medulloblastoma Using Histopathological and Textural Images,” Life, vol. 12, no. 2, p. 232, 2022.Google ScholarCross Ref
- O. Attallah , “Using multiple classifiers for predicting the risk of endovascular aortic aneurysm repair re-intervention through hybrid feature selection,” Proceedings of the Institution of Mechanical Engineers, Part H: Journal of Engineering in Medicine, vol. 231, no. 11, pp. 1048–1063, 2017.Google ScholarCross Ref
- O. Attallah and X. Ma, “Bayesian neural network approach for determining the risk of re-intervention after endovascular aortic aneurysm repair,” Proceedings of the Institution of Mechanical Engineers, Part H: Journal of Engineering in Medicine, vol. 228, no. 9, pp. 857–866, 2014.Google ScholarCross Ref
- S. Wang , “A fully automatic deep learning system for COVID-19 diagnostic and prognostic analysis,” European Respiratory Journal, vol. 56, no. 2, 2020.Google ScholarCross Ref
- O. Attallah, “ECG-BiCoNet: An ECG-based pipeline for COVID-19 diagnosis using Bi-Layers of deep features integration,” Computers in Biology and Medicine, p. 105210, 2022.Google ScholarDigital Library
- H. K. Bhuyan, C. Chakraborty, Y. Shelke, and S. K. Pani, “COVID-19 diagnosis system by deep learning approaches,” Expert Systems, p. e12776, 2021.Google Scholar
- V. K. Singh and M. H. Kolekar, “Deep learning empowered COVID-19 diagnosis using chest CT scan images for collaborative edge-cloud computing platform,” Multimedia Tools and Applications, vol. 81, no. 1, pp. 3–30, 2022.Google ScholarDigital Library
- S. V. Kogilavani , “COVID-19 detection based on lung CT scan using deep learning techniques,” Computational and Mathematical Methods in Medicine, vol. 2022, 2022.Google ScholarCross Ref
- I. Chouat, A. Echtioui, R. Khemakhem, W. Zouch, M. Ghorbel, and A. B. Hamida, “COVID-19 detection in CT and CXR images using deep learning models,” Biogerontology, pp. 1–20, 2022.Google Scholar
- E. Jangam, A. A. D. Barreto, and C. S. R. Annavarapu, “Automatic detection of COVID-19 from chest CT scan and chest X-Rays images using deep learning, transfer learning and stacking,” Applied Intelligence, vol. 52, no. 2, pp. 2243–2259, 2022.Google ScholarDigital Library
- I. Shiri , “COLI-Net: Deep learning-assisted fully automated COVID-19 lung and infection pneumonia lesion detection and segmentation from chest computed tomography images,” International journal of imaging systems and technology, vol. 32, no. 1, pp. 12–25, 2022.Google Scholar
- L. Jingxin , “COVID-19 lesion detection and segmentation–A deep learning method,” Methods, 2021.Google Scholar
- O. Attallah, “A computer-aided diagnostic framework for coronavirus diagnosis using texture-based radiomics images,” DIGITAL HEALTH, vol. 8, p. 20552076221092544, 2022.Google ScholarCross Ref
- M. M. Al Rahhal , “COVID-19 Detection in CT/X-ray Imagery Using Vision Transformers,” Journal of Personalized Medicine, vol. 12, no. 2, p. 310, 2022.Google ScholarCross Ref
- A. Jaiswal, N. Gianchandani, D. Singh, V. Kumar, and M. Kaur, “Classification of the COVID-19 infected patients using DenseNet201 based deep transfer learning,” Journal of Biomolecular Structure and Dynamics, vol. 39, no. 15, pp. 5682–5689, 2021.Google ScholarCross Ref
- H. Panwar, P. K. Gupta, M. K. Siddiqui, R. Morales-Menendez, P. Bhardwaj, and V. Singh, “A Deep Learning and Grad-CAM based Color Visualization Approach for Fast Detection of COVID-19 Cases using Chest X-ray and CT-Scan Images,” Chaos, Solitons & Fractals, p. 110190, 2020.Google ScholarCross Ref
- R. Kundu, P. K. Singh, M. Ferrara, A. Ahmadian, and R. Sarkar, “ET-NET: an ensemble of transfer learning models for prediction of COVID-19 infection through chest CT-scan images,” Multimedia Tools and Applications, vol. 81, no. 1, pp. 31–50, 2022.Google ScholarDigital Library
- P. Silva , “COVID-19 detection in CT images with deep learning: A voting-based scheme and cross-datasets analysis,” Informatics in medicine unlocked, vol. 20, p. 100427, 2020.Google ScholarCross Ref
- B. Zheng, Y. Zhu, Q. Shi, D. Yang, Y. Shao, and T. Xu, “MA-Net: Mutex attention network for COVID-19 diagnosis on CT images,” Applied Intelligence, pp. 1–16, 2022.Google Scholar
- O. Attallah, D. A. Ragab, and M. Sharkas, “MULTI-DEEP: A novel CAD system for coronavirus (COVID-19) diagnosis from CT images using multiple convolution neural networks,” PeerJ, vol. 8, p. e10086, 2020.Google ScholarCross Ref
- D. A. Ragab and O. Attallah, “FUSI-CAD: Coronavirus (COVID-19) diagnosis based on the fusion of CNNs and handcrafted features,” PeerJ Computer Science, vol. 6, p. e306, 2020.Google ScholarCross Ref
- D. Sundararajan, Discrete wavelet transform: a signal processing approach. John Wiley & Sons, 2016.Google Scholar
- K. He, X. Zhang, S. Ren, and J. Sun, “Deep Residual Learning for Image Recognition,” 2016. doi: 10.1109/CVPR.2016.90.Google ScholarCross Ref
- E. Soares, P. Angelov, S. Biaso, M. H. Froes, and D. K. Abe, “SARS-CoV-2 CT-scan dataset: A large dataset of real patients CT scans for SARS-CoV-2 identification,” medRxiv, 2020.Google Scholar
- A. Miko/lajczyk and M. Grochowski, “Data augmentation for improving deep learning in image classification problem,” in 2018 international interdisciplinary PhD workshop (IIPhDW), 2018, pp. 117–122.Google Scholar
- N. N. Das, N. Kumar, M. Kaur, V. Kumar, and D. Singh, “Automated deep transfer learning-based approach for detection of COVID-19 infection in chest X-rays,” IRBM, 2020.Google Scholar
- C. Tan, F. Sun, T. Kong, W. Zhang, C. Yang, and C. Liu, “A survey on deep transfer learning,” in International conference on artificial neural networks, 2018, pp. 270–279.Google ScholarCross Ref
- O. Attallah , “Feature selection through validation and un-censoring of endovascular repair survival data for predicting the risk of re-intervention,” BMC medical informatics and decision making, vol. 17, no. 1, pp. 115–133, 2017.Google Scholar
- J. Cai, J. Luo, S. Wang, and S. Yang, “Feature selection in machine learning: A new perspective,” Neurocomputing, vol. 300, pp. 70–79, 2018.Google ScholarCross Ref
- K. Yurtkan and H. Demirel, “Entropy-based feature selection for improved 3D facial expression recognition,” Signal, Image and Video Processing, vol. 8, no. 2, pp. 267–277, 2014.Google ScholarCross Ref
Index Terms
- Deep Learning-Based CAD System for COVID-19 Diagnosis via Spectral-Temporal Images
Recommendations
A wavelet-based deep learning pipeline for efficient COVID-19 diagnosis via CT slices
AbstractThe quick diagnosis of the novel coronavirus (COVID-19) disease is vital to prevent its propagation and improve therapeutic outcomes. Computed tomography (CT) is believed to be an effective tool for diagnosing COVID-19, however, the CT ...
Improving effectiveness of different deep learning-based models for detecting COVID-19 from computed tomography (CT) images
AbstractCOVID-19 has caused a pandemic crisis that threatens the world in many areas, especially in public health. For the diagnosis of COVID-19, computed tomography has a prognostic role in the early diagnosis of COVID-19 as it provides both rapid and ...
X-Ray image-based COVID-19 detection using deep learning
AbstractCOVID-19 is a type of respiratory infection that primarily affects the lungs. Obtaining a chest X-ray is one of the most important steps in detecting and treating COVID-19 occurrences. Our study's goal is to detect COVID-19 from chest X-ray images ...
Comments