skip to main content
10.1145/3551690.3551695acmotherconferencesArticle/Chapter ViewAbstractPublication PagesicicmConference Proceedingsconference-collections
research-article

Deep Learning-Based CAD System for COVID-19 Diagnosis via Spectral-Temporal Images

Authors Info & Claims
Published:14 September 2022Publication History

ABSTRACT

The diagnosis of COVID-19 and understanding the condition of the patients who have critical responses is crucial to stop the rapid propagation of such disease. Consequently, diminishing adverse impacts that affected various industrial divisions, especially healthcare. Deep learning methods have proven their great capabilities in studying and analyzing computed tomography (CT) images containing COVID-19. Most related studies utilized the spatial information of CT images to train deep learning models. Nevertheless, training these models with spatial-temporal images could enhance diagnostic accuracy. This paper proposes a computer-assisted diagnostic (CAD) system for COVID-19 diagnosis using three deep learning models trained with spectral-temporal images. First, it uses the multilevel discrete wavelet transform (DWT) to analyze the original CT images and obtain the spectral-temporal images. Then, it uses these images from different DWT levels to train three ResNets deep learning models. Afterward, for each ResNet trained with images of each DWT level, it extracts deep features. Next, for each ResNet, it fuses these deep features and then uses a feature selection approach to reduce their dimension. Finally, support vector machine (SVM) classifiers are used to perform classification. The performance of the proposed CAD proves that training ResNets with spectral-temporal images is better than using CT images. Also, the fusion and feature selection steps have enhanced the diagnostic accuracy, thus the proposed CAD could be employed to help radiologists in COVID-19 inspection.

References

  1. Who coronavirus disease (covid-19) dashboard. [Online]. Available: https://covid19.who.int/ (2021)Google ScholarGoogle Scholar
  2. J. A. Siordia Jr, “Epidemiology and clinical features of COVID-19: A review of current literature,” Journal of Clinical Virology, vol. 127, p. 104357, 2020.Google ScholarGoogle ScholarCross RefCross Ref
  3. H. Nishiura , “Estimation of the asymptomatic ratio of novel coronavirus infections (COVID-19),” International journal of infectious diseases, vol. 94, p. 154, 2020.Google ScholarGoogle ScholarCross RefCross Ref
  4. Y. Artik , “Comparison of COVID-19 laboratory diagnosis by commercial kits: Effectivity of RT-PCR to the RT-LAMP,” Journal of medical virology, 2022.Google ScholarGoogle ScholarCross RefCross Ref
  5. X. Wang , “Comparison of nasopharyngeal and oropharyngeal swabs for SARS-CoV-2 detection in 353 patients received tests with both specimens simultaneously,” International Journal of Infectious Diseases, vol. 94, pp. 107–109, 2020.Google ScholarGoogle ScholarCross RefCross Ref
  6. S. Armstrong, “Covid-19: Tests on students are highly inaccurate, early findings show.” British Medical Journal Publishing Group, 2020.Google ScholarGoogle Scholar
  7. M. Chung , “CT imaging features of 2019 novel coronavirus (2019-nCoV),” Radiology, vol. 295, no. 1, pp. 202–207, 2020.Google ScholarGoogle Scholar
  8. L. A. Rousan, E. Elobeid, M. Karrar, and Y. Khader, “Chest x-ray findings and temporal lung changes in patients with COVID-19 pneumonia,” BMC Pulmonary Medicine, vol. 20, no. 1, pp. 1–9, 2020.Google ScholarGoogle ScholarCross RefCross Ref
  9. A. S. Kardos , “The diagnostic performance of deep-learning-based CT severity score to identify COVID-19 pneumonia,” The British Journal of Radiology, vol. 95, no. 1129, p. 20210759, 2022.Google ScholarGoogle ScholarCross RefCross Ref
  10. O. Attallah, “An Effective Mental Stress State Detection and Evaluation System Using Minimum Number of Frontal Brain Electrodes,” Diagnostics, vol. 10, no. 5, pp. 292–327, 2020.Google ScholarGoogle ScholarCross RefCross Ref
  11. O. Attallah, “MB-AI-His: Histopathological Diagnosis of Pediatric Medulloblastoma and Its Subtypes via AI,” Diagnostics, vol. 11, no. 2, pp. 359–384, 2021.Google ScholarGoogle ScholarCross RefCross Ref
  12. O. Attallah, “CoMB-Deep: Composite Deep Learning-based Pipeline for Classifying Childhood Medulloblastoma and its Classes,” Frontiers in Neuroinformatics, vol. 15, p. 663592, 2021.Google ScholarGoogle ScholarCross RefCross Ref
  13. O. Attallah, “DIAROP: Automated Deep Learning-Based Diagnostic Tool for Retinopathy of Prematurity,” Diagnostics, vol. 11, no. 11, p. 2034, 2021.Google ScholarGoogle ScholarCross RefCross Ref
  14. O. Attallah and S. Zaghlool, “AI-Based Pipeline for Classifying Pediatric Medulloblastoma Using Histopathological and Textural Images,” Life, vol. 12, no. 2, p. 232, 2022.Google ScholarGoogle ScholarCross RefCross Ref
  15. O. Attallah , “Using multiple classifiers for predicting the risk of endovascular aortic aneurysm repair re-intervention through hybrid feature selection,” Proceedings of the Institution of Mechanical Engineers, Part H: Journal of Engineering in Medicine, vol. 231, no. 11, pp. 1048–1063, 2017.Google ScholarGoogle ScholarCross RefCross Ref
  16. O. Attallah and X. Ma, “Bayesian neural network approach for determining the risk of re-intervention after endovascular aortic aneurysm repair,” Proceedings of the Institution of Mechanical Engineers, Part H: Journal of Engineering in Medicine, vol. 228, no. 9, pp. 857–866, 2014.Google ScholarGoogle ScholarCross RefCross Ref
  17. S. Wang , “A fully automatic deep learning system for COVID-19 diagnostic and prognostic analysis,” European Respiratory Journal, vol. 56, no. 2, 2020.Google ScholarGoogle ScholarCross RefCross Ref
  18. O. Attallah, “ECG-BiCoNet: An ECG-based pipeline for COVID-19 diagnosis using Bi-Layers of deep features integration,” Computers in Biology and Medicine, p. 105210, 2022.Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. H. K. Bhuyan, C. Chakraborty, Y. Shelke, and S. K. Pani, “COVID-19 diagnosis system by deep learning approaches,” Expert Systems, p. e12776, 2021.Google ScholarGoogle Scholar
  20. V. K. Singh and M. H. Kolekar, “Deep learning empowered COVID-19 diagnosis using chest CT scan images for collaborative edge-cloud computing platform,” Multimedia Tools and Applications, vol. 81, no. 1, pp. 3–30, 2022.Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. S. V. Kogilavani , “COVID-19 detection based on lung CT scan using deep learning techniques,” Computational and Mathematical Methods in Medicine, vol. 2022, 2022.Google ScholarGoogle ScholarCross RefCross Ref
  22. I. Chouat, A. Echtioui, R. Khemakhem, W. Zouch, M. Ghorbel, and A. B. Hamida, “COVID-19 detection in CT and CXR images using deep learning models,” Biogerontology, pp. 1–20, 2022.Google ScholarGoogle Scholar
  23. E. Jangam, A. A. D. Barreto, and C. S. R. Annavarapu, “Automatic detection of COVID-19 from chest CT scan and chest X-Rays images using deep learning, transfer learning and stacking,” Applied Intelligence, vol. 52, no. 2, pp. 2243–2259, 2022.Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. I. Shiri , “COLI-Net: Deep learning-assisted fully automated COVID-19 lung and infection pneumonia lesion detection and segmentation from chest computed tomography images,” International journal of imaging systems and technology, vol. 32, no. 1, pp. 12–25, 2022.Google ScholarGoogle Scholar
  25. L. Jingxin , “COVID-19 lesion detection and segmentation–A deep learning method,” Methods, 2021.Google ScholarGoogle Scholar
  26. O. Attallah, “A computer-aided diagnostic framework for coronavirus diagnosis using texture-based radiomics images,” DIGITAL HEALTH, vol. 8, p. 20552076221092544, 2022.Google ScholarGoogle ScholarCross RefCross Ref
  27. M. M. Al Rahhal , “COVID-19 Detection in CT/X-ray Imagery Using Vision Transformers,” Journal of Personalized Medicine, vol. 12, no. 2, p. 310, 2022.Google ScholarGoogle ScholarCross RefCross Ref
  28. A. Jaiswal, N. Gianchandani, D. Singh, V. Kumar, and M. Kaur, “Classification of the COVID-19 infected patients using DenseNet201 based deep transfer learning,” Journal of Biomolecular Structure and Dynamics, vol. 39, no. 15, pp. 5682–5689, 2021.Google ScholarGoogle ScholarCross RefCross Ref
  29. H. Panwar, P. K. Gupta, M. K. Siddiqui, R. Morales-Menendez, P. Bhardwaj, and V. Singh, “A Deep Learning and Grad-CAM based Color Visualization Approach for Fast Detection of COVID-19 Cases using Chest X-ray and CT-Scan Images,” Chaos, Solitons & Fractals, p. 110190, 2020.Google ScholarGoogle ScholarCross RefCross Ref
  30. R. Kundu, P. K. Singh, M. Ferrara, A. Ahmadian, and R. Sarkar, “ET-NET: an ensemble of transfer learning models for prediction of COVID-19 infection through chest CT-scan images,” Multimedia Tools and Applications, vol. 81, no. 1, pp. 31–50, 2022.Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. P. Silva , “COVID-19 detection in CT images with deep learning: A voting-based scheme and cross-datasets analysis,” Informatics in medicine unlocked, vol. 20, p. 100427, 2020.Google ScholarGoogle ScholarCross RefCross Ref
  32. B. Zheng, Y. Zhu, Q. Shi, D. Yang, Y. Shao, and T. Xu, “MA-Net: Mutex attention network for COVID-19 diagnosis on CT images,” Applied Intelligence, pp. 1–16, 2022.Google ScholarGoogle Scholar
  33. O. Attallah, D. A. Ragab, and M. Sharkas, “MULTI-DEEP: A novel CAD system for coronavirus (COVID-19) diagnosis from CT images using multiple convolution neural networks,” PeerJ, vol. 8, p. e10086, 2020.Google ScholarGoogle ScholarCross RefCross Ref
  34. D. A. Ragab and O. Attallah, “FUSI-CAD: Coronavirus (COVID-19) diagnosis based on the fusion of CNNs and handcrafted features,” PeerJ Computer Science, vol. 6, p. e306, 2020.Google ScholarGoogle ScholarCross RefCross Ref
  35. D. Sundararajan, Discrete wavelet transform: a signal processing approach. John Wiley & Sons, 2016.Google ScholarGoogle Scholar
  36. K. He, X. Zhang, S. Ren, and J. Sun, “Deep Residual Learning for Image Recognition,” 2016. doi: 10.1109/CVPR.2016.90.Google ScholarGoogle ScholarCross RefCross Ref
  37. E. Soares, P. Angelov, S. Biaso, M. H. Froes, and D. K. Abe, “SARS-CoV-2 CT-scan dataset: A large dataset of real patients CT scans for SARS-CoV-2 identification,” medRxiv, 2020.Google ScholarGoogle Scholar
  38. A. Miko/lajczyk and M. Grochowski, “Data augmentation for improving deep learning in image classification problem,” in 2018 international interdisciplinary PhD workshop (IIPhDW), 2018, pp. 117–122.Google ScholarGoogle Scholar
  39. N. N. Das, N. Kumar, M. Kaur, V. Kumar, and D. Singh, “Automated deep transfer learning-based approach for detection of COVID-19 infection in chest X-rays,” IRBM, 2020.Google ScholarGoogle Scholar
  40. C. Tan, F. Sun, T. Kong, W. Zhang, C. Yang, and C. Liu, “A survey on deep transfer learning,” in International conference on artificial neural networks, 2018, pp. 270–279.Google ScholarGoogle ScholarCross RefCross Ref
  41. O. Attallah , “Feature selection through validation and un-censoring of endovascular repair survival data for predicting the risk of re-intervention,” BMC medical informatics and decision making, vol. 17, no. 1, pp. 115–133, 2017.Google ScholarGoogle Scholar
  42. J. Cai, J. Luo, S. Wang, and S. Yang, “Feature selection in machine learning: A new perspective,” Neurocomputing, vol. 300, pp. 70–79, 2018.Google ScholarGoogle ScholarCross RefCross Ref
  43. K. Yurtkan and H. Demirel, “Entropy-based feature selection for improved 3D facial expression recognition,” Signal, Image and Video Processing, vol. 8, no. 2, pp. 267–277, 2014.Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. Deep Learning-Based CAD System for COVID-19 Diagnosis via Spectral-Temporal Images

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Other conferences
      ICICM '22: Proceedings of the 12th International Conference on Information Communication and Management
      July 2022
      105 pages
      ISBN:9781450396493
      DOI:10.1145/3551690

      Copyright © 2022 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 14 September 2022

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article
      • Research
      • Refereed limited

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format .

    View HTML Format