Skip to main content
SpringerLink
Log in

Classification of computerized tomography images to diagnose non-small cell lung cancer using a hybrid model

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Lung cancer arises from the abnormal and uncontrolled reproduction of parenchymal cells. Among all cancer cases, lung cancer is one of the prevailing types. Prevalence and death rates of the cancer increases day by day. From this point of view, early diagnosis and treatment of this cancer increases survival times and rates. The main idea in the development of the method presented in this publication is to increase the rate of early diagnosis. Computerized Tomography (CT) is the major screening method when encountered with suspicious symptoms. The cancer can be determined with CT and besides subtyping can be done. Diagnosing the disease with the human eye can sometimes lead to the emergence of deficiencies. This is one of the problems faced today. In this direction, the study in this paper presents a hybrid method to predict and diagnose the lung cancer from CT images to minimize potential human errors. Using the method, feature maps of the CT images of the dataset are obtained using the previously trained DarkNet-53 and DenseNet-201 deep model architectures. DarkNet-53 and DenseNet-201 architectures were chosen because they gave the best feature extraction results among 7 different architectures. The purpose of using the two architectures is to combine two high-performance models to create a hybrid classification method with high accuracy. Feature concatenation is applied to increase the diagnosis accuracy. To optimize the performance and computation cost of the proposed method, the Neighborhood Component Analysis (NCA) optimization method is used in determining and analysis of the features with more information. Therefore, features with less contribution in the accuracy are eliminated. Next, new feature maps are achieved by grading all features upon their weights and applying an elimination using a threshold value. The new feature maps are classified using Classical Machine Learning (CML) classifiers. Classification accuracies on DarkNet-53 architecture were calculated as 69.11% with SoftMax and 96.25% with Ensemble Classifiers and Nearest Neighbor Classifiers respectively. Similarly, accuracies on DenseNet-201 architecture were calculated as 68.29% with SoftMax and 97.39% with Ensemble Classifiers and Nearest Neighbor Classifiers respectively. With the proposed hybrid model, the Ensemble Classifiers reached the accuracy of 98.69% and the highest accuracy is achieved by using k-Nearest Neighbor Classifier (kNN) with the value of 98.86%. The results are supported with detailed illustrations.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17

Similar content being viewed by others

Data availability

The data & material are made available on demand.

References

  1. Bentoumi M, Daoud M, Benaouali M, Taleb Ahmed A (2022) Improvement of emotion recognition from facial images using deep learning and early stopping cross validation. Multimed Tools Appl:1–31. https://doi.org/10.1007/s11042-022-12058-0

  2. Blanc-Durand P, Campedel L, Mule S, Jegou S, Luciani A, Pigneur F, Itti E (2020) Prognostic value of anthropometric measures extracted from whole-body CT using deep learning in patients with non-small-cell lung cancer. Eur Radiol 30:1–10. https://doi.org/10.1007/s00330-019-06630-w

    Article  Google Scholar 

  3. Bray F, Ferlay J, Soerjomataram I, Siegel RL, Torre LA, Jemal A (2018) Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA Cancer J Clin 68(6):394–424. https://doi.org/10.3322/caac.21660

    Article  Google Scholar 

  4. Chang C-C, Lin C-J (2011) LIBSVM: a library for support vector machines. ACM Trans Intell Syst Technol 2(3):1–27. https://doi.org/10.1145/1961189.1961199

    Article  Google Scholar 

  5. Chaunzwa TL, Hosny A, Xu Y, Shafer A, Diao N, Lanuti M, Christiani DC, Mak RH, Aerts HJWL (2021) Deep learning classification of lung cancer histology using CT images. Sci Rep 11(1):1–12. https://doi.org/10.1038/s41598-021-84630-x

    Article  Google Scholar 

  6. Cheong KH, Tang KJW, Zhao X, Koh JEW, Faust O, Gururajan R, Ciaccio EJ, Rajinikanth V, Acharya UR (2021) An automated skin melanoma detection system with melanoma-index based on entropy features. Biocybern Biomed Eng 41:997–1012. https://doi.org/10.1016/j.bbe.2021.05.010

    Article  Google Scholar 

  7. Çinar A, Yildirim M (2020) Detection of tumors on brain MRI images using the hybrid convolutional neural network architecture. Med Hypotheses 139:109684. https://doi.org/10.1016/j.mehy.2020.109684

    Article  Google Scholar 

  8. Çınar A, Yıldırım M, Eroğlu Y (2021) Classification of pneumonia cell images using improved ResNet50 model. Trait Signal 38(1):165–173. https://doi.org/10.18280/ts.380117

    Article  Google Scholar 

  9. Clark SB, Alsubait S (2020) Non small cell lung cancer. StatPearls [Internet]

  10. Cover T, Hart P (1967) Nearest neighbor pattern classification. IEEE Trans Inf Theory 13(1):21–27. https://doi.org/10.1109/TIT.1967.1053964

    Article  MATH  Google Scholar 

  11. D’Arnese E et al (2022) On the automation of radiomics-based identification and characterization of nsclc. IEEE J Biomed Health Inform 26(6):2670–2679. https://doi.org/10.1109/JBHI.2022.3156984

    Article  Google Scholar 

  12. Dewi C, Chen R-C, Yu H (2020) Weight analysis for various prohibitory sign detection and recognition using deep learning. Multimed Tools Appl 79(43):32897–32915. https://doi.org/10.1007/s11042-020-09509-x

    Article  Google Scholar 

  13. Duma N, Santana-Davila R, Molina JR (2019) Non–small cell lung cancer: epidemiology, screening, diagnosis, and treatment. In: Mayo Clinic proceedings. Elsevier. https://doi.org/10.1016/j.mayocp.2019.01.013

  14. Eroğlu Y, Yildirim M, Çinar A (2021) Convolutional neural networks based classification of breast ultrasonography images by hybrid method with respect to benign, malignant, and normal using mRMR. Comput Biol Med 133:104407. https://doi.org/10.1016/j.compbiomed.2021.104407

    Article  Google Scholar 

  15. Globerson A, Roweis S (2005) Metric learning by collapsing classes. Adv Neural Inf Proces Syst 18:451–458

    Google Scholar 

  16. Goel N, Kaur S, Gunjan D, Mahapatra SJ (2022) Investigating the significance of color space for abnormality detection in wireless capsule endoscopy images. Biomed Signal Process Control 75:103624. https://doi.org/10.1016/j.bspc.2022.103624

    Article  Google Scholar 

  17. Goel N, Kaur S, Gunjan D, Mahapatra SJ (2022) Dilated CNN for abnormality detection in wireless capsule endoscopy images. Soft Comput 26(3):1231–1247. https://doi.org/10.1007/s00500-021-06546-y

    Article  Google Scholar 

  18. Goldberger J et al (2004) Neighbourhood components analysis. Adv Neural Inf Proces Syst 17:513–520

    Google Scholar 

  19. Gudigar A, U R, Samanth J, Gangavarapu MR, Kudva A, Paramasivam G, Nayak K, Tan RS, Molinari F, Ciaccio EJ, Rajendra Acharya U (2021) Automated detection of chronic kidney disease using image fusion and graph embedding techniques with ultrasound images. Biomed Signal Process Control 68:102733. https://doi.org/10.1016/j.bspc.2021.102733

    Article  Google Scholar 

  20. Haifeng G, Shoubao S, Zhoubao S (2017) Image tag recommendation based on friendships. Multimed Tools Appl 76(13):14581–14597. https://doi.org/10.1007/s11042-016-3802-7

    Article  Google Scholar 

  21. Han Y, Ma Y, Wu Z, Zhang F, Zheng D, Liu X, Tao L, Liang Z, Yang Z, Li X, Huang J, Guo X (2021) Histologic subtype classification of non-small cell lung cancer using PET/CT images. Eur J Nucl Med Mol Imaging 48(2):350–360. https://doi.org/10.1007/s00259-020-04771-5

    Article  Google Scholar 

  22. He K et al (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition

  23. Hintze C, Dinkel J, Biederer J, Heußel CP, Puderbach M (2011) Staging des Lungenkarzinoms. Radiologe 51(2):135–144. https://doi.org/10.1007/s00117-010-2112-8

    Article  Google Scholar 

  24. Hofman P (2017) ALK in non-small cell lung cancer (NSCLC) pathobiology, epidemiology, detection from tumor tissue and algorithm diagnosis in a daily practice. Cancers 9(8):107. https://doi.org/10.3390/cancers9080107

    Article  Google Scholar 

  25. Howard AG et al (2017) Mobilenets: efficient convolutional neural networks for mobile vision applications. arXiv preprint arXiv:1704.04861. https://doi.org/10.48550/arXiv.1704.04861

  26. https://www.kaggle.com/mohamedhanyyy/chest-ctscan-images. Last accessed date: 05.06.2021

  27. Huang G et al (2017) Densely connected convolutional networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition

  28. Huang W, Wang J, Wang H, Zhang Y, Zhao F, Li K, Su L, Kang F, Cao X (2022) PET/CT based EGFR mutation status classification of NSCLC using deep learning features and radiomics features. Front Pharmacol 13:1504. https://doi.org/10.3389/fphar.2022.898529

    Article  Google Scholar 

  29. Imyanitov EN, Iyevleva AG, Levchenko EN (2020) Molecular testing and targeted therapy for non-small cell lung cancer: current status and perspectives. Crit Rev Oncol Hematol:103194. https://doi.org/10.1016/j.critrevonc.2020.103194

  30. Kar MK, Nath MK, Neog DR (2021) A review on progress in semantic image segmentation and its application to medical images. SN Comput Sci 2(5):1–30. https://doi.org/10.1007/s42979-021-00784-5

    Article  Google Scholar 

  31. Klecka WR, Iversen GR, Klecka WR (1980) Discriminant analysis, vol 19. Sage

    Book  Google Scholar 

  32. Koh JEW, de Michele S, Sudarshan VK, Jahmunah V, Ciaccio EJ, Ooi CP, Gururajan R, Gururajan R, Oh SL, Lewis SK, Green PH, Bhagat G, Acharya UR (2021) Automated interpretation of biopsy images for the detection of celiac disease using a machine learning approach. Comput Methods Prog Biomed 203:106010. https://doi.org/10.1016/j.cmpb.2021.106010

    Article  Google Scholar 

  33. Kohavi R (1996) Scaling up the accuracy of naive-bayes classifiers: a decision-tree hybrid. In: Kdd

  34. Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. Adv Neural Inf Proces Syst 25:1097–1105

    Google Scholar 

  35. Lai Y-H, Chen WN, Hsu TC, Lin C, Tsao Y, Wu S (2020) Overall survival prediction of non-small cell lung cancer by integrating microarray and clinical data with deep learning. Sci Rep 10(1):1–11. https://doi.org/10.1038/s41598-020-61588-w

    Article  Google Scholar 

  36. Lanjewar MG, Gurav O (2022) Convolutional neural networks based classifications of soil images. Multimed Tools Appl 81(7):10313–10336. https://doi.org/10.1007/s11042-022-12200-y

    Article  Google Scholar 

  37. Le T, Gerber DE (2017) ALK alterations and inhibition in lung cancer. In: Seminars in cancer biology. Elsevier. https://doi.org/10.1016/j.semcancer.2016.08.007

  38. Ma S, Ahn G, Hong H (2022) Chest CT image patch-based CNN classification and visualization for predicting recurrence of non-small cell lung Cancer patients. J Korea Comput Graph Soc 28(1):1–9

    Article  Google Scholar 

  39. Malan NS, Sharma S (2019) Feature selection using regularized neighbourhood component analysis to enhance the classification performance of motor imagery signals. Comput Biol Med 107:118–126. https://doi.org/10.1016/j.compbiomed.2019.02.009

    Article  Google Scholar 

  40. Marentakis P, Karaiskos P, Kouloulias V, Kelekis N, Argentos S, Oikonomopoulos N, Loukas C (2021) Lung cancer histology classification from CT images based on radiomics and deep learning models. Med Biol Eng Comput 59(1):215–226. https://doi.org/10.1007/s11517-020-02302-w

    Article  Google Scholar 

  41. Oudkerk M, Liu SY, Heuvelmans MA, Walter JE, Field JK (2021) Lung cancer LDCT screening and mortality reduction—evidence, pitfalls and future perspectives. Nat Rev Clin Oncol 18(3):135–151. https://doi.org/10.1038/s41571-020-00432-6

    Article  Google Scholar 

  42. Quinlan JR (1990) Decision trees and decision-making. IEEE Trans Syst Man Cybern 20(2):339–346. https://doi.org/10.1109/21.52545

    Article  Google Scholar 

  43. Rankin NM, McWilliams A, Marshall HM (2020) Lung cancer screening implementation: complexities and priorities. Respirology 25:5–23. https://doi.org/10.1111/resp.13963

    Article  Google Scholar 

  44. Ravenel JG (2012) Evidence-based imaging in lung cancer: a systematic review. J Thorac Imaging 27(5):315–324. https://doi.org/10.1097/RTI.0b013e318254a198

    Article  Google Scholar 

  45. Redmon J, Farhadi A (2017) YOLO9000: better, faster, stronger. In: Proceedings of the IEEE conference on computer vision and pattern recognition

  46. Redmon J, Farhadi A (2018) Yolov3: an incremental improvement. arXiv preprint arXiv:1804.02767. https://doi.org/10.48550/arXiv.1804.02767

  47. Rokach L (2010) Ensemble-based classifiers. Artif Intell Rev 33(1):1–39. https://doi.org/10.1007/s10462-009-9124-7

    Article  MathSciNet  Google Scholar 

  48. Shankar DD, Azhakath AS (2021) Minor blind feature based Steganalysis for calibrated JPEG images with cross validation and classification using SVM and SVM-PSO. Multimed Tools Appl 80(3):4073–4092. https://doi.org/10.1007/s11042-020-09820-7

    Article  Google Scholar 

  49. Siegel RL, Miller KD, Goding Sauer A, Fedewa SA, Butterly LF, Anderson JC, Cercek A, Smith RA, Jemal A (2020) Colorectal cancer statistics, 2020. CA Cancer J Clin 70(3):145–164. https://doi.org/10.3322/caac.21601

    Article  Google Scholar 

  50. Song MJ et al (2020) Increased number of subclones in lung squamous cell carcinoma elicits overexpression of immune related genes. Transl Lung Cancer Res 9(3):659. https://doi.org/10.21037/tlcr-19-589

    Article  Google Scholar 

  51. Song Z, Liu T, Shi L, Yu Z, Shen Q, Xu M, Huang Z, Cai Z, Wang W, Xu C, Sun J, Chen M (2021) The deep learning model combining CT image and clinicopathological information for predicting ALK fusion status and response to ALK-TKI therapy in non-small cell lung cancer patients. Eur J Nucl Med Mol Imaging 48(2):361–371. https://doi.org/10.1007/s00259-020-04986-6

    Article  Google Scholar 

  52. Szegedy C et al (2015) Going deeper with convolutions. In: Proceedings of the IEEE conference on computer vision and pattern recognition

  53. Tan M, Le Q (2019) Efficientnet: rethinking model scaling for convolutional neural networks. In: International conference on machine learning. PMLR

  54. Tian P, He B, Mu W, Liu K, Liu L, Zeng H, Liu Y, Jiang L, Zhou P, Huang Z, Dong D, Li W (2021) Assessing PD-L1 expression in non-small cell lung cancer and predicting responses to immune checkpoint inhibitors using deep learning on computed tomography images. Theranostics 11(5):2098–2107. https://doi.org/10.7150/thno.48027

    Article  Google Scholar 

  55. Wang S-H, Zhang Y-D (2020) DenseNet-201-based deep neural network with composite learning factor and precomputation for multiple sclerosis classification. ACM Trans Multimed Comput Commun Appl 16(2s):1–19. https://doi.org/10.1145/3341095

    Article  MathSciNet  Google Scholar 

  56. Wang H, Zhou Z, Li Y, Chen Z, Lu P, Wang W, Liu W, Yu L (2017) Comparison of machine learning methods for classifying mediastinal lymph node metastasis of non-small cell lung cancer from 18 F-FDG PET/CT images. EJNMMI Res 7(1):1–11. https://doi.org/10.1186/s13550-017-0260-9

    Article  Google Scholar 

  57. Wang R et al (2021) Lip language identification via wavelet entropy and K-nearest neighbor algorithm. EAI Endorsed Trans e Learn 7(22):e4. https://doi.org/10.4108/eai.11-8-2021.170669

    Article  Google Scholar 

  58. Wu J, Zhu J, Liu Q, Zhang Y (2015) Human mouth-state recognition based on learned discriminative dictionary and sparse representation combined with homotopy. Multimed Tools Appl 74(23):10697–10711. https://doi.org/10.1007/s11042-014-2199-4

    Article  Google Scholar 

  59. Yang X, Liu M, Ren Y, Chen H, Yu P, Wang S, Zhang R, Dai H, Wang C (2022) Using contrast-enhanced CT and non-contrast-enhanced CT to predict EGFR mutation status in NSCLC patients—a radiomics nomogram analysis. Eur Radiol 32(4):2693–2703

    Article  Google Scholar 

  60. Yildirim M, Cinar AC (2019) Classification of white blood cells by deep learning methods for diagnosing disease. Rev Intell Artif 33(5):335–340. https://doi.org/10.18280/ria.330502

    Article  Google Scholar 

  61. Yildirim M, Çinar A (2021) A new model for classification of human movements on videos using convolutional neural networks: MA-Net. Comput Methods Biomech Biomed Eng Imaging Vis:1–9. https://doi.org/10.1080/21681163.2021.1922315

  62. Zachara-Szczakowski S, Verdun T, Churg A (2015) Accuracy of classifying poorly differentiated non–small cell lung carcinoma biopsies with commonly used lung carcinoma markers. Hum Pathol 46(5):776–782. https://doi.org/10.1016/j.humpath.2015.02.001

    Article  Google Scholar 

  63. Zhang J, Zhang J, Yuan C, Luo Y, Li Y, Dai P, Sun W, Zhang N, Ren J, Zhang J, Gong Y, Xie C (2020) Establishment of the prognostic index of lung squamous cell carcinoma based on immunogenomic landscape analysis. Cancer Cell Int 20(1):1–16. https://doi.org/10.1186/s12935-020-01429-y

    Article  Google Scholar 

  64. Zhang X et al (2022) Prediction of therapy response in patients with NSCLC based on CT images. In: 2022 4th international conference on intelligent medicine and image processing. https://doi.org/10.1145/3524086.3524103

Download references

Funding

This research did not receive any specific grant from funding agencies in the public, commercial, or not-for-profit sectors.

Author information

Authors and Affiliations

  1. Computer Sciences Department, Technical Vocational School, Fırat University, Elazığ, Turkey

    Uğur Demiroğlu

  2. Software Engineering Department, Faculty of Engineering, Aksaray University, Aksaray, Turkey

    Bilal Şenol

  3. Computer Engineering Department, Faculty of Engineering and Natural Sciences, Malatya Turgut Özal University, Malatya, Turkey

    Muhammed Yildirim

  4. Radiology Department, School of Medicine, Fırat University, Elazığ, Turkey

    Yeşim Eroğlu

Authors
  1. Uğur Demiroğlu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Bilal Şenol
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Muhammed Yildirim
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Yeşim Eroğlu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Uğur Demiroğlu.

Ethics declarations

Conflict of interests

There is no conflict of interest between the authors.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Demiroğlu, U., Şenol, B., Yildirim, M. et al. Classification of computerized tomography images to diagnose non-small cell lung cancer using a hybrid model. Multimed Tools Appl 82, 33379–33400 (2023). https://doi.org/10.1007/s11042-023-14943-8

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-023-14943-8

Keywords

Search

Navigation