Skip to main content

Advertisement

SpringerLink
Log in

A 3D prediction model for benign or malignant of pulmonary nodules based on neural architecture search

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

Lung cancer poses a huge threat to human life and health. Early diagnosis and early treatment are the most effective means to improve patient survival and reduce mortality. Aiming at the low correlation among dimensional features of lung CT 3D image data and low accuracy of single manually designed convolutional neural network, this paper proposes a 3D prediction model for benign or malignant of pulmonary nodule based on neural architecture search. The main contribution is to design a cross-dimensional interactive quadruple attention module to increase the feature extraction and feature representation capabilities of the 3D classification network for pulmonary nodules. Moreover, a multi-model prediction fusion method based on multi-ensemble learning algorithms is designed to improve the reliability of the result. The experimental results on LUNA16 data set achieve 90.85% Accuracy, 93.02% AUC and 88.89% F1 value, thus showing that the proposed approach has high accuracy and reliability.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

Data Availability

The dataset used in this research can be downloaded from: https://luna16.grand-challenge.org/.

References

  1. Allemani, C., Matsuda, T., Carlo, V.D., Harewood, R., Matz, M., Niksic, M., Bonaventure, A., Valkov, P.M., Johnson, C.J., Esteve, P.J., Ogunbiyif, P.O.J., Azevedo, P.G., Silva, Chen, W.Q., Eser, S., Engholm, G., Stiller, C.A., Monnereau, A., Woods, R.R., Visser, O., Hsiang, G., Aitken, P.J., Weir, H.K., , Coleman, P.M.P.: Global surveillance of trends in cancer survival 2000-14: analysis of individual records for 37 513 025 patients diagnosed with one of 18 cancers from 322 population-based registries in 71 countries. The Lancet 391, 1023–1075 (2018)

  2. National Lung Screening Trial Research Team: Reduced lung-cancer mortality with low-dose computed tomographic screening. N. E. J. Med. 365, 395–409 (2011)

  3. Zhang, G., Yang, Z., Gong, L., Jiang, S., Wang, L., Cao, X., Wei, L., Zhang, H., Liu, Z.: An appraisal of nodule diagnosis for lung cancer in ct images. J. Med. Syst. 43, 1–18 (2019)

    Article  Google Scholar 

  4. Sasidhar, B., Geetha, G., Khodanpur, B.I., Babu, D.R.R.: Automatic classification of lung nodules into benign or malignant using svm classifier. In: Proceedings of the 5th International Conference on Frontiers in Intelligent Computing: Theory and Applications, 2017, Singapore, pp. 551–559 (2017)

  5. Dey, R., Lu, Z., Hong, Y.: Diagnostic classification of lung nodules using 3d neural networks. In: 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018), 2018, pp. 774–778 (2018)

  6. Zhang, G., Lin, L., Zhao, L., Wang, J.: Lung nodule classification in ct images using 3d densenet. Journal of Physics: Conference Series 1827 (2021)

  7. Aniket, J., Jayanthi, S., Gopal, J.: Lung nodule malignancy classification with weakly supervised explanation generation. J. Med. Imag. 8 (2021)

  8. Li, D., Yuan, S., Yao, G.: Classification of lung nodules based on the dca-xception network. J. X-ray Sci. Technol. 30 (2022)

  9. Sekeroglu, K., Soysal, O.: Multi-perspective hierarchical deep-fusion learning framework for lung nodule classification. Sensors 22 (2022)

  10. Yang, Y., Li, X., Fu, J., Han, Z., Gao, B.: 3d multi-view squeeze-and-excitation convolutional neural network for lung nodule classification. Med. Phy. 50, 1905–1916 (2023)

    Article  Google Scholar 

  11. Guo, Z., Yang, J., Zhao, L., Yuan, J., Yu, H.: 3d saacnet with gbm for the classification of benign and malignant lung nodules. Comput. Biol. Med. 153 (2023)

  12. Bochkovskiy, A., Wang, C., Liao, H.M.: Yolov4: Optimal speed and accuracy of object detection (2020). arXiv:2004.10934v1

  13. Liu, Z., Li, J., Shen, Z., Huang, G., Yan, S., Zhang, C.: Learning efficient convolutional networks through network slimming. In: Proceedings of the IEEE International Conference on Computer Vision, 2017, pp. 2736–2744 (2017)

  14. Cao, J., Li, Y., Sun, M., Chen, Y., Lischinski, D., Cohen-Or, D., Chen, B., Tu, C.: Do-conv: Depthwise over-parameterized convolutional layer. IEEE Trans. Image Proc. 31, 3726–3736 (2022)

    Article  Google Scholar 

  15. Lin, T., Goyal, P., Girshick, R., He, K., Dollar, P.: Focal loss for dense object detection. In: Proceedings of IEEE International Conference on Computer Vision, pp. 2980–2988 (2017)

  16. Mei, S., Jiang, H., Ma, L.: A practical detector based on improved yolov4 for pulmonary nodule detection. In: 14th International Congress on Image and Signal Processing. BioMed. Eng. Inf. (CISP-BMEI) (2021)

  17. Misra, D., Nalamada, T., Arasanipalai, A.U., Hou, Q.: Rotate to attend: Convolutional triplet attention module. In: Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), pp. 3139–3148 (2021)

  18. Setio, A., Traverso, A., Bel, T., Berens, M., Bogaard, C., Cerello, P., Chen, H., Dou, Q., Fantacci, M.E., Geurts, B., Gugten, R., Heng, P.A., Jansen, B., Kaste, M., Kotov, V., Lin, J.Y., Manders, J., Sonora-Mengana, A., Garcia-Naranjo, J.C., Papavasileiou, E.: Validation, comparison, and combination of algorithms for automatic detection of pulmonary nodules in computed tomography images: the luna16 challenge. Med. Image Analy. 42, 1–13 (2017)

    Article  Google Scholar 

  19. Armato, S.G., McLennan, G., Bidaut, L., McNitt-Gray, M.F., Meyer, C.R., Reeves, A.P., Zhao, B., Aberle, D.R., Henschke, C.I., Hoffman, E.A., Kazerooni, E.A., MacMahon, H., Beeke, E.J.R.V., Yankelevitz, D., Biancardi, A.M., Bland, P.H., Brown, M.S., Engelmann, R.M., Laderach, G.E., Max, D., Pais, R.C., Qing, D., Roberts, R.Y., Smith, A.R., Starkey, A., Batrah, P., Caligiuri, P., Farooqi, A., Gladish, G.W., Jude, C.M., Munden, R.F., Petkovska, I., Quint, L.E., Schwartz, L.H., S, B., Dodd, L.E., Fenimore, C., Gur, D., Petrick, N., Freymann, J., Kirby, J., Hughes, B., Casteele, A.V., Gupte, S., Sallamm, M., Heath, M.D., Kuhn, M.H., Dharaiya, E., Burns, R., Fryd, D.S., Salganicoff, M., Anand, V., Shreter, U., Vastagh, S., Croft, B.Y.: The lung image database consortium (lidc) and image database resource initiative (idri): a completed reference database of lung nodules on ct scans. Medical physics 38, 915–931 (2011)

  20. Woo, S., Park, J., Lee, J., Kweon, I.: Cbam: Convolutional block attention module. In: Proceedings of the European Conference on Computer Vision, pp. 3–19 (2018)

  21. Leo, B.: Bagging predictors. Machine Learn. 24, 123–140 (1996)

    Article  Google Scholar 

  22. Feng, J., Xu, Y., Jiang, Y., Zhou, Z.: Soft gradient boosting machine (2020). arXiv:2006.04059

  23. Kumar, D., Wong, A., Clausi, D.A.: Lung nodule classification using deep features in ct images. In: 12th Conference on Computer and Robot Vision, pp. 133–138 (2015)

  24. Kaya, A., Can, A.B.: A weighted rule based method for predicting malignancy of pulmonary nodules by nodule characteristics. J. Biomed. Inf. 56, 69–79 (2015)

    Article  Google Scholar 

  25. Sun, W., Zheng, B., Huang, X., Qian, W.: Balance the nodule shape and surroundings: a new multichannel image based convolutional neural network scheme on lung nodule diagnosis. In: Medical Imaging 2017: Computer-Aided Diagnosis (2017)

  26. Shen, W., Zhou, M., Yang, F., Yu, D., Dong, D., Yang, C., Zang, Y., Tian, J.: Multi-crop convolutional neural networks for lung nodule malignancy suspiciousness classification. Pattern Recog. 61, 663–673 (2017)

    Article  Google Scholar 

  27. Lee, H., Lee, H., Park, M., Kim, J.: Contextual convolutional neural networks for lung nodule classification using gaussian-weighted average image patches. In: Medical Imaging 2017: Computer-Aided Diagnosis (2017)

  28. Zhu, W., Liu, C., Fan, W., Xie, X.: Deeplung: Deep 3d dual path nets for automated pulmonary nodule detection and classification. In: IEEE Winter Conference on Applications of Computer Vision (WACV), pp. 673–681 (2018)

  29. Jiang, H., Shen, F., Gao, F., Han, W.: Learning efficient, explainable and discriminative representations for pulmonary nodules classification. Pattern Recognition 113 (2021)

Download references

Acknowledgements

This research is supported by Zhengzhou collaborative innovation major special project (20XTZX11020).

Funding

Not applicable.

Author information

Authors and Affiliations

  1. National Super Computing Center of Zhengzhou, Zhengzhou University, Zhengzhou, China

    Lei Yang

  2. Zhililkang Co. Ltd, Zhengzhou, China

    Lei Yang, Yan Li, Ling Ma & Huiqin Jiang

  3. The Graduate School of Electrical and Information Engineering, Zhengzhou University, Science Avenue No 100, Zhengzhou, 450001, China

    Sen Mei, Ling Ma & Huiqin Jiang

  4. The First Affiliated Hospital of Zhengzhou University, Zhengzhou, China

    Pan Liang & Jianbo Gao

  5. The College of Artificial Intelligence and Big Data, Henan University of Technology, Zhengzhou, China

    Yan Li

Authors
  1. Lei Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Sen Mei
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Pan Liang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Yan Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Ling Ma
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Jianbo Gao
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Huiqin Jiang
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

L.Y. wrote the main manuscript text, Sen Mei prepared figures 1-4. All authors reviewed and commented the manuscript.

Corresponding authors

Correspondence to Jianbo Gao or Huiqin Jiang.

Ethics declarations

Conflict of interest

The authors declare that they have no competing interests.

Ethics approval and consent to participate

This study was approved by the Graduate School of Information Engineering, Zhengzhou University.

Consent for publication

All the authors have provided consent for publication.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Yang, L., Mei, S., Liang, P. et al. A 3D prediction model for benign or malignant of pulmonary nodules based on neural architecture search. SIViP 18, 843–852 (2024). https://doi.org/10.1007/s11760-023-02807-5

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11760-023-02807-5

Keywords

Search

Navigation