Skip to main content

Scale-Aware Test-Time Click Adaptation for Pulmonary Nodule and Mass Segmentation

  • Conference paper
  • First Online:
Medical Image Computing and Computer Assisted Intervention – MICCAI 2023 (MICCAI 2023)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 14222))

Abstract

Pulmonary nodules and masses are crucial imaging features in lung cancer screening that require careful management in clinical diagnosis. Despite the success of deep learning-based medical image segmentation, the robust performance on various sizes of lesions of nodule and mass is still challenging. In this paper, we propose a multi-scale neural network with scale-aware test-time adaptation to address this challenge. Specifically, we introduce an adaptive Scale-aware Test-time Click Adaptation method based on effortlessly obtainable lesion clicks as test-time cues to enhance segmentation performance, particularly for large lesions. The proposed method can be seamlessly integrated into existing networks. Extensive experiments on both open-source and in-house datasets consistently demonstrate the effectiveness of the proposed method over some CNN and Transformer-based segmentation methods. Our code is available at https://github.com/SplinterLi/SaTTCA.

Z. Li and J. Yang—Equal contributions.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Armato, S.G., III., et al.: The lung image database consortium (lidc) and image database resource initiative (idri): a completed reference database of lung nodules on ct scans. Med. Phys. 38(2), 915–931 (2011)

    Article  Google Scholar 

  2. Azad, R., et al.: Transdeeplab: convolution-free transformer-based deeplab v3+ for medical image segmentation. In: Proceedings of International Conference on Medical Image Computing and Computer Assisted Intervention, pp. 91–102 (2022)

    Google Scholar 

  3. Chen, L.C., Zhu, Y., Papandreou, G., Schroff, F., Adam, H.: Encoder-decoder with atrous separable convolution for semantic image segmentation. In: Proceedings of European Conference on Computer Vision, pp. 801–818 (2018)

    Google Scholar 

  4. Chen, S., Qiu, C., Yang, W., Zhang, Z.: Multiresolution aggregation transformer unet based on multiscale input and coordinate attention for medical image segmentation. Sensors 22(10), 3820 (2022)

    Article  Google Scholar 

  5. Gould, M.K., et al.: Evaluation of individuals with pulmonary nodules: when is it lung cancer?: diagnosis and management of lung cancer: American college of chest physicians evidence-based clinical practice guidelines. Chest 143(5), e93S-e120S (2013)

    Article  Google Scholar 

  6. Heuvelmans, M., et al.: Optimisation of volume-doubling time cutoff for fast-growing lung nodules in ct lung cancer screening reduces false-positive referrals. Eur. Radiol. 23, 1836–1845 (2013)

    Article  Google Scholar 

  7. Isensee, F., Jaeger, P.F., Kohl, S.A., Petersen, J., Maier-Hein, K.H.: nnu-net: a self-configuring method for deep learning-based biomedical image segmentation. Nat. Methods 18(2), 203–211 (2021)

    Article  Google Scholar 

  8. Li, Y., et al.: Learning tumor growth via follow-up volume prediction for lung nodules. In: Proceedings of International Conference on Medical Image Computing and Computer Assisted Intervention, pp. 508–517 (2020)

    Google Scholar 

  9. Liu, K.: Stbi-yolo: a real-time object detection method for lung nodule recognition. IEEE Access 10, 75385–75394 (2022)

    Article  Google Scholar 

  10. Loshchilov, I., Hutter, F.: Sgdr: stochastic gradient descent with warm restarts. In: Proceedings of International Conference on Learning Representations (2017)

    Google Scholar 

  11. Loshchilov, I., Hutter, F.: Decoupled weight decay regularization. In: Proceedings of International Conference on Learning Representations (2019)

    Google Scholar 

  12. MacMahon, H., et al.: Guidelines for management of incidental pulmonary nodules detected on ct images: from the fleischner society 2017. Radiology 284(1), 228–243 (2017)

    Article  Google Scholar 

  13. Nikolov, S., et al.: Deep learning to achieve clinically applicable segmentation of head and neck anatomy for radiotherapy. arXiv preprint arXiv:1809.04430 (2018)

  14. Oizumi, H., et al.: Anatomic thoracoscopic pulmonary segmentectomy under 3-dimensional multidetector computed tomography simulation: a report of 52 consecutive cases. J. Thoracic Cardiovasc. Surg. 141(3), 678–682 (2011)

    Article  Google Scholar 

  15. Paszke, A., et al.: Pytorch: an imperative style, high-performance deep learning library. In: Proceedings of Advances in Neural Information Processing Systems (2019)

    Google Scholar 

  16. Pedrosa, J., et al.: Lndb: a lung nodule database on computed tomography. arXiv preprint arXiv:1911.08434 (2019)

  17. Schuchert, M.J., et al.: Anatomic segmentectomy in the treatment of stage i non-small cell lung cancer. Ann. Thoracic Surg. 84(3), 926–933 (2007)

    Article  Google Scholar 

  18. Sung, H., et al.: Global cancer statistics 2020: Globocan estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA Cancer J. Clin. 71(3), 209–249 (2021)

    Google Scholar 

  19. Tang, Y., et al.: Lesion segmentation and recist diameter prediction via click-driven attention and dual-path connection. In: Proceedings of International Conference on Medical Image Computing and Computer Assisted Intervention, pp. 341–351 (2021)

    Google Scholar 

  20. Tang, Y., Yan, K., Xiao, J., Summers, R.M.: One click lesion recist measurement and segmentation on ct scans. In: Proceedings of International Conference on Medical Image Computing and Computer Assisted Intervention, pp. 573–583 (2020)

    Google Scholar 

  21. Tang, Y., et al.: Accurate and robust lesion recist diameter prediction and segmentation with transformers. In: Proceedings of International Conference on Medical Image Computing and Computer Assisted Intervention, pp. 535–544 (2022)

    Google Scholar 

  22. Vachani, A., Zheng, C., Liu, I.L.A., Huang, B.Z., Osuji, T.A., Gould, M.K.: The probability of lung cancer in patients with incidentally detected pulmonary nodules: clinical characteristics and accuracy of prediction models. Chest 161(2), 562–571 (2022)

    Article  Google Scholar 

  23. Vaswani, A., et al.: Attention is all you need. In: Proceedings of Advances in Neural Information Processing Systems, vol. 30 (2017)

    Google Scholar 

  24. Wang, D., Shelhamer, E., Liu, S., Olshausen, B.A., Darrell, T.: Tent: fully test-time adaptation by entropy minimization. In: Proceedings of International Conference on Learning Representations. OpenReview.net (2021)

    Google Scholar 

  25. Wang, W., Chen, C., Ding, M., Yu, H., Zha, S., Li, J.: Transbts: multimodal brain tumor segmentation using transformer. In: Proceedings of International Conference on Medical Image Computing and Computer Assisted Intervention, pp. 109–119 (2021)

    Google Scholar 

  26. Yang, J., Fang, R., Ni, B., Li, Y., Xu, Y., Li, L.: Probabilistic radiomics: ambiguous diagnosis with controllable shape analysis. In: Proceedings of International Conference on Medical Image Computing and Computer Assisted Intervention, pp. 658–666 (2019)

    Google Scholar 

  27. Yang, J., et al.: Hierarchical classification of pulmonary lesions: a large-scale radio-pathomics study. In: Proceedings of International Conference on Medical Image Computing and Computer Assisted Intervention, pp. 497–507 (2020)

    Google Scholar 

Download references

Acknowledgement

This work was supported by the National Key Research and Development Program of China (2018AAA0100400), and in part by the National Natural Science Foundation of China (under Grants 62225113, 62222112 and 62176186).

Author information

Authors and Affiliations

Authors

Corresponding authors

Correspondence to Yongchao Xu or Bo Du .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Li, Z., Yang, J., Xu, Y., Zhang, L., Dong, W., Du, B. (2023). Scale-Aware Test-Time Click Adaptation for Pulmonary Nodule and Mass Segmentation. In: Greenspan, H., et al. Medical Image Computing and Computer Assisted Intervention – MICCAI 2023. MICCAI 2023. Lecture Notes in Computer Science, vol 14222. Springer, Cham. https://doi.org/10.1007/978-3-031-43898-1_65

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-43898-1_65

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-43897-4

  • Online ISBN: 978-3-031-43898-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics