Skip to main content

Optimizing Foundation Models for Histopathology: A Continual Learning Approach to Cancer Detection

  • Conference paper
  • First Online:
Trustworthy Artificial Intelligence for Healthcare (TAI4H 2024)

Abstract

Accurate analysis of histopathology images is a key step in cancer diagnosis and treatment planning. Specialized computational models for histopathology image analysis may be needed to better capture the unique characteristics of histopathological images that could be missed by models pretrained on generic data, such as ImageNet. We employed an incremental learning approach to enhance the performance of foundation models using the EfficientNet B0 architecture. Our study comprised three key experiments. First, we established a baseline accuracy of 84.4% by training the model on 50% of our dataset. Second, we investigated the impact of retraining different numbers of top blocks during incremental learning phases, finding that retraining three to six blocks provided the most significant accuracy improvements. Third, we analyzed the trade-off between accuracy improvement and training time, determining that retraining three to six blocks offered the best balance between performance gains and computational efficiency. Our results demonstrate the effectiveness of specialized models in capturing the details specific of histopathological images. Despite computational limitations, our findings underscore the importance of tailored histopathological models.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Aresta, G., et al.: BACH: grand challenge on breast cancer histology images. Med. Image Anal. 56, 122–139 (2019)

    Article  Google Scholar 

  2. Arooj, S., Zubair, M., Khan, M.F., Alissa, K., Khan, M.A., Mosavi, A.: Breast cancer detection and classification empowered with transfer learning. Front. Public Health 10, 924432 (2022)

    Article  Google Scholar 

  3. Arunachalam, H.B., et al.: Viable and necrotic tumor assessment from WSI of osteosarcoma using ML and DL models. PLoS ONE 14(4), e0210706 (2019)

    Article  Google Scholar 

  4. Kather, J.N., Halama, N., Marx, A.: 100,000 histological images of human colorectal cancer and healthy tissue. Zenodo10 5281 (2018)

    Google Scholar 

  5. Kumar, A., Vishwakarma, A., Bajaj, V.: ML3CNet: non-local means-assisted automatic framework for lung cancer subtypes classification using histopathological images. Comput. Methods Programs Biomed. 251, 108207 (2024)

    Google Scholar 

  6. Mahmud, M.I., Mamun, M., Abdelgawad, A.: A deep analysis of transfer learning based breast cancer detection using histopathology images. In: 2023 10th International Conference on Signal Processing and Integrated Networks (SPIN), pp. 198–204. IEEE (2023)

    Google Scholar 

  7. Nasir, M.U., Khan, S., Mehmood, S., Khan, M.A., Rahman, A.U., Hwang, S.O.: IoMT-based osteosarcoma cancer detection in histopathology images using transfer learning empowered with blockchain, fog computing, and edge computing. Sensors 22(14), 5444 (2022)

    Article  Google Scholar 

  8. Paszke, A., et al.: PyTorch: an imperative style, high-performance deep learning library. In: Proceedings of the 33rd International Conference on Neural Information Processing Systems (NeurIPS) (2019)

    Google Scholar 

  9. Pedregosa, F., et al.: Scikit-learn: ML in Python. JMLR 12, 2825–2830 (2011)

    MathSciNet  Google Scholar 

  10. Silva-Rodríguez, J., Colomer, A., Sales, M.A., Molina, R., Naranjo, V.: Going deeper through the Gleason scoring scale: an automatic end-to-end system for histology prostate grading and cribriform pattern detection. Comput. Methods Programs Biomed. 195, 105637 (2020)

    Article  Google Scholar 

  11. Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014)

  12. Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., Wojna, Z.: Rethinking the inception architecture for computer vision. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2016)

    Google Scholar 

  13. Tan, M., Le, Q.V.: EfficientNet: rethinking model scaling for convolutional neural networks. In: Proceedings of the 36th International Conference on Machine Learning (ICML), pp. 6105–6114 (2019)

    Google Scholar 

  14. Wu, Y., et al.: Recent advances of deep learning for computational histopathology: principles and applications. Cancers 14(5), 1199 (2022)

    Article  Google Scholar 

  15. Yadav, A., Ahmed, F., Daescu, O., Gedik, R., Coskunuzer, B.: Histopathological cancer detection with topological signatures. In: 2023 IEEE International Conference on Bioinformatics and Biomedicine (BIBM), pp. 1610–1619. IEEE (2023)

    Google Scholar 

  16. Yadav, A., Daescu, O., Leavey, P., Rudzinski, E.: Machine learning for rhabdomyosarcoma whole slide images sub-type classification. In: Proceedings of the 16th International Conference on PErvasive Technologies Related to Assistive Environments, pp. 192–196 (2023)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Ankur Yadav .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Yadav, A., Daescu, O. (2024). Optimizing Foundation Models for Histopathology: A Continual Learning Approach to Cancer Detection. In: Chen, H., Zhou, Y., Xu, D., Vardhanabhuti, V.V. (eds) Trustworthy Artificial Intelligence for Healthcare. TAI4H 2024. Lecture Notes in Computer Science, vol 14812. Springer, Cham. https://doi.org/10.1007/978-3-031-67751-9_12

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-67751-9_12

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-67750-2

  • Online ISBN: 978-3-031-67751-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics