Skip to main content

Longitudinal Mammogram Risk Prediction

  • Conference paper
  • First Online:
Medical Image Computing and Computer Assisted Intervention – MICCAI 2024 (MICCAI 2024)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 15005))

Abstract

Breast cancer is one of the leading causes of mortality among women worldwide. Early detection and risk assessment play a crucial role in improving survival rates. Therefore, annual or biennial mammograms are often recommended for screening in high-risk groups. Mammograms are typically interpreted by expert radiologists based on the Breast Imaging Reporting and Data System (BI-RADS), which provides a uniform way to describe findings and categorizes them to indicate the level of concern for breast cancer. Recently, machine learning (ML) and computational approaches have been developed to automate and improve the interpretation of mammograms. However, both BI-RADS and the ML-based methods focus on the analysis of data from the present and sometimes the most recent prior visit. While it has been shown that temporal changes in image features of longitudinal scans are valuable for quantifying breast cancer risk, no prior work has systematically studied this. In this paper, we extend a state-of-the-art ML model [20] to ingest an arbitrary number of longitudinal mammograms and predict future breast cancer risk. On a large-scale dataset, we demonstrate that our model, LoMaR, achieves state-of-the-art performance when presented with only the present mammogram. Furthermore, we use LoMaR to characterize the predictive value of prior visits. Our results show that longer histories (e.g., up to four prior annual mammograms) can significantly boost the accuracy of predicting future breast cancer risk, particularly beyond the short-term. Our code and model weights are available at https://github.com/batuhankmkaraman/LoMaR.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Arasu, V.A., Habel, L.A., Achacoso, N., Buist, D.S., Cord, J.B., Esserman, L.J., Hylton, N.M., Glymour, M.M., Kornak, J., Kushi, L.H., Lewis, D.A., Vincent, J.L., Lydon, C., Miglioretti, D.L., Navarro, D., Pu, A.X., Shen, L., Sieh, W., Yoon, H.C., Lee, C.: Comparison of mammography ai algorithms with a clinical risk model for 5-year breast cancer risk prediction: An observational study. Radiology 307 (06 2023). https://doi.org/10.1148/radiol.222733

  2. Dadsetan, S., Arefan, D., Berg, W.A., Zuley, M.L., Sumkin, J.H., Wu, S.: Deep learning of longitudinal mammogram examinations for breast cancer risk prediction. Pattern Recognition 132, 108919–108919 (12 2022).https://doi.org/10.1016/j.patcog.2022.108919

  3. Damiani, C., Kalliatakis, G., Sreenivas, M., Al-Attar, M., Rose, J., Pudney, C., Lane, E.F., Cuzick, J., Montana, G., Brentnall, A.R.: Evaluation of an ai model to assess future breast cancer risk. Radiology 307 (06 2023).https://doi.org/10.1148/radiol.222679

  4. Dembrower, K., Lindholm, P., Strand, F.: A multi-million mammography image dataset and population-based screening cohort for the training and evaluation of deep neural networks-the cohort of screen-aged women (csaw). Journal of Digital Imaging 33, 408–413 (09 2019).https://doi.org/10.1007/s10278-019-00278-0

  5. Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., et al.: An image is worth 16x16 words: Transformers for image recognition at scale. arXiv preprint arXiv:2010.11929 (2020)

  6. Gastounioti, A., Desai, S., Ahluwalia, V.S., Conant, E.F., Kontos, D.: Artificial intelligence in mammographic phenotyping of breast cancer risk: a narrative review. Breast Cancer Research 24 (02 2022).https://doi.org/10.1186/s13058-022-01509-z

  7. He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) pp. 770–778 (06 2016). https://doi.org/10.1109/cvpr.2016.90

  8. Karaman, B.K., Mormino, E.C., Sabuncu, M.R.: Machine learning based multi-modal prediction of future decline toward alzheimer’s disease: An empirical study. PLOS ONE 17, e0277322 (11 2022).https://doi.org/10.1371/journal.pone.0277322

  9. Karolinska case-control dataset, https://data.europa.eu/data/datasets/https-doi-org-10-5878-45vm-t798?locale=en

  10. Kim, G., Bahl, M.: Assessing risk of breast cancer: A review of risk prediction models. Journal of Breast Imaging 3, 144–155 (02 2021).https://doi.org/10.1093/jbi/wbab001

  11. Kim, H., Lim, J., Kim, H.G., Lim, Y., Seo, B.K., Bae, M.S.: Deep learning analysis of mammography for breast cancer risk prediction in asian women. Diagnostics 13,  2247 (01 2023). https://doi.org/10.3390/diagnostics13132247, https://www.mdpi.com/2075-4418/13/13/2247

  12. Lee, H., Kim, J., Park, E., Kim, M., Kim, T., Kooi, T.: Enhancing breast cancer risk prediction by incorporating prior images. Lecture Notes in Computer Science pp. 389–398 (01 2023). https://doi.org/10.1007/978-3-031-43904-9_38

  13. Santeramo, R., Damiani, C., Wei, J., Montana, G., Brentnall, A.R.: Are better ai algorithms for breast cancer detection also better at predicting risk? a paired case-control study. Breast Cancer Research 26 (02 2024).https://doi.org/10.1186/s13058-024-01775-z

  14. Selvaraju, R.R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., Batra, D.: Grad-cam: Visual explanations from deep networks via gradient-based localization. In: Proceedings of the IEEE international conference on computer vision. pp. 618–626 (2017)

    Google Scholar 

  15. Tasci, E., Zhuge, Y., Camphausen, K., Krauze, A.V.: Bias and class imbalance in oncologic data-towards inclusive and transferrable ai in large scale oncology data sets. Cancers 14,  2897 (06 2022).https://doi.org/10.3390/cancers14122897

  16. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, L., Polosukhin, I.: Attention is all you need (2017)

    Google Scholar 

  17. Wilkinson, L., Gathani, T.: Understanding breast cancer as a global health concern. The British Journal of Radiology 95 (12 2021).https://doi.org/10.1259/bjr.20211033, https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8822551/

  18. Yala, A., Lehman, C., Schuster, T., Portnoi, T., Barzilay, R.: A deep learning mammography-based model for improved breast cancer risk prediction. Radiology 292, 60–66 (07 2019). https://doi.org/10.1148/radiol.2019182716

  19. Yala, A., Mikhael, P.G., Strand, F., Lin, G., Satuluru, S., Kim, T., Banerjee, I., Gichoya, J., Trivedi, H., Lehman, C.D., Hughes, K., Sheedy, D.J., Matthis, L.M., Karunakaran, B., Hegarty, K.E., Sabino, S., Silva, T.B., Evangelista, M.C., Caron, R.F., Souza, B., Mauad, E.C., Patalon, T., Handelman-Gotlib, S., Guindy, M., Barzilay, R.: Multi-institutional validation of a mammography-based breast cancer risk model. Journal of Clinical Oncology (11 2022). https://doi.org/10.1200/jco.21.01337

  20. Yala, A., Mikhael, P.G., Strand, F., Lin, G., Smith, K., Wan, Y.L., Lamb, L., Hughes, K., Lehman, C., Barzilay, R.: Toward robust mammography-based models for breast cancer risk. Science Translational Medicine 13, eaba4373 (01 2021). https://doi.org/10.1126/scitranslmed.aba4373

  21. Yu, A.C., Eng, J.: One algorithm may not fit all: How selection bias affects machine learning performance. RadioGraphics p. 200040 (09 2020).https://doi.org/10.1148/rg.2020200040

  22. Yuan, W., Beaulieu-Jones, B.K., Yu, K.H., Lipnick, S.L., Palmer, N., Loscalzo, J., Cai, T., Kohane, I.S.: Temporal bias in case-control design: preventing reliable predictions of the future. Nature Communications 12 (02 2021). https://doi.org/10.1038/s41467-021-21390-2

Download references

Acknowledgement

This research was in part funded by the National Institutes of Health (NIH) grant R01AG053949, and the National Science Foundation (NSF) CAREER 1748377 grant.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Batuhan K. Karaman .

Editor information

Editors and Affiliations

Ethics declarations

Disclosure of Interests

The authors have no competing interests to declare that are relevant to the content of this article.

1 Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary material 1 (pdf 153 KB)

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Karaman, B.K., Dodelzon, K., Akar, G.B., Sabuncu, M.R. (2024). Longitudinal Mammogram Risk Prediction. In: Linguraru, M.G., et al. Medical Image Computing and Computer Assisted Intervention – MICCAI 2024. MICCAI 2024. Lecture Notes in Computer Science, vol 15005. Springer, Cham. https://doi.org/10.1007/978-3-031-72086-4_41

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-72086-4_41

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-72085-7

  • Online ISBN: 978-3-031-72086-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics