Abstract
Breast cancer is one of the leading causes of mortality among women worldwide. Early detection and risk assessment play a crucial role in improving survival rates. Therefore, annual or biennial mammograms are often recommended for screening in high-risk groups. Mammograms are typically interpreted by expert radiologists based on the Breast Imaging Reporting and Data System (BI-RADS), which provides a uniform way to describe findings and categorizes them to indicate the level of concern for breast cancer. Recently, machine learning (ML) and computational approaches have been developed to automate and improve the interpretation of mammograms. However, both BI-RADS and the ML-based methods focus on the analysis of data from the present and sometimes the most recent prior visit. While it has been shown that temporal changes in image features of longitudinal scans are valuable for quantifying breast cancer risk, no prior work has systematically studied this. In this paper, we extend a state-of-the-art ML model [20] to ingest an arbitrary number of longitudinal mammograms and predict future breast cancer risk. On a large-scale dataset, we demonstrate that our model, LoMaR, achieves state-of-the-art performance when presented with only the present mammogram. Furthermore, we use LoMaR to characterize the predictive value of prior visits. Our results show that longer histories (e.g., up to four prior annual mammograms) can significantly boost the accuracy of predicting future breast cancer risk, particularly beyond the short-term. Our code and model weights are available at https://github.com/batuhankmkaraman/LoMaR.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Arasu, V.A., Habel, L.A., Achacoso, N., Buist, D.S., Cord, J.B., Esserman, L.J., Hylton, N.M., Glymour, M.M., Kornak, J., Kushi, L.H., Lewis, D.A., Vincent, J.L., Lydon, C., Miglioretti, D.L., Navarro, D., Pu, A.X., Shen, L., Sieh, W., Yoon, H.C., Lee, C.: Comparison of mammography ai algorithms with a clinical risk model for 5-year breast cancer risk prediction: An observational study. Radiology 307 (06 2023). https://doi.org/10.1148/radiol.222733
Dadsetan, S., Arefan, D., Berg, W.A., Zuley, M.L., Sumkin, J.H., Wu, S.: Deep learning of longitudinal mammogram examinations for breast cancer risk prediction. Pattern Recognition 132, 108919–108919 (12 2022).https://doi.org/10.1016/j.patcog.2022.108919
Damiani, C., Kalliatakis, G., Sreenivas, M., Al-Attar, M., Rose, J., Pudney, C., Lane, E.F., Cuzick, J., Montana, G., Brentnall, A.R.: Evaluation of an ai model to assess future breast cancer risk. Radiology 307 (06 2023).https://doi.org/10.1148/radiol.222679
Dembrower, K., Lindholm, P., Strand, F.: A multi-million mammography image dataset and population-based screening cohort for the training and evaluation of deep neural networks-the cohort of screen-aged women (csaw). Journal of Digital Imaging 33, 408–413 (09 2019).https://doi.org/10.1007/s10278-019-00278-0
Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., et al.: An image is worth 16x16 words: Transformers for image recognition at scale. arXiv preprint arXiv:2010.11929 (2020)
Gastounioti, A., Desai, S., Ahluwalia, V.S., Conant, E.F., Kontos, D.: Artificial intelligence in mammographic phenotyping of breast cancer risk: a narrative review. Breast Cancer Research 24 (02 2022).https://doi.org/10.1186/s13058-022-01509-z
He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) pp. 770–778 (06 2016). https://doi.org/10.1109/cvpr.2016.90
Karaman, B.K., Mormino, E.C., Sabuncu, M.R.: Machine learning based multi-modal prediction of future decline toward alzheimer’s disease: An empirical study. PLOS ONE 17, e0277322 (11 2022).https://doi.org/10.1371/journal.pone.0277322
Karolinska case-control dataset, https://data.europa.eu/data/datasets/https-doi-org-10-5878-45vm-t798?locale=en
Kim, G., Bahl, M.: Assessing risk of breast cancer: A review of risk prediction models. Journal of Breast Imaging 3, 144–155 (02 2021).https://doi.org/10.1093/jbi/wbab001
Kim, H., Lim, J., Kim, H.G., Lim, Y., Seo, B.K., Bae, M.S.: Deep learning analysis of mammography for breast cancer risk prediction in asian women. Diagnostics 13, 2247 (01 2023). https://doi.org/10.3390/diagnostics13132247, https://www.mdpi.com/2075-4418/13/13/2247
Lee, H., Kim, J., Park, E., Kim, M., Kim, T., Kooi, T.: Enhancing breast cancer risk prediction by incorporating prior images. Lecture Notes in Computer Science pp. 389–398 (01 2023). https://doi.org/10.1007/978-3-031-43904-9_38
Santeramo, R., Damiani, C., Wei, J., Montana, G., Brentnall, A.R.: Are better ai algorithms for breast cancer detection also better at predicting risk? a paired case-control study. Breast Cancer Research 26 (02 2024).https://doi.org/10.1186/s13058-024-01775-z
Selvaraju, R.R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., Batra, D.: Grad-cam: Visual explanations from deep networks via gradient-based localization. In: Proceedings of the IEEE international conference on computer vision. pp. 618–626 (2017)
Tasci, E., Zhuge, Y., Camphausen, K., Krauze, A.V.: Bias and class imbalance in oncologic data-towards inclusive and transferrable ai in large scale oncology data sets. Cancers 14, 2897 (06 2022).https://doi.org/10.3390/cancers14122897
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, L., Polosukhin, I.: Attention is all you need (2017)
Wilkinson, L., Gathani, T.: Understanding breast cancer as a global health concern. The British Journal of Radiology 95 (12 2021).https://doi.org/10.1259/bjr.20211033, https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8822551/
Yala, A., Lehman, C., Schuster, T., Portnoi, T., Barzilay, R.: A deep learning mammography-based model for improved breast cancer risk prediction. Radiology 292, 60–66 (07 2019). https://doi.org/10.1148/radiol.2019182716
Yala, A., Mikhael, P.G., Strand, F., Lin, G., Satuluru, S., Kim, T., Banerjee, I., Gichoya, J., Trivedi, H., Lehman, C.D., Hughes, K., Sheedy, D.J., Matthis, L.M., Karunakaran, B., Hegarty, K.E., Sabino, S., Silva, T.B., Evangelista, M.C., Caron, R.F., Souza, B., Mauad, E.C., Patalon, T., Handelman-Gotlib, S., Guindy, M., Barzilay, R.: Multi-institutional validation of a mammography-based breast cancer risk model. Journal of Clinical Oncology (11 2022). https://doi.org/10.1200/jco.21.01337
Yala, A., Mikhael, P.G., Strand, F., Lin, G., Smith, K., Wan, Y.L., Lamb, L., Hughes, K., Lehman, C., Barzilay, R.: Toward robust mammography-based models for breast cancer risk. Science Translational Medicine 13, eaba4373 (01 2021). https://doi.org/10.1126/scitranslmed.aba4373
Yu, A.C., Eng, J.: One algorithm may not fit all: How selection bias affects machine learning performance. RadioGraphics p. 200040 (09 2020).https://doi.org/10.1148/rg.2020200040
Yuan, W., Beaulieu-Jones, B.K., Yu, K.H., Lipnick, S.L., Palmer, N., Loscalzo, J., Cai, T., Kohane, I.S.: Temporal bias in case-control design: preventing reliable predictions of the future. Nature Communications 12 (02 2021). https://doi.org/10.1038/s41467-021-21390-2
Acknowledgement
This research was in part funded by the National Institutes of Health (NIH) grant R01AG053949, and the National Science Foundation (NSF) CAREER 1748377 grant.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Ethics declarations
Disclosure of Interests
The authors have no competing interests to declare that are relevant to the content of this article.
1 Electronic supplementary material
Below is the link to the electronic supplementary material.
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Karaman, B.K., Dodelzon, K., Akar, G.B., Sabuncu, M.R. (2024). Longitudinal Mammogram Risk Prediction. In: Linguraru, M.G., et al. Medical Image Computing and Computer Assisted Intervention – MICCAI 2024. MICCAI 2024. Lecture Notes in Computer Science, vol 15005. Springer, Cham. https://doi.org/10.1007/978-3-031-72086-4_41
Download citation
DOI: https://doi.org/10.1007/978-3-031-72086-4_41
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-72085-7
Online ISBN: 978-3-031-72086-4
eBook Packages: Computer ScienceComputer Science (R0)