Abstract
Characterization of lesions by artificial intelligence (AI) has been the subject of extensive research. In recent years, many studies demonstrated the ability of convolution neural networks (CNNs) to successfully distinguish between malignant and benign breast lesions in mammography (MG) images. However, to date, no study has assessed the specific sub-type of lesions in MG images, as detailed in histolopathology reports. We present a method for finer classification of breast lesions in MG images into multiple pathology sub-types. Our approach works well with radiologists’ diagnostic workflow, and uses data available in radiology reports. The proposed Dual-Radiology Dual-Resolution Network (Du-Rad Du-Res Net) receives dual input from the radiologist and dual image resolutions. The radiologist input includes annotation of the lesion area and semantic radiology features; the dual image resolutions comprise a low resolution of the entire mammogram and a high resolution of the lesion area. The network estimates the likelihood of malignancy, as well as the associated pathological sub-type. We show that the combined input of the lesion region of interest (ROI) and the entire mammogram is important for optimizing the model’s performance. We tested the AI in a reader study on a dataset of 100 heldout cases. The AI outperformed three breast radiologists in the task of lesion histopathology sub-typing.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
https://acsjournals.onlinelibrary.wiley.com/doi/full/10.3322/caac.21588
Smith-Bindman, R., et al.: Comparing the performance of mammography screening in the USA and the UK. J. Med. Screening 12(1), 50–54 (2005)
Schell, M.J., et al.: Evidence-based target recall rates for screening mammography. Radiology 243(3), 681–689 (2007)
Neal, L., Tortorelli, C.L., Nassar, A.: Clinician’s guide to imaging and pathologic findings in benign breast disease. Mayo Clin. Proc. 85(3), 274–279 (2010). Elsevier
Kopans, D.B.: The positive predictive value of mammography. AJR Am. J. Roentgenol. 158(3), 521–526 (1992)
Holland, R., Hendriks, J.H.: Microcalcifications associated with ductal carcinoma in situ: mammographic-pathologic correlation. Seminars Diagn. Pathol. 11(3), 181–192 (1994)
Lamb, P.M., et al.: Correlation between ultrasound characteristics, mammographic findings and histological grade in patients with invasive ductal carcinoma of the breast. Clin. Radiol. 55(1), 40–44 (2000)
Hamidinekoo, A., et al.: Deep learning in mammography and breast histology, an overview and future trends. Med. Image Anal. 47, 45–67 (2018)
Cao, H., et al.: Multi-tasking U-shaped Network for benign and malignant classification of breast masses. IEEE Access 8, 223396–223404 (2020)
Agnes, S.A., et al.: Classification of mammogram images using multiscale all convolutional neural network (MA-CNN). J. Med. Syst. 44(1), 1–9 (2020)
Yi, D., et al.: Optimizing and visualizing deep learning for benign/malignant classification in breast tumors. arXiv preprint arXiv:1705.06362 (2017)
Li, H., et al.: Classification of breast mass in two’ view mammograms via deep learning. IET Image Processing (2020)
Hamidinekoo, A., et al.: Comparing the performance of various deep networks for binary classification of breast tumours. In: 14th International Workshop on Breast Imaging (IWBI 2018), vol. 10718. International Society for Optics and Photonics (2018)
Chorev, M., et al.: The case of missed cancers: applying AI as a radiologist’s safety net. In: Martel, A.L., et al. (eds.) MICCAI 2020. LNCS, vol. 12266, pp. 220–229. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-59725-2_22
Akselrod-Ballin, A., et al.: Predicting breast cancer by applying deep learning to linked health records and mammograms. Radiology 292(2), 331–342 (2019)
Yala, A., et al.: A deep learning model to triage screening mammograms: a simulation study. Radiology 293(1), 38–46 (2019)
Rodriguez-Ruiz, A., et al.: One-view digital breast tomosynthesis as a stand-alone modality for breast cancer detection: do we need more? Eur. Radiol. 28(5), 1938–1948 (2018)
Kyono, T., Gilbert, F.J., van der Schaar, M.: Improving workflow efficiency for mammography using machine learning. J. Am. Coll. Radiol. 17(1), 56–63 (2020)
Shen, Y., et al.: An interpretable classifier for high-resolution breast cancer screening images utilizing weakly supervised localization. Med. Image Anal. 68, 101908 (2021)
Szegedy, C., et al.: Inception-v4, inception-resnet and the impact of residual connections on learning. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 31(1) (2017)
Ness, L., Barkan, E., Ozery-Flato, M.: Improving the performance and explainability of mammogram classifiers with local annotations. In: Cardoso, J., et al. (eds.) IMIMIC/MIL3ID/LABELS -2020. LNCS, vol. 12446, pp. 33–42. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-61166-8_4
IBM Research, H.: Fusemedml: https://github.com/ibm/fuse-med-ml (2021). https://doi.org/10.5281/ZENODO.5146491. https://zenodo.org/record/51464
Cohen, J.: A coefficient of agreement for nominal scales. Educ. Psychol. Measure. 20(1), 37–46 (1960)
Elmore, J.G., et al.: Diagnostic concordance among pathologists interpreting breast biopsy specimens. Jama 313(11), 1122–1132 (2015)
Waugh, S.A., et al.: Magnetic resonance imaging texture analysis classification of primary breast cancer. Eur. Radiol. 26(2), 322–330 (2016)
Harrison, B.T., et al.: Quality assurance in breast pathology: lessons learned from a review of amended reports. Arch. Pathol. Lab. Med. 141(2), 260–266 (2017)
Dillon, M.F., et al.: Diagnostic accuracy of core biopsy for ductal carcinoma in situ and its implications for surgical practice. J. Clin. Pathol. 59(7), 740–743 (2006)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
1 Electronic supplementary material
Below is the link to the electronic supplementary material.
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Tlusty, T. et al. (2021). Pre-biopsy Multi-class Classification of Breast Lesion Pathology in Mammograms. In: Lian, C., Cao, X., Rekik, I., Xu, X., Yan, P. (eds) Machine Learning in Medical Imaging. MLMI 2021. Lecture Notes in Computer Science(), vol 12966. Springer, Cham. https://doi.org/10.1007/978-3-030-87589-3_29
Download citation
DOI: https://doi.org/10.1007/978-3-030-87589-3_29
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-87588-6
Online ISBN: 978-3-030-87589-3
eBook Packages: Computer ScienceComputer Science (R0)
