Abstract
Neoadjuvant chemotherapy (NAC) is considered to be the standard treatment for locally advanced breast cancer, but less than half of all recipients achieve pathological complete response (pCR), necessitating a way to predict pCR prior to NAC. Previous work has shown that pCR prediction is viable via either radiomic or deep learning classification methods when applied to the tumoral region on breast MRI. Others have shown that analysis within the peritumoral region directly outside of the tumor can contribute unique value to pCR prediction. In this work we present Response Estimation through Spatially Oriented Neural Network and Texture Ensemble (RESONATE): an approach to spatially invoke different types of analytic representations in different tumor compartments to create a multi-representation based prediction of response to NAC in breast cancer. A total of 114 NAC recipients with pre-treatment MRI were retrospectively analyzed, with 80 of the patients used for training and 34 held out as an independent testing set. Deep learning and radiomic classifiers were trained separately within the tumor and the peritumoral region, with separate classifier predictions then being fused together via a logistic regression classifier. In the testing set, individual radiomics and deep learning classifiers achieved area under the curve (AUC) values of 0.69 and 0.75 within the tumor, respectively, and 0.69 and 0.66 within the peritumoral region. A weighted fusion of these four classifiers, however, best predicted pCR with an AUC of 0.79. This approach also outperformed fusions incorporating radiomic (AUC = 0.77) or deep learning (AUC = 0.75) only, as well as combinations of representations only within (AUC = 0.78) or outside (AUC = 0.70) the tumor.
J. E. Eben and N. Braman—Equal contribution.
Research reported in this publication was supported by the National Cancer Institute of the National Institutes of Health under award numbers 1F31CA221383-01, 1U24CA199374-01, R01CA202752-01A1, R01CA208236-01A1, R01 CA216579-01A1, R01 CA220581-01A1, 1U01 CA239055-01, National Center for Research Resources under award number 1 C06 RR12463-01, VA Merit Review Award IBX004121A from the United States Department of Veterans Affairs Biomedical Laboratory Research and Development Service, the DOD Prostate Cancer Idea Development Award (W81XWH-15-1-0558), the DOD Lung Cancer Investigator-Initiated Translational Research Award (W81XWH-18-1-0440), the DOD Peer Reviewed Cancer Research Program (W81XWH-16-1-0329), the Ohio Third Frontier Technology Validation Fund, the Wallace H. Coulter Foundation Program in the Department of Biomedical Engineering and the Clinical and Translational Science Award Program (CTSA) at Case Western Reserve University. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health, the U.S. Department of Veterans Affairs, the Department of Defense, or the United States Government.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Thompson, A.M., et al.: Neoadjuvant treatment of breast cancer. Ann. Oncol. 23, x231–x236 (2012)
Kong, X., et al.: Meta-analysis confirms pathological complete response after neoadjuvant chemotherapy predicts favourable breast cancer prognosis. Eur. J. Canc. 47(14), 2084–2090 (2011)
Earl, H., et al.: Neoadjuvant trials in early breast cancer: pathological response at surgery and correlation to longer term outcomes. BMC Med. 13(1), 234 (2015)
Braman, N.M., et al.: Intratumoral and peritumoral radiomics for the pretreatment prediction of pathological complete response to neoadjuvant chemotherapy based on breast DCE-MRI. BCR 19(1), 57 (2017)
Ravichandran, K., et al.: A deep learning classifier for prediction of pathological complete response to neoadjuvant chemotherapy from baseline breast DCE-MRI. In: SPIE (2018)
Braman, N., et al.: Association of peritumoral radiomics with tumor biology and pathologic response to preoperative targeted therapy for HER2 (ERBB2)-positive breast cancer. JAMA Netw. Open 2(4), e192561–e192561 (2019)
Amyar, A., et al.: 3-D RPET-NET: development of a 3-D pet imaging convolutional neural network for radiomics analysis and outcome prediction. IEEE TRPMS 3(2), 225–231 (2019)
Antropova, N., et al.: A deep feature fusion methodology for breast cancer diagnosis demonstrated on three imaging modality datasets. Med. Phys. 44(10), 5162–5171 (2017)
Paul, R., et al.: Predicting nodule malignancy using a CNN ensemble approach. In: Proceedings of the International Joint Conference on Neural Networks (2018)
Bizzego, A., et al.: Integrating deep and radiomics features in cancer bioimaging. bioRxiv (2019)
Liu, S., et al.: Pulmonary nodule classification in lung cancer screening with three-dimensional convolutional neural networks. J. Med. Imaging 4(4), 041308 (2017)
Braman, N., Prasanna, P., Alilou, M., Beig, N., Madabhushi, A.: Vascular network organization via hough transform (VaNgOGH): a novel radiomic biomarker for diagnosis and treatment response. In: Frangi, A.F., Schnabel, J.A., Davatzikos, C., Alberola-López, C., Fichtinger, G. (eds.) MICCAI 2018. LNCS, vol. 11071, pp. 803–811. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-00934-2_89
Springenberg, J.T., et al.: Striving for simplicity: the all convolutional net. In: ICLR (2015)
Kotikalapudi, R., et al.: keras-vis (2017). https://github.com/raghakot/keras-vis
Pauly, M., et al.: Permutation based inference for the AUC: a unified approach for continuous and discontinuous data. Biometrical 58(6), 1319–1337 (2016)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Eben, J.E., Braman, N., Madabhushi, A. (2019). Response Estimation Through Spatially Oriented Neural Network and Texture Ensemble (RESONATE). In: Shen, D., et al. Medical Image Computing and Computer Assisted Intervention – MICCAI 2019. MICCAI 2019. Lecture Notes in Computer Science(), vol 11767. Springer, Cham. https://doi.org/10.1007/978-3-030-32251-9_66
Download citation
DOI: https://doi.org/10.1007/978-3-030-32251-9_66
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-32250-2
Online ISBN: 978-3-030-32251-9
eBook Packages: Computer ScienceComputer Science (R0)