Skip to main content

Response Estimation Through Spatially Oriented Neural Network and Texture Ensemble (RESONATE)

  • Conference paper
  • First Online:
Medical Image Computing and Computer Assisted Intervention – MICCAI 2019 (MICCAI 2019)

Abstract

Neoadjuvant chemotherapy (NAC) is considered to be the standard treatment for locally advanced breast cancer, but less than half of all recipients achieve pathological complete response (pCR), necessitating a way to predict pCR prior to NAC. Previous work has shown that pCR prediction is viable via either radiomic or deep learning classification methods when applied to the tumoral region on breast MRI. Others have shown that analysis within the peritumoral region directly outside of the tumor can contribute unique value to pCR prediction. In this work we present Response Estimation through Spatially Oriented Neural Network and Texture Ensemble (RESONATE): an approach to spatially invoke different types of analytic representations in different tumor compartments to create a multi-representation based prediction of response to NAC in breast cancer. A total of 114 NAC recipients with pre-treatment MRI were retrospectively analyzed, with 80 of the patients used for training and 34 held out as an independent testing set. Deep learning and radiomic classifiers were trained separately within the tumor and the peritumoral region, with separate classifier predictions then being fused together via a logistic regression classifier. In the testing set, individual radiomics and deep learning classifiers achieved area under the curve (AUC) values of 0.69 and 0.75 within the tumor, respectively, and 0.69 and 0.66 within the peritumoral region. A weighted fusion of these four classifiers, however, best predicted pCR with an AUC of 0.79. This approach also outperformed fusions incorporating radiomic (AUC = 0.77) or deep learning (AUC = 0.75) only, as well as combinations of representations only within (AUC = 0.78) or outside (AUC = 0.70) the tumor.

J. E. Eben and N. Braman—Equal contribution.

Research reported in this publication was supported by the National Cancer Institute of the National Institutes of Health under award numbers 1F31CA221383-01, 1U24CA199374-01, R01CA202752-01A1, R01CA208236-01A1, R01 CA216579-01A1, R01 CA220581-01A1, 1U01 CA239055-01, National Center for Research Resources under award number 1 C06 RR12463-01, VA Merit Review Award IBX004121A from the United States Department of Veterans Affairs Biomedical Laboratory Research and Development Service, the DOD Prostate Cancer Idea Development Award (W81XWH-15-1-0558), the DOD Lung Cancer Investigator-Initiated Translational Research Award (W81XWH-18-1-0440), the DOD Peer Reviewed Cancer Research Program (W81XWH-16-1-0329), the Ohio Third Frontier Technology Validation Fund, the Wallace H. Coulter Foundation Program in the Department of Biomedical Engineering and the Clinical and Translational Science Award Program (CTSA) at Case Western Reserve University. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health, the U.S. Department of Veterans Affairs, the Department of Defense, or the United States Government.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Thompson, A.M., et al.: Neoadjuvant treatment of breast cancer. Ann. Oncol. 23, x231–x236 (2012)

    Article  Google Scholar 

  2. Kong, X., et al.: Meta-analysis confirms pathological complete response after neoadjuvant chemotherapy predicts favourable breast cancer prognosis. Eur. J. Canc. 47(14), 2084–2090 (2011)

    Article  Google Scholar 

  3. Earl, H., et al.: Neoadjuvant trials in early breast cancer: pathological response at surgery and correlation to longer term outcomes. BMC Med. 13(1), 234 (2015)

    Article  Google Scholar 

  4. Braman, N.M., et al.: Intratumoral and peritumoral radiomics for the pretreatment prediction of pathological complete response to neoadjuvant chemotherapy based on breast DCE-MRI. BCR 19(1), 57 (2017)

    Article  MathSciNet  Google Scholar 

  5. Ravichandran, K., et al.: A deep learning classifier for prediction of pathological complete response to neoadjuvant chemotherapy from baseline breast DCE-MRI. In: SPIE (2018)

    Google Scholar 

  6. Braman, N., et al.: Association of peritumoral radiomics with tumor biology and pathologic response to preoperative targeted therapy for HER2 (ERBB2)-positive breast cancer. JAMA Netw. Open 2(4), e192561–e192561 (2019)

    Article  Google Scholar 

  7. Amyar, A., et al.: 3-D RPET-NET: development of a 3-D pet imaging convolutional neural network for radiomics analysis and outcome prediction. IEEE TRPMS 3(2), 225–231 (2019)

    Google Scholar 

  8. Antropova, N., et al.: A deep feature fusion methodology for breast cancer diagnosis demonstrated on three imaging modality datasets. Med. Phys. 44(10), 5162–5171 (2017)

    Article  Google Scholar 

  9. Paul, R., et al.: Predicting nodule malignancy using a CNN ensemble approach. In: Proceedings of the International Joint Conference on Neural Networks (2018)

    Google Scholar 

  10. Bizzego, A., et al.: Integrating deep and radiomics features in cancer bioimaging. bioRxiv (2019)

    Google Scholar 

  11. Liu, S., et al.: Pulmonary nodule classification in lung cancer screening with three-dimensional convolutional neural networks. J. Med. Imaging 4(4), 041308 (2017)

    Article  Google Scholar 

  12. Braman, N., Prasanna, P., Alilou, M., Beig, N., Madabhushi, A.: Vascular network organization via hough transform (VaNgOGH): a novel radiomic biomarker for diagnosis and treatment response. In: Frangi, A.F., Schnabel, J.A., Davatzikos, C., Alberola-López, C., Fichtinger, G. (eds.) MICCAI 2018. LNCS, vol. 11071, pp. 803–811. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-00934-2_89

    Chapter  Google Scholar 

  13. Springenberg, J.T., et al.: Striving for simplicity: the all convolutional net. In: ICLR (2015)

    Google Scholar 

  14. Kotikalapudi, R., et al.: keras-vis (2017). https://github.com/raghakot/keras-vis

  15. Pauly, M., et al.: Permutation based inference for the AUC: a unified approach for continuous and discontinuous data. Biometrical 58(6), 1319–1337 (2016)

    Article  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jeffrey E. Eben .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Eben, J.E., Braman, N., Madabhushi, A. (2019). Response Estimation Through Spatially Oriented Neural Network and Texture Ensemble (RESONATE). In: Shen, D., et al. Medical Image Computing and Computer Assisted Intervention – MICCAI 2019. MICCAI 2019. Lecture Notes in Computer Science(), vol 11767. Springer, Cham. https://doi.org/10.1007/978-3-030-32251-9_66

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-32251-9_66

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-32250-2

  • Online ISBN: 978-3-030-32251-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics