Abstract
Brain tumor classification plays an important role in brain cancer diagnosis and treatment. Pathologists typically have to work through numerous pathology images that can be in the order of hundreds or thousands which takes time and is prone to manual error. Here we investigate automating this task given pathology images as well as 3D MRI volumes without lesion maps. We use data provided by the CPM-RadPath 2019 MICCAI challenge. We first evaluate accuracy on the validation dataset with MRI and pathology images separately. We predict the 3D tumor mask with our custom developed tumor segmentation model that we used for the BraTS 2019 challenge. We show that the predicted tumor segmentations give a higher validation accuracy of 77.1% vs. 69.8% with MRI images when trained by a 3D residual convolutional neural network. For pathology images we train a 2D residual network and obtain a 66.2% validation accuracy. In both cases we find high training accuracies above 95% which suggests overfitting. We propose a dual path residual convolutional neural network model that trains simultaneously from both MRI and pathology images and we use a simple method to prevent overfitting. One path of our network is fully 3D and considers 3D tumor segmentations as input while the other path considers pathology images. To prevent overfitting we stop training after 90% training accuracy at the epoch number where our network loss increases in the following one. With this approach we achieve a validation accuracy of 84.9% showing that indeed combining the two image sources yields a better overall accuracy.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Louis, D.N., et al.: The 2016 world health organization classification of tumors of the central nervous system: a summary. Acta Neuropathol. 131(6), 803–820 (2016)
Kleihues, P., et al.: The WHO classification of tumors of the nervous system. J. Neuropathol. Exp. Neurol. 61(3), 215–225 (2002)
Brat, D.J., et al.: cIMPACT-NOW update 3: recommended diagnostic criteria for diffuse astrocytic glioma, IDH-wildtype, with molecular features of glioblastoma, WHO grade IV. Acta Neuropathol. 136(5), 805–810 (2018)
Xue, Y., et al.: A multi-path decoder network for brain tumor segmentation. In: Proceedings of MICCAI BraTS 2019 Challenge (2019)
Menze, B.H., et al.: The multimodal brain tumor image segmentation benchmark (BRATS). IEEE Trans. Med. Imaging 34(10), 1993–2024 (2014)
Bakas, S., et al.: Identifying the best machine learning algorithms for brain tumor segmentation, progression assessment, and overall survival prediction in the BRATS challenge. arXiv preprint arXiv:1811.02629 (2018)
He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)
Goodfellow, I., Bengio, Y., Courville, A.: Deep Learning. MIT press, Cambridge (2016)
Paszke, A., et al.: Automatic differentiation in PyTorch. In: NIPS-W, Alban Desmaison (2017)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Xue, Y. et al. (2020). Brain Tumor Classification with Tumor Segmentations and a Dual Path Residual Convolutional Neural Network from MRI and Pathology Images. In: Crimi, A., Bakas, S. (eds) Brainlesion: Glioma, Multiple Sclerosis, Stroke and Traumatic Brain Injuries. BrainLes 2019. Lecture Notes in Computer Science(), vol 11993. Springer, Cham. https://doi.org/10.1007/978-3-030-46643-5_36
Download citation
DOI: https://doi.org/10.1007/978-3-030-46643-5_36
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-46642-8
Online ISBN: 978-3-030-46643-5
eBook Packages: Computer ScienceComputer Science (R0)