Automated end-to-end deep learning framework for classification and tumor localization from native non-stained pathology images

Akram Bayat; Connor Anderson; Pratik Shah

doi:10.1117/12.2582303

15 February 2021 Automated end-to-end deep learning framework for classification and tumor localization from native non-stained pathology images

Akram Bayat, Connor Anderson, Pratik Shah

Author Affiliations +

Proceedings Volume 11596, Medical Imaging 2021: Image Processing; 115960A (2021) https://doi.org/10.1117/12.2582303
Event: SPIE Medical Imaging, 2021, Online Only

Abstract

Deep learning based quantitative assessment of digital pathology images and understanding the underlying reasons for a specific clinical decision is challenging, and automatic histology pattern classification and tumor localization in whole-slide pathology images are critical for interpretable learning systems. In this study, we propose an end-to-end deep learning framework for automatic detection and localization of tumors directly from non-stained whole slide prostate core biopsy images (WSI). We use a previously described Generative Adversarial Network (GAN)-based model from our laboratory for computational Hematoxylin and Eosin (HE) staining of native non-stained pathology images. A convolutional neural network to detect and classify tumor regions in 1024×1024 virtually stained HE pixel patches, and a concurrent deep weakly supervised (WSL) model that provides localization of predominant histologic patterns used for tumor classification without the need for pixel-level annotations are reported in this study for the first time. The end-to-end system was evaluated on a 17K hold out set of 1024×1024 non-stained patches extracted from 13 whole slide prostate biopsy images. Experimental results yielded 86.37% patch-level classification accuracy with 85.05% precision, and achieved a Dice index of 65.07±1.99 (compared to 70.24±1.86 Dice index in the U-Net reference model for pixel-level segmentation). The end-to-end deep learning framework thus automates digital pathology image workflow from tissue staining to interpretable prostate tumor classification and can be valuable for accurate grading of prostate cancer and generalized to other whole-slide image classification tasks.

Conference Presentation

Citation Download Citation

Akram Bayat, Connor Anderson, and Pratik Shah "Automated end-to-end deep learning framework for classification and tumor localization from native non-stained pathology images", Proc. SPIE 11596, Medical Imaging 2021: Image Processing, 115960A (15 February 2021); https://doi.org/10.1117/12.2582303

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available