Deep learning for tissue microarray image-based outcome prediction in patients with colorectal cancer

Dmitrii Bychkov; Riku Turkki; Caj Haglund; Nina Linder M.D.; Johan Lundin M.D.

doi:10.1117/12.2217072

23 March 2016 Deep learning for tissue microarray image-based outcome prediction in patients with colorectal cancer

Dmitrii Bychkov, Riku Turkki, Caj Haglund, Nina Linder M.D., Johan Lundin M.D.

Proceedings Volume 9791, Medical Imaging 2016: Digital Pathology; 979115 (2016) https://doi.org/10.1117/12.2217072
Event: SPIE Medical Imaging, 2016, San Diego, California, United States

Abstract

Recent advances in computer vision enable increasingly accurate automated pattern classification. In the current study we evaluate whether a convolutional neural network (CNN) can be trained to predict disease outcome in patients with colorectal cancer based on images of tumor tissue microarray samples. We compare the prognostic accuracy of CNN features extracted from the whole, unsegmented tissue microarray spot image, with that of CNN features extracted from the epithelial and non-epithelial compartments, respectively. The prognostic accuracy of visually assessed histologic grade is used as a reference. The image data set consists of digitized hematoxylin-eosin (H and E) stained tissue microarray samples obtained from 180 patients with colorectal cancer. The patient samples represent a variety of histological grades, have data available on a series of clinicopathological variables including long-term outcome and ground truth annotations performed by experts. The CNN features extracted from images of the epithelial tissue compartment significantly predicted outcome (hazard ratio (HR) 2.08; CI95% 1.04-4.16; area under the curve (AUC) 0.66) in a test set of 60 patients, as compared to the CNN features extracted from unsegmented images (HR 1.67; CI95% 0.84-3.31, AUC 0.57) and visually assessed histologic grade (HR 1.96; CI95% 0.99-3.88, AUC 0.61). As a conclusion, a deep-learning classifier can be trained to predict outcome of colorectal cancer based on images of H and E stained tissue microarray samples and the CNN features extracted from the epithelial compartment only resulted in a prognostic discrimination comparable to that of visually determined histologic grade.

Citation Download Citation

Dmitrii Bychkov, Riku Turkki, Caj Haglund, Nina Linder M.D., and Johan Lundin M.D. "Deep learning for tissue microarray image-based outcome prediction in patients with colorectal cancer ", Proc. SPIE 9791, Medical Imaging 2016: Digital Pathology, 979115 (23 March 2016); https://doi.org/10.1117/12.2217072

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available