Application and generalizability of U-Net segmentation of immune cells in inflamed tissue

Rebecca Abraham; Madeleine S. Durkee; Margaret Veselits; Junting Ai; Jordan D. Fuhrman; Marcus R. Clark; Maryellen L. Giger

doi:10.1117/12.2581063

15 February 2021 Application and generalizability of U-Net segmentation of immune cells in inflamed tissue

Rebecca Abraham, Madeleine S. Durkee, Margaret Veselits, Junting Ai, Jordan D. Fuhrman, Marcus R. Clark, Maryellen L. Giger

Author Affiliations +

Proceedings Volume 11603, Medical Imaging 2021: Digital Pathology; 1160317 (2021) https://doi.org/10.1117/12.2581063
Event: SPIE Medical Imaging, 2021, Online Only

Conference Poster

Abstract

Several disease states, including cancer and autoimmunity, are characterized by the infiltration of large populations of immune cells into organ tissue. The degree and composition of these invading cells have been correlated with patient outcomes, suggesting that the intercellular interactions occurring in inflamed tissue play a role in pathology. Immunofluorescence staining paired with confocal microscopy produce detailed visualizations of these interactions. Applying computer vision and machine learning methods to the resulting images allows for robust quantification of immune infiltrates. We are developing an analytical pipeline to assess the immune environments of two distinct disease states: lupus nephritis and triple-negative breast cancer (TNBC). Biopsies of inflamed kidney tissue (lupus) and tumors (TNBC) were stained and imaged for panels of 20 markers using a strip-reprobe technique. This set of markers interrogates populations of T-cells, B-cells, and antigen presenting cells. To detect T cells, we first trained a U-Net to segment CD3+CD4+ T-cells in images of lupus biopsies and achieved an object-level precision of 0.855 and recall of 0.607 on an independent test set. We then evaluated the generalizability of this network to CD3+CD8+ T cells in lupus nephritis and CD3+CD4+ T cells in TNBC, and the extent to which fine-tuning the network improved performance for these cell types. We found that recall increased moderately with finetuning, while precision did not. Further work will focus on developing robust methods of segmenting a larger variety of T cell markers in both tissue contexts with high fidelity.

Conference Presentation

Citation Download Citation

Rebecca Abraham, Madeleine S. Durkee, Margaret Veselits, Junting Ai, Jordan D. Fuhrman, Marcus R. Clark, and Maryellen L. Giger "Application and generalizability of U-Net segmentation of immune cells in inflamed tissue", Proc. SPIE 11603, Medical Imaging 2021: Digital Pathology, 1160317 (15 February 2021); https://doi.org/10.1117/12.2581063

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available