Deep learning analysis on raw image data: case study on holographic cell analysis

Gal Gozes; Shani Ben Baruch; Noa Rotman-Nativ; Darina Roitshtain; Natan T. Shaked; Hayit Greenspan

doi:10.1117/12.2582101

15 February 2021 Deep learning analysis on raw image data: case study on holographic cell analysis

Gal Gozes, Shani Ben Baruch, Noa Rotman-Nativ, Darina Roitshtain, Natan T. Shaked, Hayit Greenspan

Proceedings Volume 11597, Medical Imaging 2021: Computer-Aided Diagnosis; 1159723 (2021) https://doi.org/10.1117/12.2582101
Event: SPIE Medical Imaging, 2021, Online Only

Conference Poster

Abstract

With the advances in deep learning analysis a question arises – if for a robust network learning cycle, the shift between raw data and image-based data, is of importance. In the current work, we start exploring this topic by focusing on the following case study: categorizing cancer cells from holographic images. The problem in the categorization process is the time consumption of the transformation from off-axis image holograms to OPD maps. While there have been attempts for fast transformation, they still take non-negligible time. We propose a novel approach for fast classification that skips the pre-processing of creating OPD maps and directly uses the raw data of holographic images. Our dataset contains two separate image acquisitions of primary cancer cells (SW480) and metastatic cancer cells (SW620) of colorectal adenocarcinoma imaged during flow. We extracted the OPD maps of those cells and used them to train and evaluate a ResNet model to create baseline results. Our convolutional neural network (CNN) model is based on Y-Net approach: during training synthetic OPD images are created from input holograms, using the real OPD maps while simultaneously classifying the cells. During inference time only the classification branch operates to further reduce running time. This approach saves computational time by over 90%.

Conference Presentation

Citation Download Citation

Gal Gozes, Shani Ben Baruch, Noa Rotman-Nativ, Darina Roitshtain, Natan T. Shaked, and Hayit Greenspan "Deep learning analysis on raw image data: case study on holographic cell analysis", Proc. SPIE 11597, Medical Imaging 2021: Computer-Aided Diagnosis, 1159723 (15 February 2021); https://doi.org/10.1117/12.2582101

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available