Interactive deep learning for explainable retinal disease classification

Mariana Vasquez; Suhev Shakya; Ian Wang; Jacob Furst; Roselyne Tchoua; Daniela Raicu

doi:10.1117/12.2611822

4 April 2022 Interactive deep learning for explainable retinal disease classification

Mariana Vasquez, Suhev Shakya, Ian Wang, Jacob Furst, Roselyne Tchoua, Daniela Raicu

Proceedings Volume 12032, Medical Imaging 2022: Image Processing; 120320M (2022) https://doi.org/10.1117/12.2611822
Event: SPIE Medical Imaging, 2022, San Diego, California, United States

Abstract

Age-related macular degeneration is the leading cause of vision deterioration among older adults. The selected treatment for this retinal disease is largely dependent on the later stage type (wet or geographic atrophy), meaning correct type classification is crucial to ensuring the best patient outcome. Previous studies have demonstrated high classification accuracy with medical images and used saliency maps to add explainability to opaque deep learning models. However, these explanations have revealed a tendency to make classification decisions based on irrelevant information. Our proposed deep learning model allows domain experts to correct model behavior during the training process through direct annotations of the regions of interest (ROIs) and integrates these annotations into the learning model. Our approach performs consistently with non-interactive classification accuracy of the retinal optical coherence tomography (OCT) scans. Filters are applied regionally to the original OCT image based on the annotations and Grad-CAM highlighted regions. Four interactive classification methods are introduced and compared against a non-interactive CNN with the same overall architecture. Three of the four methods selectively filter regions of the images with weighted pairs of enhancement and blurring filters. The fourth uses ROI maps to focus the attention of the feature maps on the expert annotated region(s). All overlap scores measuring the human and computer output agreement overperformed the non-interactive CNN baseline model with two of the interactive methods doubling the overlap score while another tripling the overlap score

Conference Presentation

Citation Download Citation

Mariana Vasquez, Suhev Shakya, Ian Wang, Jacob Furst, Roselyne Tchoua, and Daniela Raicu "Interactive deep learning for explainable retinal disease classification", Proc. SPIE 12032, Medical Imaging 2022: Image Processing, 120320M (4 April 2022); https://doi.org/10.1117/12.2611822

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available