Understanding CNN based anthropomorphic model observer using classification images

Iris Lorente; Craig K. Abbey; Jovan G. Brankov

doi:10.1117/12.2581121

15 February 2021 Understanding CNN based anthropomorphic model observer using classification images

Iris Lorente, Craig K. Abbey, Jovan G. Brankov

Proceedings Volume 11599, Medical Imaging 2021: Image Perception, Observer Performance, and Technology Assessment; 115990C (2021) https://doi.org/10.1117/12.2581121
Event: SPIE Medical Imaging, 2021, Online Only

Abstract

It is widely accepted that medical imaging reconstruction strategies should be optimized by maximizing the chance of a radiologist making a correct diagnostic. This implies organizing costly sessions with doctors to evaluate the images and provide feedback. Model Observers (MO) are algorithms designed to act as human surrogates in evaluating and providing feedback as a measure of diagnostic accuracy, and should be tuned to make the same diagnostic as the human’s, regardless of the correctness. In this work, we use a previously trained and optimized Convolutional Neural Network (CNN) based MO to construct classification images that show how the diagnostic information is accessed by the MO in a form of a perceptual filter. A single MO was trained for a forced-localization task in simulated data with three different power-law noise backgrounds representing different levels of background variability. The classification images are computed in the same way as they would for a human observer using 10,000 simulated images with a defect. The frequency profile of the MO classification images show that frequency weights appear band-pass in nature and highly correlated to the frequency weights from the human observer classification images.

Conference Presentation

Citation Download Citation

Iris Lorente, Craig K. Abbey, and Jovan G. Brankov "Understanding CNN based anthropomorphic model observer using classification images", Proc. SPIE 11599, Medical Imaging 2021: Image Perception, Observer Performance, and Technology Assessment, 115990C (15 February 2021); https://doi.org/10.1117/12.2581121

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available