Automatic cardiac landmark localization by a recurrent neural network

Mike van Zon; Mitko Veta; Shuo Li

doi:10.1117/12.2512048

15 March 2019 Automatic cardiac landmark localization by a recurrent neural network

Mike van Zon, Mitko Veta, Shuo Li

Proceedings Volume 10949, Medical Imaging 2019: Image Processing; 1094916 (2019) https://doi.org/10.1117/12.2512048
Event: SPIE Medical Imaging, 2019, San Diego, California, United States

Abstract

Localization of cardiac anatomical landmarks is an important step towards a more robust and accurate analysis of the heart. A fully automatic hybrid framework is proposed that detects key landmark locations in cardiac magnetic resonance (MR) images. Our method is trained and evaluated for the detection of mitral valve points on long-axis MRI and RV insert points in short-axis MRI. The framework incorporates four key modules for the localization of the landmark points. The first module crops the MR image around the heart using a convolutional neural network (CNN). The second module employs a U-Net to obtain an efficient feature representation of the cardiac image, as well as detect a preliminary location of the landmark points. In the third module, the feature representation of a cardiac image is processed with a Recurrent Neural Network (RNN). The RNN leverages either spatial or temporal dynamics from neighboring slides in time or space and obtains a second prediction for the landmark locations. In the last module the two predictions from the U-Net and RNN are combined and final locations for the landmarks are extracted. The framework is separately trained and evaluated for the localization of each landmark, it achieves a final average error of 2.87 mm for the mitral valve points and an average error of 3.64 mm for the right ventricular insert points. Our method shows that the use of a recurrent neural network for the modeling of additional temporal or spatial dependencies improves localization accuracy and achieves promising results.

Conference Presentation

Citation Download Citation

Mike van Zon, Mitko Veta, and Shuo Li "Automatic cardiac landmark localization by a recurrent neural network", Proc. SPIE 10949, Medical Imaging 2019: Image Processing, 1094916 (15 March 2019); https://doi.org/10.1117/12.2512048

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available