Supervised local error estimation for nonlinear image registration using convolutional neural networks

Koen A. J. Eppenhof; Josien P. W. Pluim

doi:10.1117/12.2253859

24 February 2017 Supervised local error estimation for nonlinear image registration using convolutional neural networks

Koen A. J. Eppenhof, Josien P. W. Pluim

Proceedings Volume 10133, Medical Imaging 2017: Image Processing; 101331U (2017) https://doi.org/10.1117/12.2253859
Event: SPIE Medical Imaging, 2017, Orlando, Florida, United States

Abstract

Error estimation in medical image registration is valuable when validating, comparing, or combining registration methods. To validate a nonlinear image registration method, ideally the registration error should be known for the entire image domain. We propose a supervised method for the estimation of a registration error map for nonlinear image registration. The method is based on a convolutional neural network that estimates the norm of the residual deformation from patches around each pixel in two registered images. This norm is interpreted as the registration error, and is defined for every pixel in the image domain. The network is trained using a set of artificially deformed images. Each training example is a pair of images: the original image, and a random deformation of that image. No manually labeled ground truth error is required. At test time, only the two registered images are required as input. We train and validate the network on registrations in a set of 2D digital subtraction angiography sequences, such that errors up to eight pixels can be estimated. We show that for this range of errors the convolutional network is able to learn the registration error in pairs of 2D registered images at subpixel precision. Finally, we present a proof of principle for the extension to 3D registration problems in chest CTs, showing that the method has the potential to estimate errors in 3D registration problems.

Citation Download Citation

Koen A. J. Eppenhof and Josien P. W. Pluim "Supervised local error estimation for nonlinear image registration using convolutional neural networks", Proc. SPIE 10133, Medical Imaging 2017: Image Processing, 101331U (24 February 2017); https://doi.org/10.1117/12.2253859

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available