Abstract
We propose an unsupervised deep learning method for serial electron microscopy (EM) image registration with fast speed and high accuracy. Current registration methods are time consuming in practice due to the iterative optimization procedure. We model the registration process as a parametric function in the form of convolutional neural networks, and optimize its parameters based on features extracted from training serial EM images in a training set. Given a new series of EM images, the deformation field of each serial image can be rapidly generated through the learned function. Specifically, we adopt a spatial transformer layer to reconstruct features in the subject image from the reference ones while constraining smoothness on the deformation field. Moreover, for the first time, we introduce the 3D convolution layer to learn the relationship between several adjacent images, which effectively reduces error accumulation in serial EM image registration. Experiments on two popular EM datasets, Cremi and FIB25, demonstrate our method can operate in an unprecedented speed while providing competitive registration accuracy compared with state-of-the-art methods, including learning-based ones.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsNotes
References
Arganda-Carreras, I., Sorzano, C.O.S., Marabini, R., Carazo, J.M., Ortiz-de-Solorzano, C., Kybic, J.: Consistent and elastic registration of histological sections using vector-spline regularization. In: Beichel, R.R., Sonka, M. (eds.) CVAMIA 2006. LNCS, vol. 4241, pp. 85–95. Springer, Heidelberg (2006). https://doi.org/10.1007/11889762_8
Balakrishnan, G., et al.: An unsupervised learning model for deformable medical image registration. In: CVPR (2018)
Cardona, A., et al.: TrakEM2 software for neural circuit reconstruction. PloS One 7(6), e38011 (2012)
Dosovitskiy, A., et al.: FlowNet: learning optical flow with convolutional networks. In: ICCV (2015)
Funke, J., et al.: Large scale image segmentation with structured loss based deep learning for connectome reconstruction. IEEE Trans. Pattern Anal. Mach. Intell. 41, 1669–1680 (2018)
Hinton, G.E., et al.: Reducing the dimensionality of data with neural networks. Science 313(5786), 504–507 (2006)
Jaderberg, M., et al.: Spatial transformer networks. In: NIPS (2015)
Januszewski, M., et al.: High-precision automated reconstruction of neurons with flood-filling networks. Nat. Methods 15(8), 605 (2018)
Saalfeld, S., et al.: Elastic volume reconstruction from series of ultra-thin microscopy sections. Nat. Methods 9(7), 717 (2012)
Takemura, S.Y., et al.: Synaptic circuits and their variations within different columns in the visual system of drosophila. Proc. Natl. Acad. Sci. 112(44), 13711–13716 (2015)
Yoo, I., Hildebrand, D.G.C., Tobin, W.F., Lee, W.-C.A., Jeong, W.-K.: ssEMnet: serial-section electron microscopy image registration using a spatial transformer network with learned features. In: Cardoso, M., et al. (eds.) DLMIA/ML-CDS -2017. LNCS, vol. 10553, pp. 249–257. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-67558-9_29
Zheng, Z., et al.: A complete electron microscopy volume of the brain of adult drosophila melanogaster. Cell 174(3), 730–743 (2018)
Acknowledgment
We acknowledge funding from Natural Science Foundation of China under Grant 91732304, Anhui Provincial Natural Science Foundation No.1908085QF256, and the Fundamental Research Funds for the Central Universities under Grant WK2380000002.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Zhou, S. et al. (2019). Fast and Accurate Electron Microscopy Image Registration with 3D Convolution. In: Shen, D., et al. Medical Image Computing and Computer Assisted Intervention – MICCAI 2019. MICCAI 2019. Lecture Notes in Computer Science(), vol 11764. Springer, Cham. https://doi.org/10.1007/978-3-030-32239-7_53
Download citation
DOI: https://doi.org/10.1007/978-3-030-32239-7_53
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-32238-0
Online ISBN: 978-3-030-32239-7
eBook Packages: Computer ScienceComputer Science (R0)