Abstract
The hippocampus plays a critical role in the human brain, which is mainly responsible for memory and other functions. Accurate and effective hippocampal registration significantly impacts all kinds of hippocampus-related analysis, particularly in the widely-used multi-atlas hippocampus segmentation and the associated clinical decision. However, the existing registration methods suffer from high computational cost and insufficient registration performance. A 3D unsupervised U-Net registration model HPCReg-Net was proposed under a coarse-fine registration strategy in this study, which combined dilated convolution and residual attention module. Specifically, in the coarse registration stage, a new gap-filling mechanism was designed to solve the semantic gap problem in U-Net, and a novel residual attention module was devised to characterize hippocampal deformation. In the fine registration stage, a cascaded dilated convolution module was adopted to capture the considerable deformation and position information of voxels from each pair of images. The experimental results based on ADNI data sets show that our method can improve hippocampal registration greatly in both computational efficiency and registration precision.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Zheng, Q., et al.: Integrating semi-supervised label propagation and random forests for multi-atlas based hippocampus segmentation. In: 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018), pp. 154–157. IEEE.(2018)
Zheng, Q., et al.: Integrating semi-supervised and supervised learning methods for label fusion in multi-atlas based image segmentation. Front. Neuroinf. 12, 69 (2018)
Aljabar, P., et al.: Multi-atlas based segmentation of brain images: atlas selection and its effect on accuracy. Neuroimage 46(3), 726–738 (2009)
Holden, M.: A review of geometric transformations for nonrigid body registration. IEEE Trans. Med. Imaging 27(1), 111–128 (2007)
Balakrishnan, G., et al.: VoxelMorph: a learning framework for deformable medical image registration. IEEE Trans. Med. Imaging 38(8), 1788–1800 (2019)
Li, B., et al.: Longitudinal diffusion MRI analysis using Segis-Net: a single-step deep-learning framework for simultaneous segmentation and registration. NeuroImage 235, 118004 (2021)
Zhang, L., et al.: Non-rigid joint registration for multi-contrast MR of infant brain based on the unsupervised deep regression network. In: 2019 12th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI), pp. 1–5. IEEE.(2019)
Chen, L.-C., Zhu, Y., Papandreou, G., Schroff, F., Adam, H.: Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation. In: Ferrari, V., Hebert, M., Sminchisescu, C., Weiss, Y. (eds.) ECCV 2018. LNCS, vol. 11211, pp. 833–851. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-01234-2_49
Wang, F., et al.: Residual attention network for image classification. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3156–3164 (2017)
Jaderberg, M., et al.: Spatial transformer networks. Adv. Neural. Inf. Process. Syst. 28, 2017–2025 (2015)
Ronneberger, O., et al.: U-net: convolutional networks for biomedical image segmentation. In: International Conference on Medical image computing and computer-assisted intervention, pp. 234–241. Springer (2015)
Fan, J., et al.: BIRNet: brain image registration using dual-supervised fully convolutional networks. Med. Image Anal. 54, 193–206 (2019)
Ibtehaz, N., et al.: MultiResUNet: rethinking the U-Net architecture for multimodal biomedical image segmentation. Neural Netw. 121, 74–87 (2020)
Jin, Q., et al.: RA-UNet: a hybrid deep attention-aware network to extract liver and tumor in CT scans. Front. Bioeng. Biotechnol. 8, 1471 (2020)
Boccardi, M., et al.: Training labels for hippocampal segmentation based on the EADC-ADNI harmonized hippocampal protocol. Alzheimer’s Dement. 11(2), 175–183 (2015)
Avants, B.B., et al.: A reproducible evaluation of ANTs similarity metric performance in brain image registration. Neuroimage 54(3), 2033–2044 (2011)
Hao, Y., et al.: Local label learning (LLL) for subcortical structure segmentation: application to hippocampus segmentation. Hum. Brain Mapp. 35(6), 2674–2697 (2014)
Avants, B.B., et al.: Symmetric diffeomorphic image registration with cross-correlation: evaluating automated labeling of elderly and neurodegenerative brain. Med. Image Anal. 12(1), 26–41 (2008)
Paszke, A., et al.: Automatic differentiation in pytorch (2017)
Coupé, P., et al.: Patch-based segmentation using expert priors: Application to hippocampus and ventricle segmentation. Neuroimage 54(2), 940–954 (2011)
Hao, Y., et al.: Local label learning (L3) for multi-atlas based segmentation. In: Medical Imaging 2012: Image Processing. pp. 83142E. International Society for Optics and Photonics (2012)
Rohlfing, T., et al.: Evaluation of atlas selection strategies for atlas-based image segmentation with application to confocal microscopy images of bee brains. Neuroimage 21(4), 1428–1442 (2004)
Acknowledgements
This work was supported by National Natural Science Foundation of China (61802330, 61802331, 61801415), Natural Science Foundation of Shandong Province (ZR2018BF008).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Yu, H. et al. (2021). HPCReg-Net: Unsupervised U-Net Integrating Dilated Convolution and Residual Attention for Hippocampus Registration. In: Ma, H., et al. Pattern Recognition and Computer Vision. PRCV 2021. Lecture Notes in Computer Science(), vol 13021. Springer, Cham. https://doi.org/10.1007/978-3-030-88010-1_38
Download citation
DOI: https://doi.org/10.1007/978-3-030-88010-1_38
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-88009-5
Online ISBN: 978-3-030-88010-1
eBook Packages: Computer ScienceComputer Science (R0)