Abstract
Cardiovascular image registration is an essential approach to combine the advantages of preoperative 3D computed tomography angiograph (CTA) images and intraoperative 2D X-ray/ digital subtraction angiography (DSA) images together in minimally invasive vascular interventional surgery (MIVI). Recent studies have shown that convolutional neural network (CNN) regression model can be used to register these two modality vascular images with fast speed and satisfactory accuracy. Because of the large differences in the vascular architecture of different patients, a CNN regression model trained on one patient often cannot be applied to another. To overcome this challenge, we proposed a transfer learning based CNN regression model which can be transferred from one patient to another with only tiny modifications. The registration error of our proposed method can reach less than 1 mm or 1\(^ \circ \) when a trained model is fine-tuned with only 200 images of the target patient in about 150 s. We tested the transfer ability of our method with images from various patients suffering different cardiovascular disease and confirm the effectiveness of our method. Deformation of cardiac vessels was not considered in this rigid registration model and non-rigid cardiovascular registration model will be developed in our future work to improve the registration accuracy of \(t_z\).
Supported by the National Natural Science Foundation of China (Grants No. 61533016, 61873010).
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Annegreet, V.O., Hakim, C.A., Vernooij, M.W., de Bruijne, M.: Convolutional neural networks for medical image analysis: full training or fine tuning? IEEE Trans. Med. Imaging 38(1), 213–224 (2019)
Cheplygina, V., de Bruijne, M., Pluim, J.P.W.: Not-so-supervised: a survey of semi-supervised, multi-instance, and transfer learning in medical image analysis. Med. Image Anal. 54, 1–24 (2018)
Cheplygina, V., Pino, I., Pedersen, J., Lynch, D., Sørensen, L., de Bruijne, M.: Transfer learning for multicenter classification of chronic obstructive pulmonary disease. IEEE J. Biomed. Health Inform. 22(5), 1486–1496 (2018)
Chou, C.R., Frederick, B., Mageras, G., Chang, S., Pizer, S.: 2D/3D image registration using regression learning. Comput. Vis. Image Underst. 117(9), 1095 (2013)
Guan, S., Meng, C., Xie, Y., Wang, Q., Sun, K., Wanga, T.: Deformable cardiovascular image registration via multi-channel convolutional neural network. IEEE Access 7, 17524–17534 (2019)
Hinton, G.E., Osindero, S., Teh, Y.W.: A fast learning algorithm for deep belief nets. Neural Comput. 18(7), 1527–1554 (2006)
Shin, H.C., Roth, H.R., Gao, M., Lu, L., Xu, Z.: Deep convolutional neural networks for computer-aided detection: Cnn architectures, dataset characteristics and transfer learning. IEEE Trans. Med. Imaging 35(5), 1285–1298 (2016)
Hu, Y., Modat, M., Gibson, E., et al.: Label-driven weakly-supervised learning for multimodal deformable image registration. In: IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018), pp. 1070–1074. IEEE, Washington, DC (2018)
Jia, Y., Shelhamer, E., Donahue, J., et al.: Caffe: convolutional architecture for fast feature embedding. In: Proceedings of the 22nd ACM International Conference on Multimedia, pp. 675–678. ACM, Florida (2014)
Ketcha, M.D., et al.: Multi-stage 3D–2D registration for correction of anatomical deformation in image-guided spine surgery. Phys. Med. Biol. 62(11), 4604 (2017)
Kraats, E.B.V.D., Penney, G.P., Tomazevic, D., Walsum, T.V., Niessen, W.J.: Standardized evaluation methodology for 2-D-3-D registration. IEEE Trans. Med. Imaging 24(9), 1177–1189 (2005)
Krizhevsky, A., Sutskever, I., Hinton, G.E.: ImageNet classification with deep convolutional neural networks. In: Advances in Neural Information Processing Systems, pp. 1097–1105. MIT Press, Lake Tahoe (2012)
Markelj, P., Tomazevic, D., Likar, B., Pernus, F.: A review of 3D/2D registration methods for image-guided interventions. Med. Image Anal. 16(3), 642–661 (2012)
Miao, S., Wang, Z., Liao, R.: A CNN regression approach for real-time 2D/3D registration. IEEE Trans. Med. Imaging 35(5), 1352–1363 (2016)
Miao, S., Wang, Z.J., Liao, R.: Real-time 2D/3D registration via CNN regression. Optoelectron. Adv. Mater.-Rapid Commun. 4(3), 636–648 (2015)
Nima, T., et al.: Convolutional neural networks for medical image analysis: full training or fine tuning? IEEE Trans. Med. Imaging 35(5), 1299–1312 (2016)
Swati, Z., et al.: Content-based brain tumor retrieval for MR images using transfer learning. IEEE Access 7, 17809–17822 (2019)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Guan, S., Meng, C., Sun, K., Wang, T. (2019). Transfer Learning for Rigid 2D/3D Cardiovascular Images Registration. In: Lin, Z., et al. Pattern Recognition and Computer Vision. PRCV 2019. Lecture Notes in Computer Science(), vol 11858. Springer, Cham. https://doi.org/10.1007/978-3-030-31723-2_32
Download citation
DOI: https://doi.org/10.1007/978-3-030-31723-2_32
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-31722-5
Online ISBN: 978-3-030-31723-2
eBook Packages: Computer ScienceComputer Science (R0)