Abstract
Deformable image registration is an important tool in medical image analysis. In the case of lung four dimensions computed tomography (4D CT) registration, there is a major problem that the traditional image registration methods based on continuous optimization are easy to fall into the local optimal solution and lead to serious misregistration. In this study, we proposed a novel image registration method based on high-order Markov Random Fields (MRF). By analyzing the effect of the deformation field constraint of the potential functions with different order cliques in MRF model, energy functions with high-order cliques form are designed separately for 2D and 3D images to preserve the deformation field topology. For the complexity of the designed energy function with high-order cliques form, the Markov Chain Monte Carlo (MCMC) algorithm is used to solve the optimization problem of the designed energy function. To address the high computational requirements in lung 4D CT image registration, a multi-level processing strategy is adopted to reduce the space complexity of the proposed registration method and promote the computational efficiency. Compared with some other registration methods, the proposed method achieved the optimal average target registration error (TRE) of 0.93 mm on public DIR-lab dataset with 4D CT images, which indicates its great potential in lung motion modeling and image guided radiotherapy.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Kappes, J.H., et al.: A comparative study of modern inference techniques for structured discrete energy minimization problems. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 155–184. IEEE (2015)
Li, S.Z.: Markov Random Field Modeling in Image Analysis. Springer-Verlag, Tokyo (2001). https://doi.org/10.1007/978-4-431-67044-5
Wainwright, M.J., Jaakkola, T.S., Willsky, A.S.: Map estimation via agreement on trees: message-passing and linear programming. IEEE Trans. Inform. Theory 51(11), 3697–3717 (2005)
Kolmogorov, V.: Convergent tree-reweighted message passing for energy minimization. IEEE Trans. Pattern Anal. Mach. Intell. 28(10), 1568–1583 (2006)
Komodakis, N., Tziritas, G.: Approximate labeling via graph cuts based on linear programming. IEEE Trans. Pattern Anal. Mach. Intell. 29(8), 1436–1453 (2007)
Rother, C., Kolmogorov, V., Lempitsky, V., Szummer, M.: Optimizing binary MRFs via extended roof duality. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1784–1791. IEEE (2007)
Cordero-Grande, L., Vegas-Sanchez-Ferrero, G., Casaseca-de-la-Higuera, P., Alberola-Lopez, C.: A Markov random field approach for topology-preserving registration: application to object-based tomographic image interpolation. IEEE Trans. Image Process. 21(4), 2047–2061 (2012)
Han, X.: Feature-constrained nonlinear registration of lung CT images. In: Medical Image Analysis for the Clinic, pp. 137–146 (2010)
Lugo, W., Seguel, J.: A fast and accurate parallel algorithm for genome mapping assembly aimed at massively parallel sequencers. In: 6th ACM Conference on Bioinformatics, Computational Biology, and Health Informatics, pp. 574–581. Association for Computing Machinery, Inc, Atlanta (2015)
Heinrich, M.P., et al.: MIND: modality independent neighborhood descriptor for multi-modal deformable registration. Med. Image Anal. 16(7), 1423–1435 (2012)
Vishnevskiy, V., Gass, T., Szekely, G., Tanner, C., Goksel, O.: Isotropic total variation regularization of displacements in parametric image registration. IEEE Trans. Med. Imaging 36(2), 385–395 (2017)
Ruehaak, J., et al.: Estimation of large motion in lung CT by integrating regularized keypoint correspondences into dense deformable registration. IEEE Trans. Med. Imaging 36(8), 1746–1757 (2017)
Eppenhof, K.A.J., Pluim, J.P.W.: Pulmonary CT registration through supervised learning with convolutional neural networks. IEEE Trans. Med. Imaging 38, 1097–1105 (2018)
Sun, X., Pitsianis, N.P., Bientinesi, P.: Fast computation of local correlation coefficients. In: Mathematics for Signal & Information Processing. International Society for Optics and Photonics (2008)
Glocker, B., Komodakis, N., Tziritas, G.: Dense image registration through MRFs and efficient linear programming. Med. Image Anal. 12(6), 731–741 (2008)
Karacali, B., Davatzikos, C.: Estimating topology preserving and smooth displacement fields. IEEE Trans. Med. Imaging 23(7), 868–880 (2004)
Heinrich, M.P., Jenkinson, M., Brady, M., Schnabel, J.A.: MRF-based deformable registration and ventilation estimation of lung CT. IEEE Trans. Med. Imaging 32(7), 1239–1248 (2013)
Koenig, L., Ruehaak, J.: A fast and accurate parallel algorithm for non-linear image registration using normalized gradient fields. In: IEEE 11th International Symposium on Biomedical Imaging, pp. 580–583. IEEE (2014)
Hermann, S., Werner, R.: High accuracy optical flow for 3D medical image registration using the census cost function. In: Klette, R., Rivera, M., Satoh, S. (eds.) PSIVT 2013. LNCS, vol. 8333, pp. 23–35. Springer, Heidelberg (2014). https://doi.org/10.1007/978-3-642-53842-1_3
Ruehaak, J., Heldmann, S., Kipshagen, T., Fischer, B.: Highly accurate fast lung CT registration. In: Medical Imaging 2013: Image Processing, SPIE, Lake Buena Vista, pp. 86690Y-1–86690Y-9 (2013)
Polzin, T., et al.: Combining automatic landmark detection and variational methods for lung CT registration. In: International Workshop on Pulmonary Image Analysis (2013)
Hermann, S.: Evaluation of scan-line optimization for 3D medical image registration. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 3073–3080. IEEE (2014)
Vishnevskiy, V., Gass, T., Szekely, G., Goksel, O.: Total variation regularization of displacements in parametric image registration. In: Yoshida, H., Näppi, J., Saini, S. (eds.) ABD-MICCAI 2014. LNCS, vol. 8676, pp. 211–220. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-13692-9_20
Acknowledgements
This paper is supported by the Fundamental Research Funds for the Central Universities (China), the National Natural Science Foundation of China (Nos. 81671848 and 81371635) and Shandong Key Research and Development Program (2019GGX101022).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Xue, P., Dong, E., Ji, H. (2020). High-Order Markov Random Field Based Image Registration for Pulmonary CT. In: Zheng, Y., Williams, B., Chen, K. (eds) Medical Image Understanding and Analysis. MIUA 2019. Communications in Computer and Information Science, vol 1065. Springer, Cham. https://doi.org/10.1007/978-3-030-39343-4_29
Download citation
DOI: https://doi.org/10.1007/978-3-030-39343-4_29
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-39342-7
Online ISBN: 978-3-030-39343-4
eBook Packages: Computer ScienceComputer Science (R0)