Abstract
Purpose
Nonrigid registration of multimodal medical images remains a challenge in image-guided interventions. A common approach is to use mutual information (MI), which is robust to the intensity variations across modalities. However, primarily based on intensity distribution, MI does not take into account of underlying spatial and structural information of the images, which might lead to local optimization. To address such a challenge, this paper proposes a two-stage multimodal nonrigid registration scheme with joint structural information and local entropy.
Methods
In our two-stage multimodal nonrigid registration scheme, both the reference image and floating image are firstly converted to a common space. A unified representation in the common space for the images is constructed by fusing the structure tensor (ST) trace with the local entropy (LE). Through the representation that reflects its geometry uniformly across modalities, the complicated deformation field is estimated using \(L_{1}\) or \(L_{2}\) distance.
Results
We compared our approach to four other methods: (1) the method using LE, (2) the method using ST, (3) the method using spatially weighted LE and (4) the conventional MI-based method. Quantitative evaluations on 80 multimodal image pairs of different organs including 50 pairs of MR images with artificial deformations, 20 pairs of medical brain MR images and 10 pairs of breast images showed that our proposed method outperformed the comparison methods. Student’s t test demonstrated that our method achieved statistically significant improvement on registration accuracy.
Conclusion
The two-stage registration with joint ST and LE outperformed the conventional MI-based method for multimodal images. Both the ST and the LE contributed to the improved registration accuracy.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Sotiras A, Davatzikos C, Paragios N (2013) Deformable medical image registration: a survey. IEEE Trans Med Imaging 32(7):1153–1190
Markelj P, Tomaževič D, Likar B, Pernuš F (2012) A review of 3D/2D registration methods for image-guided interventions. Med Image Anal 16(3):642–661
Roujol S, Benois-Pineau J, de Senneville BD, Ries M, Quesson B, Moonen CTW (2012) Robust real-time-constrained estimation of respiratory motion for interventional MRI on mobile organs. IEEE Trans Inf Technol Biomed 16(3):365–374
Otake Y, Armand M, Armiger RS, Kutzer MD, Basafa E, Kazanzides P, Taylor RH (2012) Intraoperative image-based multiview 2D/3D registration for image-guided orthopaedic surgery: incorporation of fiducial-based C-arm tracking and GPU-acceleration. IEEE Trans Med Imaging 31(4):948–962
Ferrant M, Nabavi A, Macq B, Black P, Jolesz F, Kikinis R, Warfield S (2012) Serial registration of intraoperative MR images of the brain. Med Image Anal 6(4):337–360
Wang X, Eberl S, Fulham M, Som S, Feng DD (2008) Data registration and fusion. In: Feng DD (ed) Biomedical information technology. Elsevier, Amsterdam, pp 187–210
Lu X, Zhao Y, Zhang B, Wu J, Li N, Jia W (2013) A non-rigid cardiac image registration method based on an optical flow model. Opt Int J Light Electron Opt 124(20):4266–4273
Lombaert H, Grady L, Pennec X, Ayache N, Cheriet F (2014) Spectral log-demons: diffeomorphic image registration with very large deformations. Int J Comput Vis 107(3):254–271
Zhang J, Wang J, Wang X, Feng D (2014) The adaptive FEM elastic model for medical image registration. Phys Med Biol 59:97–118
Zhuang X, Arridge S, Hawkes DJ, Ourselin S (2011) A nonrigid registration framework using spatially encoded mutual information and free-form deformations. IEEE Trans Med Imaging 30(10):1819–1828
Wachinger C, Navab N (2012) Entropy and Laplacian images: structural representations for multi-modal registration. Med Image Anal 16(1):1–17
Budde MD, Frank JA (2012) Examining brain microstructure using structure tensor analysis of histological sections. Neuroimage 63(1):1–10
Pluim JPW, Maintz JBA, Viergever MA (2000) Image registration by maximization of combined mutual information and gradient information. Med Image Comput Comput-Assist Interv MICCAI 2000 1935:452–461
Bay H, Ess A, Tuytelaars T, Gool LV (2008) Speeded-up robust features (SURF). Comput Vis Image Underst 110(3):346–359
Yang L, Guo BL, Ni W (2008) Multimodality medical image fusion based on multiscale geometric analysis of contourlet transform. Neurocomputing 72(1–3):203–211
Zhang GY, Wittek A, Joldes GR, Jin X, Miller K (2014) A three-dimensional nonlinear meshfree algorithm for simulating mechanical responses of soft tissue. Eng Anal Bound Elem 42: 60–66
MICCAI (2012) Challenge on multimodal brain tumor segmentation. http://www.imm.dtu.dk/projects/BRATS2012. Accessed 20 Dec 2014
Bullitt E, Zeng D, Gerig G, Aylward S, Joshi S, Smith JK, Lin W, Ewend MG (2005) Vessel tortuosity and brain tumor malignancy: a blinded study. Acad Radiol 12:1232–1240
Marami B, Sirouspour S, Capson DW (2011) Model-based deformable registration of preoperative 3D to intraoperative low-resolution 3D and 2D sequences of MR images. In: Fichtinger G, Martel A, Peters T (eds) Medical Image Computing Computer-Assisted Intervention—MICCAI 2011, Vol 6891. Springer, Berlin, pp 460–467
Acknowledgments
This work is supported by National Natural Science Foundation of China, No. 60871086 and Natural Science Foundation of Jiangsu Province China, No. BK2008159.
Conflict of interest
None.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Zhang, J., Wang, J., Wang, X. et al. Multimodal image registration with joint structure tensor and local entropy. Int J CARS 10, 1765–1775 (2015). https://doi.org/10.1007/s11548-015-1219-9
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11548-015-1219-9