Abstract
We propose a method to efficiently compute mutual information between high-dimensional distributions of image patches. This in turn is used to perform accurate registration of images captured under different modalities, while exploiting their local structure otherwise missed in traditional mutual information definition. We achieve this by organizing the space of image patches into orbits under the action of Euclidean transformations of the image plane, and estimating the modes of a distribution in such an orbit space using affinity propagation. This way, large collections of patches that are equivalent up to translations and rotations are mapped to the same representative, or “dictionary element”. We then show analytically that computing mutual information for a joint distribution in this space reduces to computing mutual information between the (scalar) label maps, and between the transformations mapping each patch into its closest dictionary element. We show that our approach improves registration performance compared with the state of the art in multimodal registration, using both synthetic and real images with quantitative ground truth.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Bardera, A., Feixas, M., Boada, I., Sbert, M.: High-dimensional normalized mutual information for image registration using random lines. In: Workshop on Biomedical Image Registration, pp. 264–271 (2006)
Bellman, R.: Adaptive Control Processes: A Guided Tour. Princeton University Press, Princeton (1961)
Chung, A.C.S., Wells III, W.M., Norbash, A., Grimson, W.E.L.: Multi-modal image registration by minimising kullback-leibler distance. In: Dohi, T., Kikinis, R. (eds.) MICCAI 2002. LNCS, vol. 2489, pp. 525–571. Springer, Heidelberg (2002)
Cocosco, C., Kollokian, V., Kwan, R., Evans, A.: Brainweb: online interface to a 3D MRI simulated brain database. In: Int. Conf. Functional Mapping of the Human Brain, p. S427 (1997)
Collignon, A., Maes, F., Delaere, D., Vandermeulen, D., Suetens, P., Marchal, G.: Automated multimodality medical image registration using information theory. In: Int. Conf. Information Processing in Medical Imaging, pp. 263–274 (1995)
Fodor, I.: A survey of dimension reduction techniques. Tech. rep., U.S. Department of Energy (2002)
Frey, B., Dueck, D.: Clutering by passing messages between data points. Science 315, 972–976 (2007)
Gray, R.: Vector Quantization. IEEE ASSP Magazine (1984)
Hermosillo, G., Faugeras, O.: Dense image matching with global and local statistical criteria: a variational approach. In: IEEE Conf. Computer Vision and Pattern Recognition, pp. 73–78 (2001)
Loeckx, D., Slagmolen, P., Maes, F., Vandermeulen, D., Suetens, P.: Nonrigid image registration using conditional mutual information. In: Karssemeijer, N., Lelieveldt, B. (eds.) IPMI 2007. LNCS, vol. 4584, pp. 725–737. Springer, Heidelberg (2007)
Lowe, D.: Distinctive image features from scale-invariant keypoints. Int. Journal of Computer Vision 60, 91–110 (2004)
Mellor, M., Brady, M.: Phase mutual information as a similarity measure for registration. Medical Image Analysis 9, 330–343 (2005)
Pluim, J., Maintz, J., Viegever, M.: Image registration by maximization of combined mutual information and gradient information. IEEE Trans. Medical Imaging 19, 809–814 (2000)
Pluim, J., Maintz, J., Viegever, M.: Mutual information based registration of medical images: a survey. IEEE Trans. Medical Imaging 22, 986–1004 (2003)
Roche, A., Malandain, G., Pennec, X., Ayache, N.: The correlation ratio as a new similarity measure for multimodal image registration. In: Wells, W.M., Colchester, A.C.F., Delp, S.L. (eds.) MICCAI 1998. LNCS, vol. 1496, pp. 1115–1124. Springer, Heidelberg (1998)
Rueckert, D., Clarkson, M., Hill, D., Hawkes, D.: Non-rigid registration using higher-order mutual information. In: Proc. SPIE Image Processing: Medical Imaging, pp. 438–447 (2000)
Russakoff, D.B., Tomasi, C., Rohlfing, T., Maurer Jr., C.R.: Image similarity using mutual information of regions. In: Pajdla, T., Matas, J(G.) (eds.) ECCV 2004. LNCS, vol. 3023, pp. 596–607. Springer, Heidelberg (2004)
Shotton, J., Winn, J.M., Rother, C., Criminisi, A.: textonBoost: Joint appearance, shape and context modeling for multi-class object recognition and segmentation. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006. LNCS, vol. 3951, pp. 1–15. Springer, Heidelberg (2006)
Studholme, C., Drapaca, C., Iordanova, B., Cardenas, V.: Deformation-based mapping of volume change from serial brain MRI in the presence of local tissue contrast change. IEEE Trans. Medical Imaging 25, 626–639 (2006)
Studholme, C., Hill, D., Hawkes, D.: Automated 3D registration of MR and CT images of the head. Medical Image Analysis 1, 163–175 (1996)
Toews, M., Wells III, W.M.: Bayesian registration via local image regions: Information, selection and marginalization. In: Prince, J.L., Pham, D.L., Myers, K.J. (eds.) IPMI 2009. LNCS, vol. 5636, pp. 435–446. Springer, Heidelberg (2009)
Varma, M., Zisserman, A.: Texture classification: are filter banks necessary. In: IEEE Conf. Computer Vision and Pattern Recognition, pp. II–691–8 (2003)
Viola, P., Wells, W.: Alignment by maximization of mutual information. Int. Journal of Computer Vision 24, 137–154 (1997)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Yi, Z., Soatto, S. (2011). Multimodal Registration via Spatial-Context Mutual Information. In: Székely, G., Hahn, H.K. (eds) Information Processing in Medical Imaging. IPMI 2011. Lecture Notes in Computer Science, vol 6801. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-22092-0_35
Download citation
DOI: https://doi.org/10.1007/978-3-642-22092-0_35
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-22091-3
Online ISBN: 978-3-642-22092-0
eBook Packages: Computer ScienceComputer Science (R0)