Abstract
Image segmentations based on maximum likelihood (ML) or maximum a posteriori (MAP) analyses of object textures usually assume parametric models (e.g., Gaussian) for distributions of these features. For real images, parameter accuracy and model stationarity may be elusive, so that model-free inference methods ought to have an advantage over those that are model-dependent. Functions of the relative entropy (RE) from information theory can produce minimum error, model-free inferences, and can detect the boundary of an image object by maximizing the RE between the pixel distributions inside and outside a flexible curve contour. A generalization of the RE–the Jensen-Rényi divergence (JRD)–computes optimal n-way decisions and can contour multiple objects in an image simultaneously. Seed regions expand naturally and multiple contours tend not to overlap. We apply these functions to contour patient anatomy in X-ray computed tomography (CT) for radiotherapy treatment planning.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Collignon, A., Vandermeulen, D., et al.: Automated multimodality medical image registration using information theory. In: Ayache, N. (ed.) CVRMed 1995. LNCS, vol. 905, pp. 195–204. Springer, Heidelberg (1995)
Cover, T.M., Thomas, J.A.: Elements of Information Theory. Wiley-Interscience, New York (1991)
Devroye, L., Gyorfi, L., Lugosi, G.: A Probabilistic Theory of Pattern Recognition. Springer, New York (1996)
Duda, R.O., Hart, P.E., Stork, D.G.: Pattern Classification, 2nd edn. Wiley- Interscience, New York (2001)
Fukunaga, K.: Introduction to Statistical Pattern Recognition. Academic Press, New York (1990)
Garcia, J.A., Fdez-Valdivia, J., Fdez-Vidal, X., Rodriguez-Sanchez, R.: Information theoretic measure for visual target distinctness. IEEE Transactions on Pattern Analysis and Machine Intelligence 23, 362–383 (2001)
Giardina, C.R., Kuhl, F.P.: Accuracy of curve approximation by harmonically related vectors with the elliptical loci. Computer Graphics and Image Processing 21, 277–285 (1977)
Gokcay, E., Principe, J.C.: Information theoretic clustering. IEEE Transactions on Pattern Analysis and Machine Intelligence 24, 158–171 (2002)
Gomez-Lopera, J.F., Martinez-Aroza, J., Robles-Perez, A.M., Roman-Roldan, R.: An Analysis of Edge Detection by Using the Jensen-Shannon Divergence. Journal of Mathematical Imaging and Vision 13, 35–56 (2000)
He, Y., Ben Hamza, A., Krim, H.: An information divergence measure for ISAR image registration. In: IEEE Workshop on Statistical Signal Processing, Singapore, August 2001, pp. 130–133 (2001)
Kuhl, F.P., Giardina, C.R.: Elliptic Fourier features of a closed contour. Computer Graphics and Image Processing 18, 236–258 (1982)
Kullback, S., Leibler, R.A.: On information and sufficiency. Annals of Mathematical Statistics 22, 79–86 (1951)
Kullback, S.: Information Theory and Statistics. John Wiley and Sons, New York (1959)
Lin, J.: Divergence measures based on the Shannon entropy. IEEE Transactions on Information Theory 37, 145–151 (1991)
Meas, F., Collignon, A., Vandermeulen, D., Marchal, G., Seutens, P.: Multimodality image registration by maximization of mutual information. IEEE Transactions on Medical Imaging 16, 187–198 (1997)
Nelder, J.A., Mead, R.: A simplex method for function minimization. The Computer Journal 7, 308–313 (1965)
O’Sullivan, J.A., Blahut, R.E., Snyder, D.L.: Information-theoretic image formation. IEEE Transactions on Information Theory 44, 2094–2123 (1998)
Press, W.H., Teukolsky, S.A., Vettering, W.T., Flannery, B.P.: Numerical Recipes in C++, 2nd edn. Cambridge University Press, Cambridge (2002)
Principe, J.C., Xu, D., Fisher III, J.W.: Information-theoretic learning. In: Haykin, S. (ed.) Unsupervised Adaptive Filtering, pp. 265–319. Wiley, New York (1999)
Rényi, A.: On measures of entropy and information. In: Proceedings of the Fourth Berkeley Symposium on Mathematical Statistics and Probability, Berkeley, CA, June 20-July 30, vol. I, pp. 547–561 (1961)
Shannon, C.E.: A mathematical theory of communication. The Bell System Technical Journal 27, 379–423 (1948)
Snyder, D.L., Schultz, T.J., O’Sullivan, J.A.: Deblurring subject to nonnegativity constraints. IEEE Transactions on Signal Processing 40, 1143–1150 (1992)
Snyder, D.L., O’Sullivan, J.A., Whiting, B.R., Murphy, R.J., Benac, J., Cataldo, J.A., Politte, D.G., Williamson, J.F.: Deblurring subject to nonnegativity constraints when known functions are present with application to object-constrained computerized tomography. IEEE Transactions on Medical Imaging 20, 1009–1017 (2001)
Studholme, C., Hill, D.L.G., Hawkes, D.J.: Automated 3-D registration of MR and CT images of the head. Medical Image Analysis 1, 163–175 (1996)
Viola, P., Wells III, W.M.: Alignment by maximization of mutual information. In: Proc. of the Vth Int’l. Conf. on Computer Vision Cambridge, MA, June 16-23 (1995)
Wells III, W.M., Viola, P., Atsumi, H., Nakajima, S., Kikinis, R.: Multi-modal volume registration by maximization of mutual information. Medical Image Analysis 1, 33–51 (1996)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2003 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Hibbard, L.S. (2003). Region Segmentation Using Information Divergence Measures. In: Ellis, R.E., Peters, T.M. (eds) Medical Image Computing and Computer-Assisted Intervention - MICCAI 2003. MICCAI 2003. Lecture Notes in Computer Science, vol 2879. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-39903-2_68
Download citation
DOI: https://doi.org/10.1007/978-3-540-39903-2_68
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-20464-0
Online ISBN: 978-3-540-39903-2
eBook Packages: Springer Book Archive