Definition
The notation we shall use is defined in Table 1, and some core definitions are presented in Table 2. In each of the examples presented in Fig. 1, we are simply asserting that
which arises by a straightforward application of the product rule (Definition 1), along with the fact that X A and X B are conditionally independent, given X C (Definition 3). The key observation we make is that while the left-hand side of (Eq. 1) is a function of three variables, its conditional independence properties allow it to be factored into functions of two variables.
References
Aji, S. M., & McEliece, R. J. (2000). The generalized distributive law. IEEE transactions on information theory, 46(2): 325-343.
Amir, E. (2001). Efficient approximation for triangulation of minimum treewidth. In Proceedings of the 17th conference on uncertainty in artificial intelligence (pp. 7–15). San Francisco: Morgan Kaufmann.
Cowell, R. G., Dawid, P. A., Lauritzen, S. L., & Spiegelhalter, D. J. (2003). Probabilistic networks and expert systems. Berlin: Springer.
Edwards, D. (2000). Introduction to graphical modelling. New York: Springer.
Geman, S., & Geman, D. (1984). Stochastic relaxation, Gibbs distributions and the bayesian restoration of images. In IEEE transactions on pattern analysis and machine intelligence, 6, 721–741.
Getoor, L., & Taskar, B. (Eds.). (2007). An introduction to statistical relational learning. Cambridge, MA: MIT Press.
Ihler, A. T., Fischer III, J. W., & Willsky, A. S. (2005). Loopy belief propagation: Convergence and effects of message errors. Journal of Machine Learning Research, 6, 905–936.
Jensen, F. V. (2001). Bayesian networks and decision graphs. Berlin: Springer.
Jordan, M. (Ed.). (1998). Learning in graphical models. Cambridge, MA: MIT Press.
Koller, D., & Friedman, N. (2009). Probabilistic graphical models: Principles and techniques. Cambridge, MA: MIT Press.
Kschischang, F. R., Frey, B. J., & Loeliger, H. A. (2001). Factor graphs and the sum-product algorithm. IEEE transactions on information theory, 47(2), 498–519.
Lauritzen, S. L. (1996). Graphical models. Oxford: Oxford University Press.
Lauritzen, S. L., & Spiegelhalter, D. J. (1988). Local computations with probabilities on graphical structures and their application to expert systems. Journal of the Royal Statistical Society, Series B, 50, 157–224.
Murphy, K. (1998). A brief introduction to graphical models and Bayesian networks. San Francisco: Morgan Kaufmann.
Pearl, J. (1988). Probabilistic reasoning in intelligent systems: Networks of plausible inference. San Francisco: Morgan Kaufmann.
Pearl, J. (2000). Causality. Cambridge: Cambridge University Press.
Roweis, S., & Ghahramani, Z. (1997). A unifying review of linear Gaussian models. Neural Computation, 11, 305–345.
Smyth, P. (1998). Belief networks, hidden Markov models, and Markov random fields: A unifying view. Pattern Recognition Letters, 18, 1261–1268.
Wainwright, M. J., & Jordan, M. I. (2008). Graphical models, exponential families, and variational inference. Foundations and Trends in Machine Learning, 1, 1–305.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer Science+Business Media, LLC
About this entry
Cite this entry
McAuley, J., Caetano, T., Buntine, W. (2011). Graphical Models. In: Sammut, C., Webb, G.I. (eds) Encyclopedia of Machine Learning. Springer, Boston, MA. https://doi.org/10.1007/978-0-387-30164-8_351
Download citation
DOI: https://doi.org/10.1007/978-0-387-30164-8_351
Publisher Name: Springer, Boston, MA
Print ISBN: 978-0-387-30768-8
Online ISBN: 978-0-387-30164-8
eBook Packages: Computer ScienceReference Module Computer Science and Engineering