Skip to main content

Graphical Models

  • Reference work entry
Encyclopedia of Machine Learning

Definition

The notation we shall use is defined in Table 1, and some core definitions are presented in Table 2. In each of the examples presented in Fig. 1, we are simply asserting that

$$\underbrace{p({x}_{A},{x}_{B}\vert {x}_{C})}_{\text{ function of three variables}} =\underbrace{ p({x}_{A}\vert {x}_{C})p({x}_{B}\vert {x}_{C})}_{\text{ functions of two variables}},$$
(1)

which arises by a straightforward application of the product rule (Definition 1), along with the fact that X A and X B are conditionally independent, given X C (Definition 3). The key observation we make is that while the left-hand side of (Eq. 1) is a function of three variables, its conditional independence properties allow it to be factored into functions of two variables.

Graphical Models. Table 1 Notation

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Institutional subscriptions

References

  • Aji, S. M., & McEliece, R. J. (2000). The generalized distributive law. IEEE transactions on information theory, 46(2): 325-343.

    Article  MathSciNet  MATH  Google Scholar 

  • Amir, E. (2001). Efficient approximation for triangulation of minimum treewidth. In Proceedings of the 17th conference on uncertainty in artificial intelligence (pp. 7–15). San Francisco: Morgan Kaufmann.

    Google Scholar 

  • Cowell, R. G., Dawid, P. A., Lauritzen, S. L., & Spiegelhalter, D. J. (2003). Probabilistic networks and expert systems. Berlin: Springer.

    Google Scholar 

  • Edwards, D. (2000). Introduction to graphical modelling. New York: Springer.

    MATH  Google Scholar 

  • Geman, S., & Geman, D. (1984). Stochastic relaxation, Gibbs distributions and the bayesian restoration of images. In IEEE transactions on pattern analysis and machine intelligence, 6, 721–741.

    Google Scholar 

  • Getoor, L., & Taskar, B. (Eds.). (2007). An introduction to statistical relational learning. Cambridge, MA: MIT Press.

    Google Scholar 

  • Ihler, A. T., Fischer III, J. W., & Willsky, A. S. (2005). Loopy belief propagation: Convergence and effects of message errors. Journal of Machine Learning Research, 6, 905–936.

    Google Scholar 

  • Jensen, F. V. (2001). Bayesian networks and decision graphs. Berlin: Springer.

    MATH  Google Scholar 

  • Jordan, M. (Ed.). (1998). Learning in graphical models. Cambridge, MA: MIT Press.

    Google Scholar 

  • Koller, D., & Friedman, N. (2009). Probabilistic graphical models: Principles and techniques. Cambridge, MA: MIT Press.

    Google Scholar 

  • Kschischang, F. R., Frey, B. J., & Loeliger, H. A. (2001). Factor graphs and the sum-product algorithm. IEEE transactions on information theory, 47(2), 498–519.

    Article  MathSciNet  MATH  Google Scholar 

  • Lauritzen, S. L. (1996). Graphical models. Oxford: Oxford University Press.

    Google Scholar 

  • Lauritzen, S. L., & Spiegelhalter, D. J. (1988). Local computations with probabilities on graphical structures and their application to expert systems. Journal of the Royal Statistical Society, Series B, 50, 157–224.

    MathSciNet  MATH  Google Scholar 

  • Murphy, K. (1998). A brief introduction to graphical models and Bayesian networks. San Francisco: Morgan Kaufmann.

    Google Scholar 

  • Pearl, J. (1988). Probabilistic reasoning in intelligent systems: Networks of plausible inference. San Francisco: Morgan Kaufmann.

    Google Scholar 

  • Pearl, J. (2000). Causality. Cambridge: Cambridge University Press.

    MATH  Google Scholar 

  • Roweis, S., & Ghahramani, Z. (1997). A unifying review of linear Gaussian models. Neural Computation, 11, 305–345.

    Article  Google Scholar 

  • Smyth, P. (1998). Belief networks, hidden Markov models, and Markov random fields: A unifying view. Pattern Recognition Letters, 18, 1261–1268.

    Article  Google Scholar 

  • Wainwright, M. J., & Jordan, M. I. (2008). Graphical models, exponential families, and variational inference. Foundations and Trends in Machine Learning, 1, 1–305.

    Article  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer Science+Business Media, LLC

About this entry

Cite this entry

McAuley, J., Caetano, T., Buntine, W. (2011). Graphical Models. In: Sammut, C., Webb, G.I. (eds) Encyclopedia of Machine Learning. Springer, Boston, MA. https://doi.org/10.1007/978-0-387-30164-8_351

Download citation

Publish with us

Policies and ethics