Zhao Xu
ABSTRACT
We apply nonparametric hierarchical Bayesian modelling to relational learning. In a hierarchical Bayesian approach, model parameters can be "personalized", i.e., owned by entities or relationships, and are coupled via a common prior distribution. Flexibility is added in a nonparametric hierarchical Bayesian approach, such that the learned knowledge can be truthfully represented. We apply our approach to a medical domain where we form a nonparametric hierarchical Bayesian model for relations involving hospitals, patients, procedures and diagnosis. The experiments show that the additional flexibility in a nonparametric hierarchical Bayes approach results in a more accurate model of the dependencies between procedures and diagnosis and gives significantly improved estimates of the probabilities of future procedures.
- Dzeroski, S., & Lavrac, N. (Eds.). (2001). Relational data mining. Berlin: Springer. Google Scholar
Digital Library
- Escobar, M. D., & West, M. (1998). Computing bayesian nonparametric hierarchical models (Technical Report 92--A20). Duke University, ISDS.Google Scholar
- Friedman, X., Getoor, L. Koller, D., & Pfeffer, A. (1999). Learning probabilistic relational models. Proc. 16th JCAI (pp. 1300--1309). Morgan Kaufmann. Google ScholarDigital Library
- Gelman, A., Carlin, J. B., Stern, H. S., & Rubin, D. B. (2003). Bayesian data analysis. CRC press.Google Scholar
- Getoor, L., Friedman, N., Koller, D., & Taskar, B. (2003). Learning probabilistic models of link structure. Journal of Machine Learning Research, 3, 679--707. Google ScholarDigital Library
- Heckerman, D., Meek, C., & Koller, D. (2004). Probabilistic models for relational data (Technical Report MSR-TR-2004-30). Microsoft.Google Scholar
- Jelinek, F. (1997). Statistical methods for speech recognition. Cambridge, MA, USA: MIT Press. Google ScholarDigital Library
- Raedt, L. D., & Kersting, K. (2003). Probabilistic logic learning. SIGKDD Explor. Newsl., 5, 31--48. Google ScholarDigital Library
- Teh, Y. W., Jordan, M. I., Beal, M. J., & Blei, D. M. (2004). Hierarchical dirichlet processes (Technical Report 653). UC Berkeley Statistics.Google Scholar
- Tresp, V., & Yu, K. (2004). An introduction to nonparametric hierarchical bayesian modelling with a focus on multi-agent learning. In Proc. the hamilton summer school on switching and learning in feedback systems, 290 312 Springer. Google ScholarDigital Library
- Ullman, J. D., & Widom, J. (1997). A first course in database systems. Upper Saddle River, NJ, USA: Prentice Hall. Google ScholarDigital Library
- Wrobel, S. (2001). Inductive logic programming for knowledge discovery in databases. In S. Dzeroski and N. Lavrac (Eds.), Relational data mining, 74 101. Springer. Google ScholarDigital Library
- Yu, K., Tresp, V., & Yu, S. (2004). A nonparametric hierarchical bayesian framework for information filtering. Proc. 27th SIGIR (pp. 353--360). ACM. Google ScholarDigital Library
- Dirichlet enhanced relational learning
Recommendations
Variational learning for Dirichlet process mixtures of Dirichlet distributions and applications
In this paper, we propose a Bayesian nonparametric approach for modeling and selection based on a mixture of Dirichlet processes with Dirichlet distributions, which can also be seen as an infinite Dirichlet mixture model. The proposed model uses a stick-...
Learning and Updating of Uncertainty in Dirichlet Models
In this paper we analyze the problem of learning and updating of uncertainty in Dirichlet models, where updating refers to determining the conditional distribution of a single variable when some evidence is known. We first obtain the most general family ...
Variational methods for the Dirichlet process
ICML '04: Proceedings of the twenty-first international conference on Machine learningVariational inference methods, including mean field methods and loopy belief propagation, have been widely used for approximate probabilistic inference in graphical models. While often less accurate than MCMC, variational methods provide a fast ...
Comments