Abstract
This paper introduces Higher-Order Bayesian Networks, a probabilistic reasoning formalism which combines the efficient reasoning mechanisms of Bayesian Networks with the expressive power of higher-order logics. We discuss how the proposed graphical model is used in order to define a probability distribution semantics over particular families of higher-order terms. We give an example of the application of our method on the Mutagenesis domain, a popular dataset from the Inductive Logic Programming community, showing how we employ probabilistic inference and model learning for the construction of a probabilistic classifier based on Higher-Order Bayesian Networks.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Ceci, M., Appice, A., Malerba, D.: Mr-sbc: A multi-relational naive bayes classifier. In: Lavrač, N., Gamberger, D., Todorovski, L., Blockeel, H. (eds.) PKDD 2003. LNCS (LNAI), vol. 2838, pp. 95–106. Springer, Heidelberg (2003)
Cussens, J.: Parameter estimation in stochastic logic programs. Machine Learning 44(3), 245–271 (2001)
Dietterich, T., Getoor, L., Murphy, K. (eds.): Working Notes of the ICML-2004 Workshop on Statistical Relational Learning and Connections to Other Fields, SRL-2004 (2004)
Flach, P.A., Lachiche, N.: 1BC: a first-order Bayesian classifier. In: Džeroski, S., Flach, P.A. (eds.) ILP 1999. LNCS (LNAI), vol. 1634, pp. 92–103. Springer, Heidelberg (1999)
Gyftodimos, E., Flach, P.: Learning hierarchical bayesian networks for human skill modelling. In: Rossiter, J.M., Martin, T.P. (eds.) Proceedings of the 2003 UK workshop on Computational Intelligence (UKCI-2003), University of Bristol (2003)
Gyftodimos, E., Flach, P.: Hierarchical bayesian networks: An approach to classification and learning for structured data. In: Vouros, G.A., Panayiotopoulos, T. (eds.) SETN 2004. LNCS (LNAI), vol. 3025, pp. 291–300. Springer, Heidelberg (2004)
Kersting, K., Raedt, L.D.: Bayesian logic programs. Technical report, Institute for Computer Science, Machine Learning Lab, University of Freiburg, Germany (2000)
Koller, D.: Probabilistic relational models. In: Džeroski, S., Flach, P.A. (eds.) ILP 1999. LNCS (LNAI), vol. 1634, p. 3. Springer, Heidelberg (1999)
Lachiche, N., Flach, P.A.: 1BC2: a true first-order Bayesian classifier. In: Džeroski, S., Flach, P.A. (eds.) ILP 1999. LNCS (LNAI), vol. 1634, pp. 133–148. Springer, Heidelberg (1999)
Lloyd, J.W.: Logic for Learning: Learning Comprehensible theories from Structured Data. Springer, Heidelberg (2003)
Muggleton, S.: Stochastic logic programs. In: de Raedt, L. (ed.) Advances in inductive logic programming, pp. 254–264. IOS press, Amsterdam (1996)
Poole, D.: Logic, knowledge representation, and bayesian decision theory. In: Palamidessi, C., Moniz Pereira, L., Lloyd, J.W., Dahl, V., Furbach, U., Kerber, M., Lau, K.-K., Sagiv, Y., Stuckey, P.J. (eds.) CL 2000. LNCS (LNAI), vol. 1861, p. 70. Springer, Heidelberg (2000)
De Raedt, L., Kersting, K.: Probabilistic inductive logic programming. In: Ben-David, S., Case, J., Maruoka, A. (eds.) ALT 2004. LNCS (LNAI), vol. 3244, pp. 19–36. Springer, Heidelberg (2004)
Sato, T., Kameya, Y.: Prism: A language for symbolic-statistical modeling. In: Proceedings of the 15th International Joint Conference on Artificial Intelligence (IJCAI 1997), pp. 1330–1339. Morgan Kaufmann, San Francisco (1997)
Srinivasan, A., Muggleton, S.H., Sternberg, M.J.E., King, R.D.: Theories for mutagenicity: a study in first-order and feature-based induction. Artificial Intelligence 85(1-2), 277–299 (1996)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Gyftodimos, E., Flach, P.A. (2005). Combining Bayesian Networks with Higher-Order Data Representations. In: Famili, A.F., Kok, J.N., Peña, J.M., Siebes, A., Feelders, A. (eds) Advances in Intelligent Data Analysis VI. IDA 2005. Lecture Notes in Computer Science, vol 3646. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11552253_14
Download citation
DOI: https://doi.org/10.1007/11552253_14
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-28795-7
Online ISBN: 978-3-540-31926-9
eBook Packages: Computer ScienceComputer Science (R0)