Abstract
Causal knowledge is crucial for facilitating comprehension, diagnosis, prediction, and control in automated reasoning. Active learning in causal Bayesian networks involves interventions by manipulating specific variables, and observing the patterns of change over other variables to derive causal knowledge. In this paper, we propose a new active learning approach that supports interventions with node selection. Our method admits a node selection criterion based on non-symmetrical entropy from the current data and a stop criterion based on structure entropy of the resulting networks. We examine the technical challenges and practical issues involved. Experimental results on a set of benchmark Bayesian networks are promising. The proposed method is potentially useful in many real-life applications where multiple instances are collected as a data set in each active learning step.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Cooper, G.F., Herskovits, E.: A Bayesian method for the induction of probabilistic networks from data. Machine Learning 9, 309–347
Cooper, G.F., Yoo, C.: Causal discovery from a mixture of experimental and observational data. In: Proceedings of the Fifteenth Annual Conference on Uncertainty in Artificial Intelligence, pp. 116–125. Morgan Kaufmann Publishers, San Francisco (1999)
Eaton, D., Murphy, K.: Exact Bayesian structure learning from uncertain interventions. In: AI & Statistics, pp. 107–114 (2007)
Eberhardt, F., Glymour, C., Scheines, R.: On the Number of Experiments Sufficient and in the Worst Case Necessary to Identify All Causal Relations Among N Variables. In: UAI 2005, pp. 178–184. AUAI Press (2005)
Heckerman, D.: A Tutorial on Learning with Bayesian Networks. In: Jordan, M. (ed.) Learning in Graphical Models, pp. 301–354. MIT Press, Cambridge (1998)
Heckerman, D., Geiger, D., Chickering, D.M.: Learning Bayesian networks: The combination of knowledge and statistical data. Machine Learning 20, 197–243
Koivisto, M.: Advances in exact Bayesian structure discovery in Bayesian networks. In: UAI 2006, pp. 241–248. AUAI Press (2006)
Korb, K.B., Hope, L., Nicholson, A.E., Axnick, K.: Varieties of causal intervention. In: Zhang, C., Guesgen, H.W., Yeap, W.-K. (eds.) PRICAI 2004. LNCS (LNAI), vol. 3157, pp. 322–331. Springer, Heidelberg (2004)
Li, G.: Knowledge Discovery with Bayesian Networks, PhD Thesis Department of Computer Science, National University of Singapore, 1–210 (submitted, 2009)
Pearl, J.: Causality: models, reasoning, and inference. Cambridge University Press, New York (2000)
Sachs, K., Perez, O., Pe’er, D., Lauffenburger, D.A., Nolan, G.P.: Causal Protein-Signaling Networks Derived from Multiparameter Single-Cell Data. Science 308(5721), 523–529
Spirtes, P., Glymour, C., Scheines, R.: Causation, Prediction, and Search, 2nd edn. MIT Press, Cambridge (2000)
Tian, J., Pearl, J.: Causal Discovery from Changes. In: Proceedings of the Seventeenth Conference on Uncertainty in Artificial Intelligence (UAI), pp. 512–521. Morgan Kaufmann, San Francisco (2001)
Tong, S., Koller, D.: Active Learning for Structure in Bayesian Networks. In: IJCAI 2001, pp. 863–869. Morgan Kaufmann, Washington (2001)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Li, G., Leong, TY. (2009). Active Learning for Causal Bayesian Network Structure with Non-symmetrical Entropy. In: Theeramunkong, T., Kijsirikul, B., Cercone, N., Ho, TB. (eds) Advances in Knowledge Discovery and Data Mining. PAKDD 2009. Lecture Notes in Computer Science(), vol 5476. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-01307-2_28
Download citation
DOI: https://doi.org/10.1007/978-3-642-01307-2_28
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-01306-5
Online ISBN: 978-3-642-01307-2
eBook Packages: Computer ScienceComputer Science (R0)