Abstract
Causal discovery involves learning Directed Acyclic Graphs (DAGs) from observational data and has widespread applications in various fields. Recent advancements in the structural equation model (SEM) have successfully applied continuous optimization techniques to causal discovery. These methods introduce acyclicity constraints to tackle the challenge of exploring the exponentially large search space that arises as the number of graph nodes increases. However, these methods often rely on point estimates that fail to fully account for the inherent uncertainty present in the data. This limitation can lead to inaccurate causal graph inference. In this paper, we propose a novel method for causal discovery with Bayesian Neural Networks (CD-BNN). CD-BNN incorporates a Bayesian Neural Network to explicitly model and quantify uncertainty in the data while reducing the influence of noise through model averaging. Moreover, we explore the extraction of the final DAG from the BNN using partial derivatives. We conduct a comprehensive set of experiments on both real-world and synthetic data to evaluate the performance of our approach. The results demonstrate that our proposed method surpasses related baselines in accurately identifying causal graphs, particularly when faced with data uncertainty.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Blundell, C., Cornebise, J., Kavukcuoglu, K., Wierstra, D.: Weight uncertainty in neural network. In: International Conference on Machine Learning, pp. 1613–1622. PMLR (2015)
Daly, R., Shen, Q.: Learning Bayesian network equivalence classes with ant colony optimization. J. Artif. Intell. Res. 35, 391–447 (2009)
Geffner, T., et al.: Deep end-to-end causal inference. In: NeurIPS 2022 Workshop on Causality for Real-world Impact (2022). https://openreview.net/forum?id=6DPVXzjnbDK
Gelman, A.: Bayesian model-building by pure thought: some principles and examples. Statistica Sinica 6(1), 215–232 (1996)
Gheisari, S., Meybodi, M.R.: BNC-PSO: structure learning of Bayesian networks by particle swarm optimization. Inf. Sci. 348, 272–289 (2016)
He, Y., Cui, P., Shen, Z., Xu, R., Liu, F., Jiang, Y.: Daring: differentiable causal discovery with residual independence. In: Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, pp. 596–605 (2021)
Heng, X.C., Qin, Z., Wang, X.H., Shao, L.P.: Research on learning Bayesian networks by particle swarm optimization. Inf. Technol. J. 5(3), 118–121 (2006)
Kuang, K., Cui, P., Athey, S., Xiong, R., Li, B.: Stable prediction across unknown environments. In: proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 1617–1626 (2018)
Lachapelle, S., Brouillard, P., Deleu, T., Lacoste-Julien, S.: Gradient-based neural dag learning. arXiv preprint arXiv:1906.02226 (2019)
Li, X.L., Wang, S.C., He, X.D.: Learning Bayesian networks structures based on memory binary particle swarm optimization. In: International Conference on Simulated Evolution and Learning (2006)
Opgen-Rhein, R., Strimmer, K.: From correlation to causation networks: a simple approximate learning algorithm and its application to high-dimensional plant gene expression data. BMC Syst. Biol. 1(1), 1–10 (2007)
Peters, J., Mooij, J.M., Janzing, D., Schölkopf, B.: Causal discovery with continuous additive noise models (2014)
Sachs, K., Perez, O., Pe’er, D., Lauffenburger, D.A., Nolan, G.P.: Causal protein-signaling networks derived from multiparameter single-cell data. Science 308(5721), 523–529 (2005)
Shanmugam, R.: Causality: models, reasoning, and inference-judea pearl; Cambridge University Press, Cambridge, UK, 2000, pp. 384. ISBN 0-521-77362-8. Neurocomputing 1(41), 189–190 (2001)
Shimizu, S., Hoyer, P.O., Hyvärinen, A., Kerminen, A., Jordan, M.: A linear non-gaussian acyclic model for causal discovery. J. Mach. Learn. Res. 7(10) (2006)
Spirtes, P., Glymour, C., Scheines, R.: Causality from probability (1989)
Spirtes, P., Glymour, C.N., Scheines, R., Heckerman, D.: Causation, prediction, and search. MIT press (2000)
Tong, W., Yang, J.: A heuristic method for learning Bayesian networks using discrete particle swarm optimization. Knowl. Inform. Syst. 24(2), 269–281 (2010)
Varian, H.R.: Causal inference in economics and marketing. Proc. Natl. Acad. Sci. 113(27), 7310–7315 (2016)
Wright, S.: The relative importance of heredity and environment in determining the piebald pattern of guinea-pigs. Proc. Natl. Acad. Sci. U.S.A. 6(6), 320 (1920)
Yu, Y., Chen, J., Gao, T., Yu, M.: DAG-GNN: dag structure learning with graph neural networks. In: International Conference on Machine Learning, pp. 7154–7163. PMLR (2019)
Zhang, B., et al.: Integrated systems approach identifies genetic nodes and networks in late-onset Alzheimer’s disease. Cell 153(3), 707–720 (2013)
Zhang, K., Hyvarinen, A.: On the identifiability of the post-nonlinear causal model. arXiv preprint arXiv:1205.2599 (2012)
Zhang, M., Jiang, S., Cui, Z., Garnett, R., Chen, Y.: D-VAE: a variational autoencoder for directed acyclic graphs. In: Advances in Neural Information Processing Systems 32 (2019)
Zhang, X., Jia, S., Li, X., Cong, G.: Learning the bayesian networks structure based on ant colony optimization and differential evolution. In: 2018 4th International Conference on Control, Automation and Robotics (ICCAR) (2018)
Zheng, X., Aragam, B., Ravikumar, P.K., Xing, E.P.: Dags with no tears: Continuous optimization for structure learning. In: Advances in Neural Information Processing Systems 31 (2018)
Zheng, X., Dan, C., Aragam, B., Ravikumar, P., Xing, E.: Learning sparse nonparametric DAGs. In: International Conference on Artificial Intelligence and Statistics, pp. 3414–3425. PMLR (2020)
Zhu, S., Ng, I., Chen, Z.: Causal discovery with reinforcement learning. arXiv preprint arXiv:1906.04477 (2019)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Han, H., Wang, S., Yuan, H., Ruan, S. (2023). CD-BNN: Causal Discovery with Bayesian Neural Network. In: Yang, X., et al. Advanced Data Mining and Applications. ADMA 2023. Lecture Notes in Computer Science(), vol 14176. Springer, Cham. https://doi.org/10.1007/978-3-031-46661-8_29
Download citation
DOI: https://doi.org/10.1007/978-3-031-46661-8_29
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-46660-1
Online ISBN: 978-3-031-46661-8
eBook Packages: Computer ScienceComputer Science (R0)