Abstract
Bayesian networks are graphical models that describe dependency relationships between variables, and are powerful tools for studying probability classifiers. At present, the causal Bayesian network learning method is used in constructing Bayesian network classifiers while the contribution of attribute to class is overlooked. In this paper, a Bayesian network specifically for classification-restricted Bayesian classification networks is proposed. Combining dependency analysis between variables, classification accuracy evaluation criteria and a search algorithm, a learning method for restricted Bayesian classification networks is presented. Experiments and analysis are done using data sets from UCI machine learning repository. The results show that the restricted Bayesian classification network is more accurate than other well-known classifiers.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Zhang G P. Neural networks for classification: a survey. IEEE Trans Neural Netw, 2000, 30: 117–124
Vapnik V N. Statistical Learning Theory. New York: Springer, 1998
Scott C, Salzberg S. A weighted nearest neighbor algorithm for learning with symbolic features. Mach Learn, 1993, 10: 57–78
Friedman N, Geiger D, Goldszmidt M. Bayesian network classifiers. Mach Learn, 1997, 29: 131–161
Quinlan J R. Induction of decision trees. Mach Learn, 1986, 1: 81–106
Domingos P, Pazzani M. On the optimality of the simple Bayesian classifier under zero-one loss. Mach Learn, 1997, 29: 103–130
Ramoni M, Sebastiani P. Robust Bayes classifiers. Artif Intell, 2001, 125: 209–226
Chow C K, Liu C N. Approximating discrete probability distributions with dependence trees. IEEE Trans Inform Theory, 1968, 14: 462–467
Lam W, Bacchus F. Learning Bayesian belief networks: an approach based on the MDL principle. Comput Intell, 1994, 10: 269–293
Grossman D, Domingos P. Learning Bayesian network classifiers by maximizing conditional likelihood. In: Proceedings of the 21th International Conference on Machine Learning. Banff, Canada, 2004. 361–368
Greiner R, Su X Y, Shen B et al. Structural extension to logistic regression: discriminative parameter learning of belief net classifiers. Mach Learn, 2005, 59: 297–322
Jing Y S, Pavlovi V, Rehg J M. Boosted Bayesian network classifiers. Mach Learn, 2008, 73: 155–184
Pearl J. Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference. San Mateo: Morgan Kaufmann, 1988. 383–408
Verma T S, Pearl J. Equivalence and synthesis of causal models. In: Proceedings of the 6th International Conference on Uncertainty in Artificial Intelligence. New York: Elsevier Science Inc, 1991. 255–270
Sarkar S, Murthy I. Constructing efficient belief network structures with expert provided information. IEEE Trans Knowl Data En, 1996, 8: 183–188
Cooper G F, Herskovits E. A Bayesian method for the induction of probabilistic networks from data. Mach Learn, 1992, 9: 309–347
Heckerman D, Geiger D, Chickering D M. Learning Bayesian networks: the combination of knowledge and statistical data. Mach Learn, 1995, 20: 197–243
Spirtes P, Glymour C, Scheines R. An algorithm for fast recovery of sparse causal graphs. Soc Sci Comput Rev, 1991, 9: 62–72
Cowell R G. When learning Bayesian networks from data, using conditional independence tests is equivalent to a local scoring metric. In: Proceedings of the 17th International Conference on Uncertainty in Artificial Intelligence. San Francisco: Morgan Kaufmann, 2001. 91–97
Cheng J, Greiner R, Kelly J. Learning Bayesian networks from data: an efficient approach based on information-theory. Artif Intell, 2002, 137: 43–90
Cheng J, Greiner R. Comparing Bayesian network classifiers. In: Proceedings of the 15th Conference Annual Conference on Uncertainty in Artificial Intelligence (UAI-99). San Francisco: Morgan Kaufmann, 1999. 101–108
Madden M G. On the classification performance of TAN and general Bayesian networks. Knowl-Based Syst, 2009, 22: 489–495
Drugan M M, Wiering M A. Feature selection for Bayesian network classifiers using the MDL-FS score. Int J Approx Reason, 2010, 51: 695–717
Jiang S, Zhang H. Full Bayesian network classifiers. In: Proceedings of the 23th International Conference on Machine Learning. New York: ACM, 2006. 897–904
Hernndez-Lobato J M, Hernndez-Lobato D, Surez A. Network-based sparse Bayesian classification. Pattern Recogn, 2011, 44: 886–900
Jensen F V. Bayesian Networks and Decision Graphs. New York: Springer, 2001
Wang S C, Yuan S M. Research on learning Bayesian networks structure with missing data(in Chinese). J Sofw, 2004, 15: 1042–1048
Kohavi R. A study of cross-validation and bootstrap for accuracy estimation and model selection. In: Proceedings of the 14th International Joint Conference on Artificial Intelligence. Montral: Morgan Kaufmann, 1995. 1137–1143
Murphy S L, Aha D W. UCI repository of machine learning databases. http://www.ics.uci.edu/mlearn/MLRepository.Html/2011
Fayyad U, Irani K. Multi-interval discretization of continuous-valued attributes for classification learning. In: Proceedings of the 13th International Joint Conference on Artificial Intelligence. San Francisco: Morgan Kaufmann, 1993. 1022–1027
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Wang, S., Xu, G. & Du, R. Restricted Bayesian classification networks. Sci. China Inf. Sci. 56, 1–15 (2013). https://doi.org/10.1007/s11432-012-4729-x
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11432-012-4729-x