Abstract
Despite its unrealistic independence assumption, the Naive Bayes classifier is remarkably successful in practice. In the Naive Bayes classifier, all variables are assumed to be nominal variables, it means that each variable has a finite number of values. But in large databases, the variables often take continuous values or have a large number of numerical values. So many researchers discussed the discretization (or partitioning) for domain of the continuous variables. In this paper we generalize the Naive Bayes classifier to the situation in which the fuzzy partitioning for the variable domains instead of discretization is taken. Therefore each variable in the Fuzzy Naive Bayes classifier can take a linguistic value represented by a fuzzy set. One method for estimating the conditional probabilities in the Fuzzy Naive Bayes classifier is proposed. This generalization can decrease the complexity for learning optimal discretization, and increase the power for dealing with imprecise data and the large databases. Some well-known classification problems in machine learning field have been tested, the results show that the Fuzzy Naive Bayes classifier is an effective tool to deal with classification problem which has continuous variables.
Chapter PDF
References
Dubois, D., Prade, H.: Random sets and fuzzy interval analysis. Fuzzy Sets and Systems 42, 87–101 (1991)
El-Matouat, F., Colot, O., Vannoorenberghe, P., Labiche, J.: From Continuous To Discrete Variables For Bayesian Network Classifiers. In: Proceedings of 2000 IEEE international conference on systems, man and cybernetics, Nashville, Tennessee, USA, October 2000, pp. 2800–2805 (2000)
Friedman, N., Geiger, D., Goldszmit, M.: Bayesian network classifiers. Machine Learning 29, 131–163 (1997)
Friedman, N., Goldszmidt, M.: Discretization of continuous attributes while learning Bayesian networks. In: Proceedings of the Thirteenth International Conference on Machine Learning, pp. 157–165. Morgan Kaufmann, San Francisco (1996)
Kleiter, G.D.: Propagating imprecise probabilities in Bayesian networks. Artificial Intelligence 88, 143–161 (1996)
Kleiter, G.D.: Bayesian diagnosis in expert systems. Artificial Intelligence 54, 1–32 (1992)
Nguyen, H.T.: Fuzzy sets and probability. Fuzzy Sets and Systems 90, 129–132 (1997)
Drakopolulos, J.A.: Probabilities, possibilities, and fuzzy sets. Fuzzy Sets and Systems 75, 1–15 (1995)
Larranaga, P., Kuijpers, C.M.H., Murga, R.H., Yurramendi, Y.: Learning Bayesian Network structures by searching for the best ording with genetic algorithms. IEEE transactions on systems, man, and cybernetics-part A: systems and humans 26(4), 487–493 (1996)
Neal, R.M.: Connectionist learning of belief networks. Artificial Intelligence 56, 71–113 (1992)
Yager, R.R., Filev, D.P.: Including Probabilistic Uncertainty in Fuzzy Logic Controller Modeling Using Dempster-Shafer Theory. IEEE transactions on systems, man and cybernetics 25(8), 1221–1230 (1995)
Fruhwirth-Schnattter, S.: On fuzzy bayesian inference. Fuzzy Sets and Systems 60, 41–58 (1993)
Viertl, R.: Is it necessary to develop a fuzzy Bayesian inference? In: Viertl, R. (ed.) Probability and Bayesian Statistics, pp. 471–475. Plenum Publishing Company, New York (1987)
Zadeh, L.A.: Probability measures of fuzzy events. J.Math. Analysis and Appl. 10, 421–427 (1968)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Zheng, J., Tang, Y. (2005). One Generalization of the Naive Bayes to Fuzzy Sets and the Design of the Fuzzy Naive Bayes Classifier. In: Mira, J., Álvarez, J.R. (eds) Artificial Intelligence and Knowledge Engineering Applications: A Bioinspired Approach. IWINAC 2005. Lecture Notes in Computer Science, vol 3562. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11499305_29
Download citation
DOI: https://doi.org/10.1007/11499305_29
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-26319-7
Online ISBN: 978-3-540-31673-2
eBook Packages: Computer ScienceComputer Science (R0)