Abstract
Machine learning has focused a lot of attention at Bayesian classifiers in recent years. It has seen that even Naive Bayes classifier performs well in many cases, it may be improved by introducing some dependency relationships among variables (Augmented Naive Bayes). Naive Bayes is incremental in nature but, up to now, there are no incremental algorithms for learning Augmented classifiers. When data is presented in short chunks of instances, there is an obvious need for incrementally improving the performance of the classifiers as new data is available. It would be too costly, in computing time and memory space, to use the batch algorithms processing again the old data together with the new one. We present in this paper an incremental algorithm for learning Tree Augmented Naive classifiers. The algorithm rebuilds the network structure from the branch which is found to be invalidated, in some sense, by data. We will experimentally demonstrate that the heuristic is able to obtain almost optimal trees while saving computing time.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
W. Buntine. Theory refinement on Bayesian networks. In B.D. D’Ambrosio, P. Smets, and P.P. Bonisone, editors, Proceedings of the Seventh Conference on Uncertainty in Artificial Intelligence, pages 52–60, 1991.
W. Buntine. A guide to the literature on learning probabilistic networks from data. IEEE Trans. On Knowledge And Data Engineering, 8:195–210, 1996.
Jie Cheng and Russell Greiner. Learning bayesian belief network classifiers: Algorithms and system. In Proceedings of the Canadian Conference on AI, pages 141–151, 2001.
C.K. Chow and C.N. Liu. Approximating discrete probability distributions with dependence trees. IEEE Transactions on Information Teory, 14:462–467, 1968.
R. O. Duda and P. E. Hart. Pattern Classification and Scene Analysis. JohnWiley & Sons, NewYork, 1973.
N. Friedman and M. Goldszmidt. Sequential update of Bayesian network structure. In Proceedings of the Thirteenth Conference on Uncertainty in Artificial Intelligence, 1997.
Nir Friedman, Dan Geiger, and Moises Goldszmidt. Bayesian network classifiers. Machine Learning, 29(2-3):131–163, 1997.
E. Keogh and M. Pazzani. Learning augmented bayesian classifiers: A comparison of distribution-based and classification-based approaches. In FL Ft. Lauderdale, editor, Proceedings of the seventh International Workshop on Artificial Intelligence and Statistics, pages 225–230, 1999.
W. Lam and F. Bacchus. Using new data to refine Bayesian networks. In R. López de Mantaras and D. Poole, editors, Proceedings of the Tenth Conference on Uncertainty in Artificial Intelligence, pages 383–390, 1994.
P. Langley. Order effects in incremental learning. In P. Reimann and H. Spada, editors, Learning in humans and machines: Towards an Interdisciplinary Learning Science. Pergamon, 1995.
Pat Langley and Stephanie Sage. Induction of selective bayesian classifiers. In R. López de Mantaras and D. Poole, editors, Proceedings of the tenth Conference on Uncertainty in Artificial Intelligence (UAI’94), pages 399–406. San Francisco, CA: Morgan Kaufmann.
P.M. Murphy and D.W. Aha. UCI repository of machine learning databases. http://www.ics.uci.edu/ mlearn/MLRepository.html., 1994. Irvine, CA: University of California, Department of Information and Computer Science.
D. J. Spiegelhalter and S. L. Lauritzen. Sequential updating of conditional probabilities on directed graphical structures. Networks, 20:579–605, 1990.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2002 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Roure Alcobé, J. (2002). Incremental Learning of Tree Augmented Naive Bayes Classifiers. In: Garijo, F.J., Riquelme, J.C., Toro, M. (eds) Advances in Artificial Intelligence — IBERAMIA 2002. IBERAMIA 2002. Lecture Notes in Computer Science(), vol 2527. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-36131-6_4
Download citation
DOI: https://doi.org/10.1007/3-540-36131-6_4
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-00131-7
Online ISBN: 978-3-540-36131-2
eBook Packages: Springer Book Archive