Abstract
In on-line machine learning, predicting changes is not a trivial task. In this paper, a novel prediction approach is presented, that relies on a committee of experts. Each expert is trained on a specific history of changes and tries to predict future changes. The experts are constantly modified based on their performance and the committee as a whole is thus dynamic and can adapt to a large variety of changes. Experimental results based on synthetic data show three advantages: (a) it can adapt to different types of changes, (b) it can use different types of prediction models and (c) the committee outperforms predictors trained on a priori fixed size history of changes.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Bickel, S., Bruckner, M., Scheffer, T.: Discriminative learning under covariate shift. The Journal of Machine Learning Research 10, 2137–2155 (2009)
Bottcher, M., Spott, M., Kruse, R.: Predicting future decision trees from evolving data. In: The Eighth IEEE International Conference on Data Mining, pp. 33–42 (2008)
Fan, W., Davidson, I., Zadrozny, B., Yu, P.S.: An improved categorization of classifier’s sensitivity on sample selection bias. In: Fifth IEEE International Conference on Data Mining (2005)
Ruping, S.: Incremental learning with support vector machines. In: The 2001 IEEE International Conference on Data Mining, pp. 641–642 (2001)
Stanley, K.O.: Learning concept drift with a committee of decision trees. Technical report, Computer Science Department, University of Texas at Austin, USA (2003)
Syed, N.A., Liu, H., Sung, K.K.: Handling concept drifts in incremental learning with support vector machines. In: The Fifth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 317–321. ACM Press (1999)
Widmer, G., Kubat, M.: Learning in the presence of concept drift and hidden contexts. Machine Learning 23, 69–101 (1996)
Yang, Y., Wu, X., Zhu, X.: Mining in anticipation for concept change: Proactive-reactive prediction in data streams. Data Mining and Knowledge Discovery 13, 261–289 (2006)
Zliobaite, I.: Learning under concept drift: an overview. Technical report, Vilnius University, Faculty of Mathematics and Informatics (2009)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Jaber, G., Cornuéjols, A., Tarroux, P. (2011). Predicting Concept Changes Using a Committee of Experts. In: Lu, BL., Zhang, L., Kwok, J. (eds) Neural Information Processing. ICONIP 2011. Lecture Notes in Computer Science, vol 7062. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-24955-6_69
Download citation
DOI: https://doi.org/10.1007/978-3-642-24955-6_69
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-24954-9
Online ISBN: 978-3-642-24955-6
eBook Packages: Computer ScienceComputer Science (R0)