Abstract
The aim of this paper is to present an alternative ensemble-based drift learning method that is applicable to cascaded ensemble classifiers. It is a hybrid of detect-and-retrain and constant-update approaches, thus being equally responsive to both gradual and abrupt concept drifts. It is designed to address the issues of concept forgetting, experienced when altering weights of individual ensembles, as well as real-time adaptability limitations of classifiers that are not always possible with ensemble structure-modifying approaches. The algorithm achieves an effective trade-off between accuracy and speed of adaptations in time-evolving environments with unknown rates of change and is capable of handling large volume data-streams in real-time.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Kuncheva, L.: Classifier ensembles for changing environments. Multiple Classifier Systems, 1–15 (2004)
Grossberg, S.: Nonlinear neural networks: Principles, mechanisms, and architectures. Neural Networks 1(1), 17–61 (1988)
Elwell, R., Polikar, R.: Incremental Learning of Variable Rate Concept Drift. Multiple Classifier Systems, 142–151 (2009)
Rodriguez, J., Kuncheva, L.: Combining online classification approaches for changing environments. Structural, Syntactic, and Statistical Pattern Recognition, 520–529 (2010)
Tsymbal, A.: The problem of concept drift: definitions and related work. In: TCD-CS-2004-15, Dep. of Comp. Sci., Trinity College, Dublin, Ireland, vol. 4 (2004)
Barczak, A.L.C., Johnson, M.J., Messom, C.H.: Empirical evaluation of a new structure for adaboost. In: SAC 2008: Proceedings of the 2008 ACM Symposium on Applied Computing, pp. 1764–1765. ACM, Fortaleza (2008)
Susnjak, T., Barczak, A., Hawick, K.: A modular approach to training cascades of boosted ensembles. In: Hancock, E.R., et al. (eds.) SSPR&SPR 2010. LNCS, vol. 6218, pp. 640–649. Springer, Heidelberg (2010)
Freund, Y., Schapire, R.E.: A decision-theoretic generalization of on-line learning and an application to boosting. In: Vitányi, P.M.B. (ed.) EuroCOLT 1995. LNCS, vol. 904, pp. 23–37. Springer, Heidelberg (1995)
Huang, C., Ai, H., Yamashita, T., Lao, S., Kawade, M.: Incremental learning of boosted face detector. In: ICCV, pp. 1–8. IEEE, Los Alamitos (2007)
Grabner, H., Leistner, C., Bischof, H.: Semi-supervised on-line boosting for robust tracking. In: Computer Vision–ECCV, pp. 234–247 (2008)
Georghiades, A., Belhumeur, P., Kriegman, D.: From few to many: Illumination cone models for face recognition under variable lighting and pose. IEEE Trans. Pattern Anal. Mach. Intelligence 23(6), 643–660 (2001)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Susnjak, T., Barczak, A.L.C., Hawick, K.A. (2010). Adaptive Ensemble Based Learning in Non-stationary Environments with Variable Concept Drift. In: Wong, K.W., Mendis, B.S.U., Bouzerdoum, A. (eds) Neural Information Processing. Theory and Algorithms. ICONIP 2010. Lecture Notes in Computer Science, vol 6443. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-17537-4_54
Download citation
DOI: https://doi.org/10.1007/978-3-642-17537-4_54
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-17536-7
Online ISBN: 978-3-642-17537-4
eBook Packages: Computer ScienceComputer Science (R0)