Abstract
Support Vector Machines (SVMs) have been recognized as one of the most successful classification methods for many applications in static environment. However in dynamic environment, data characteristics may evolve over time. This leads to deteriorate dramatically the performance of SVMs over time. This is because of the use of data which is no more consistent with the characteristics of new incoming one. Thus in this paper, we propose an approach to recognize and handle concept changes with support vector machine. This approach integrates a mechanism to use only the recent and most representative patterns to update the SVMs without a catastrophic forgetting.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Ripley, B.D.: Pattern Recognition and Neural Networks. Cambridge University Press, Cambridge (1996)
Cha, S.H.: Comprehensive survey on distance/similarity measures between probability density functions. International Journal of Mathematical Models and Methods in Applied Sciences 4, 300–307 (2007)
Medasani, S., Zliobaite, K., Kuncheva, L.I.: Theoretical window size for classification in the presence of sudden concept drift. Technical Report # BCS-TR-001-2010. Bangor University, UK (2010)
Sobhani, P., Beigy, H.: New drift detection method for data streams. In: Bouchachia, A. (ed.) ICAIS 2011. LNCS, vol. 6943, pp. 88–97. Springer, Heidelberg (2011)
Rutkowski, L.: Adaptive probabilistic neural networks for pattern classification in time-varying environment. IEEE Transactions on Neural Networks 15(4), 811–827 (2004)
Lughofer, E., Angelov, P.: Handling drifts and shifts in on-line data streams with evolving fuzzy systems. Applied Soft Computing 11, 2057–2068 (2011)
Kuncheva, L.I.: Classifier ensembles for changing environments. In: Roli, F., Kittler, J., Windeatt, T. (eds.) MCS 2004. LNCS, vol. 3077, pp. 1–15. Springer, Heidelberg (2004)
Burges, C.J.C.: A Tutorial on support vector machines for pattern recognition. Iternational Journal of Data Mining and Knowledge Discovery 2, 121–167 (1998)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Ayad, O. (2014). Learning under Concept Drift with Support Vector Machines. In: Wermter, S., et al. Artificial Neural Networks and Machine Learning – ICANN 2014. ICANN 2014. Lecture Notes in Computer Science, vol 8681. Springer, Cham. https://doi.org/10.1007/978-3-319-11179-7_74
Download citation
DOI: https://doi.org/10.1007/978-3-319-11179-7_74
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-11178-0
Online ISBN: 978-3-319-11179-7
eBook Packages: Computer ScienceComputer Science (R0)