Abstract
Many critical application domains present issues related to imbalanced learning - classification from imbalanced data. Using conventional techniques produces biased results, as the over-represented class dominates the learning process and tend to naturally attract predictions. As a consequence, the false negative rate may result unacceptable and the chosen classifier unusable. We propose a classification procedure based on Support Vector Machine able to effectively cope with data imbalance. Using a first step approximate solution and then a suitable kernel transformation, we enlarge asymmetrically space around the class boundary, compensating data skewness. Results show that while in case of moderate imbalance the performances are comparable to standard SVM, in case of heavily skewed data the proposed approach outperforms its competitors.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Akbani, R., Kwek, S., Japkowicz, N.: Applying support vector machines to imbalanced datasets. In: Boulicaut, J.-F., Esposito, F., Giannotti, F., Pedreschi, D. (eds.) ECML 2004. LNCS (LNAI), vol. 3201, pp. 39–50. Springer, Heidelberg (2004)
Amari, S., Wu, S.: Improving svm classifiers by modifying kernel functions. Neural Networks 12(6), 783–789 (1999)
Tsanas, A., Little, M.A., McSharry, P.E., Ramig, L.O.: Accurate telemonitoring of Parkinsons disease progression by non-invasive speech tests. IEEE Transactions on Biomedical Engineering (2009) (to appear)
Burges, C.J.C.: Geometry and Invariance in Kernel Based Methods. In: Schlkopf, B., Burges, C.J.C., Smola, A. (eds.) Advances in Kernel Methods - Support Vector Learning. MIT Press, Cambridge (1999)
Castro, C.L., Carvalho, M.A., Braga, A.P.: An Improved Algorithm for SVMs Classification of Imbalanced Data Sets. Engineering Applications of Neural Networks, 108–118 (2009)
Chawla, N.V., Bowyer, K.W., Hall, L.O., Philip Kegelmeyer, W.: SMOTE: Synthetic Minority Over-sampling Technique. Journal of Artificial Intelligence Research 16, 321–357 (2002)
Cristianini, N., Shawe-Taylor, J.: An introduction to Support Vector Machines and other Kernel based Learning Methods. Cambridge University Press, Cambridge (2001)
Guo, J., Takahashi, N., Hu, W.: An Efficient Algorithm for Multi-class Support Vector Machines. In: International Conference on Advanced Computer Theory and Engineering (ICACTE 2008), Phuket, December 20-22, pp. 327–331 (2008)
Vapnik, V.: Statistical Learning Theory. John Wiley and Sons, New York (1998)
Weiss, G.M.: Mining with Rarity: A Unifying Framework. ACM SIGKDD Explorations 6(1), 7–19 (2004)
Williams, P., Li, S., Feng, J., Wu, S.: Scaling the Kernel Function to Improve Performance of the Support Vector Machine. In: Wang, J., Liao, X.-F., Yi, Z. (eds.) ISNN 2005. LNCS, vol. 3496, pp. 831–836. Springer, Heidelberg (2005)
Wu, G., Chang, E.Y.: Adaptive Feature-Space Conformal Transformation for Imbalanced-Data Learning. In: The Twentieth International Conference on Machine Learning (ICML-2003), Washington DC, pp. 816–823 (2003)
Wu, G., Chang, E.Y.: KBA: Kernel Boundary Alignment considering imbalanced data distribution. IEEE Transaction on Knowledge and Data Engineering 17(6), 786–795 (2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Maratea, A., Petrosino, A. (2011). Asymmetric Kernel Scaling for Imbalanced Data Classification. In: Fanelli, A.M., Pedrycz, W., Petrosino, A. (eds) Fuzzy Logic and Applications. WILF 2011. Lecture Notes in Computer Science(), vol 6857. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-23713-3_25
Download citation
DOI: https://doi.org/10.1007/978-3-642-23713-3_25
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-23712-6
Online ISBN: 978-3-642-23713-3
eBook Packages: Computer ScienceComputer Science (R0)