Abstract
The majority of machine learning algorithms previously designed usually assume that their training sets are well-balanced, but data in the real-world is usually imbalanced. The class imbalance problem is pervasive and ubiquitous, causing trouble to a large segment of the data mining community. As the conventional machine learning algorithms have bad performance when they learn from imbalanced data sets, it is necessary to find solutions to machine learning on imbalanced data sets. This paper presents a novel Isomap-based hybrid re-sampling approach to improve the conventional SMOTE algorithm by incorporating the Isometric feature mapping algorithm (Isomap). Experiment results demonstrate that this hybrid re-sampling algorithm attains a performance superior to that of the re-sampling. It is clear that the Isomap method is an effective means to reduce the dimension of the re-sampling. This provides a new possible solution for dealing with the IDS classification.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Chawla, N.V., Bowyer, K.W., Hall, L.O., Kegelmeyer, W.P.: SMOTE: Synthetic Minority Over-sampling Technique. Journal of Artificial Intelligence Research 16, 321–357 (2002)
Tenenbaum, J.B., Silva, V., Langford, J.C.: A Global Geometric Framework for Nonlinear Dimensionality Reduction. Science 290, 2319–2323 (2000)
Chawla, N.V., Bowyer, K.W., Hall, L.O., Kegelmeyer, W.P.: SMOTE: Synthetic Minority Over-sampling Technique. Journal of Artificial Intelligence Research 16, 321–357 (2002)
Laurikkala, J.: Improving Identification of Difficult Small Classes by Balancing Class Distribution. In: Quaglini, S., Barahona, P., Andreassen, S. (eds.) AIME 2001. LNCS (LNAI), vol. 2101, pp. 63–66. Springer, Heidelberg (2001)
Wilson, L.D.: Asymptotic Properties of Nearest Neighbor Rules Using Edited Data. IEEE Transactions on Systems, Man and Cybernetics 2, 408–421 (1972)
Michalski, R.S., Mozetic, I., Hong, J., Lavrac, N.: The multi-purpose incremental learning system AQ15 and its testing application to three medical domains. In: The Fifth National Conference on Artificial Intelligence, pp. 1041–1045 (1986)
Weiss, G.M.: Mining with rarity: a unifying framework. In: Newsletter of the ACM Special Interest Group on Knowledge Discovery and Data Mining, vol. 6, pp. 7–19 (2004)
Kubat, M., Holte, R., Matwin, S.: Learning when negative examples abound. LNCS, pp. 146–153. Springer, Heidelberg (1997)
Bradley, A.P.: The use of the area under the ROC curve in the evaluation of machine learning algorithms. Pattern Recognition 30, 1145–1159 (1997)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Gu, Q., Cai, Z., Zhu, L. (2009). Classification of Imbalanced Data Sets by Using the Hybrid Re-sampling Algorithm Based on Isomap. In: Cai, Z., Li, Z., Kang, Z., Liu, Y. (eds) Advances in Computation and Intelligence. ISICA 2009. Lecture Notes in Computer Science, vol 5821. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-04843-2_31
Download citation
DOI: https://doi.org/10.1007/978-3-642-04843-2_31
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-04842-5
Online ISBN: 978-3-642-04843-2
eBook Packages: Computer ScienceComputer Science (R0)