Abstract
In practice, numerous applications exist where the data are imbalanced. It supposes a damage in the performance of the classifier. In this paper, an appropriate metric for imbalanced data is applied as a filtering technique in the context of Nearest Neighbor rule, to improve the classification accuracy in RBF and MLP neural networks. We diminish atypical or noisy patterns of the majority-class keeping all samples of the minority-class. Several experiments with these preprocessing techniques are performed in the context of RBF and MLP neural networks.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Anand, R., Mehrotra, K.G., Mohan, C.K., Ranka, S.: An Improved Algorithm for Neural Network Classification of Imbalanced Training Sets. IEEE Transactions on Neural Networks 4(6), 962–969 (1993)
Barandela, R., Cortés, N., Palacios, A.: The nearest neighbour rule and the reduction of the training sample size. In: 9th. Spanish Symposium on Pattern Recognition and Image Analysis, Benicassim, Spain, vol. 1, pp. 103–108 (2001)
Barandela, R., Sánchez, J.S., García, V., Rangel, E.: Strategies for learning in class imbalance problems. Pattern Recognition 36(3), 849–851 (2003)
Barandela, R., Valdovinos, R.M., Sánchez, J.S., Ferri, F.J.: The imbalanced training sample problem: under or over sampling? In: Fred, A., Caelli, T.M., Duin, R.P.W., Campilho, A.C., de Ridder, D. (eds.) SSPR&SPR 2004. LNCS, vol. 3138, pp. 806–814. Springer, Heidelberg (2004)
Berardi, V.L., Zhang, G.P.: The Effect of Misclassification Costs on Neural Network Classifiers. Decision Sciences 30(3), 659–682 (1999)
Ding, S.Q., Xiang, C.: From multilayer perceptrons to radial basis function networks: a comparative study. In: IEEE. Conference on Cybernetics and Intelligent Systems, Singapore, December 1-3, vol. 1, pp. 69–74 (2004)
Fu, X., Wang, L., Chua, K.S., Chu, F.: Training RBF neural networks on unbalanced data. In: IX International Conference on Neural Information Processing (ICONIP 2002), Singapore, pp. 1016–1020 (2002)
Haykin, S.: Neuronal Networks - a comprehensive foundation, 2nd edn., pp. 278–282. Prentice-Hall, Englewood Cliffs (1999)
Hutchinson, J.M., Lo, A., Poggio, T.: A Nonparametric Approach to Pricing and Hedging Derivates Securities Via Learning Networks. Technical Report, Artificial Intelligence Laboratory and Center for Biological and Computational Learning, MIT, memo 1471, no. 92 (1994)
Kubat, M., Matwin, S.: Addressing the curse of imbalanced training set: one-sided selection. In: 14th International Conference on Machine Learning, Nashville, USA, pp. 179–186 (1997)
Lu, Y., Guo, H., Feldkamp, L.: Robust neural learning from unbalanced data examples. In: IEEE International Joint Conference on Neural Networks, pp. 1816–1821 (1998)
Pao, Y.H.: Adaptive Patter Recognition and Neuronal Networks. Addison-Wesley, Reading (1989)
Schwenker, F., Kestler, H.A., Palm, G.: Three learning phases for radial-basisfunction networks. Neural Networks 14(4-5), 439–458 (2001)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Alejo, R., Garcia, V., Sotoca, J.M., Mollineda, R.A., Sánchez, J.S. (2006). Improving the Classification Accuracy of RBF and MLP Neural Networks Trained with Imbalanced Samples. In: Corchado, E., Yin, H., Botti, V., Fyfe, C. (eds) Intelligent Data Engineering and Automated Learning – IDEAL 2006. IDEAL 2006. Lecture Notes in Computer Science, vol 4224. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11875581_56
Download citation
DOI: https://doi.org/10.1007/11875581_56
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-45485-4
Online ISBN: 978-3-540-45487-8
eBook Packages: Computer ScienceComputer Science (R0)