Abstract
This paper describes the result of our study on neural learning to solve the classification problems in which data is unbalanced and noisy. We use multidimensional Gaussian distribution to analyze the separation of different class samples in a training data set, and then generate artificial noise samples in the training set using a noise modeling algorithm. The noise analysis allows us to identify special densities in the feature space that are prone to prediction er- ror. We argue that by properly generate extra training data samples around the noise densities, we can train a neural network to have stronger capability of generalization and control the classification error of the trained neural network. In particular, we focus on the problems that require a neural network to make favorable classification to a particular class. The noise modeling algorithm has been implemented to solve a classification problem of good(pass) and bad(fail) vehicles in test sites of automobile assembly plants and a multi-layered Back Propagation neural network has been used in our experiments. The experimen- tal results showed that the noise modeling algorithm was very effective in gen- erate extra data samples that can be used to train a neural network to make fa- vorable decisions to a minority class and to have increased generalization capa- bility.
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Lu, Y., Guo, H., Feldkamp, L.: Robust Neural Learning from Unbalanced Data Samples, IEEE IJCNN (1998)
Dali, C. (ed.): Artificial Neural Networks for Intelligent Manufacturing (1992)
Kosko, B.: Neural Networks and Fuzzy Systems: A Dynamical Systems Approach to Machine Intelligence, Prentice-Hall (1992)
Mackay, D.: Bayesian Methods for Adaptive Models, Ph.D thesis, CIT (1991)
Rubinstein, R.: Simulation and the Monte Carlo Method, John Wiley & Sons (1981)
Musavi, M., Chan, K., Hummels, D., Kalantri, K.: On the Generalization Ability of Neural Network Classifiers, IEEE Trans. On PAMI-16, No. 6 (1994) 659–663
Rummelhart, D., McClelland, J.: Parallel Distributed Processing: Explorations in the Microstructure of Cognition, Vol. 1: Foundations, MIT press, Cambridage, MA (1986)
Carpenter, G., Grossberg, S., Markuzon, N., et al: Fuzzy ARTMAP: An adaptive Resonance Architecture for Incremental Learning of Ananlog Maps, IJCNN (1992) 309–314
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2001 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Guo, H., Murphey, Y.L. (2001). Neural Learning from Unbalanced Data Using Noise Modeling. In: Monostori, L., Váncza, J., Ali, M. (eds) Engineering of Intelligent Systems. IEA/AIE 2001. Lecture Notes in Computer Science(), vol 2070. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45517-5_30
Download citation
DOI: https://doi.org/10.1007/3-540-45517-5_30
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-42219-8
Online ISBN: 978-3-540-45517-2
eBook Packages: Springer Book Archive