Abstract
The Recursive Deterministic Perceptron (RDP) feed-forward multilayer neural network is a generalisation of the single layer perceptron topology. This model is capable of solving any two-class classification problem as opposed to the single layer perceptron which can only solve classification problems dealing with linearly separable sets. For all classification problems, the construction of an RDP is done automatically and convergence is always guaranteed. A generalization of the 2-class Recursive Deterministic Perceptron (RDP) exists. This generalization allows to always separate, in a deterministic way, m-classes. It is based on a new notion of linear separability and it falls naturally from the 2 valued RDP. The methods for building 2-class RDP neural networks have been extensively tested. However, no testing has been done before on the m-class RDP method. For the first time, a study on the performance of the m-class method is presented. This study will allow the highlighting of the main advantages and disadvantages of this method by comparing the results obtained while building m-class RDP neural networks with other more classical methods such as Backpropagation and Cascade Correlation. The networks were trained and tested using the following standard benchmark classification datasets: IRIS, SOYBEAN, and Wisconsin Breast Cancer.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Tajine, M., Elizondo, D.: Enhancing the perceptron neural network by using functional composition. Technical Report 96-07, Computer Science Department, Université Louis Pasteur, Strasbourg, France (1996)
Rosenblatt, F.: Principles of Neurodynamics. Spartan, Washington D.C (1962)
Tajine, M., Elizondo, D., Fiesler, E., Korczak, J.: Adapting the 2 −class recursive deterministic perceptron neural network to m −classes. In: The International Conference on Neural Networks (ICNN). IEEE, Los Alamitos (1997)
Preparata, F.P., Shamos, M.: Computational Geometry. An Introduction. Springer, New York (1985)
Newman, D.J., Hettich, S., Blake, C.L., Merz, C.J.: UCI repository of machine learning databases (1998)
Fisher, R.A.: The use of multiple measurements in taxonomic problems. Annual Eugenics 7(II), 179–188 (1936)
Gates, G.W.: The reduced nearest neighbor rule. IEEE Transactions on Information Theory, 431–433 (May 1972)
Dasarathy, B.W.: Nosing around the neighborhood: A new system structure and classification rule for recognition in partially exposed environments. IEEE Transactions on Pattern Analysis and Machine Intelligence 2(1), 67–71 (1980)
Elizondo, D.: The Recursive Determinist Perceptron (RDP) and Topology Reduction Strategies for Neural Networks. PhD thesis, Université Louis Pasteur, Strasbourg, France (January 1997)
Mangasarian, O.L., Wolberg, W.H.: Cancer diagnosis via linear programming. SIAM News 23(5), 1–18 (1990)
Bennett, K.P., Mangasarian, O.L.: Robust linear programming discrimination of two linearly inseparable sets. Optimization Methods and Software 1, 23–34 (1992)
Wolberg, W.H., Mangasarian, O.: Multisurface method of pattern separation for medical diagnosis applied to breast cytology. In: Proceedings of the National Academy of Sciences, December 1990, vol. 87, pp. 9193–9196 (1990)
Weiss, S.M., Kulikowski, C.A.: Computer Systems That Learn. Morgan Kaufmann Publishers, San Mateo (1991)
Elizondo, D.: Searching for linearly separable subsets using the class of linear separability method. In: Proceedings of the IEEE-IJCNN, pp. 955–960 (April 2004)
Elizondo, D.: The linear separability problem: Some testing methods. In: IEEE TNN (2006) (accepted for Publication)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Elizondo, D.A., Ortiz-de-Lazcano-Lobato, J.M., Birkenhead, R. (2008). On the Generalization of the m-Class RDP Neural Network. In: Kůrková, V., Neruda, R., Koutník, J. (eds) Artificial Neural Networks - ICANN 2008. ICANN 2008. Lecture Notes in Computer Science, vol 5164. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-87559-8_76
Download citation
DOI: https://doi.org/10.1007/978-3-540-87559-8_76
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-87558-1
Online ISBN: 978-3-540-87559-8
eBook Packages: Computer ScienceComputer Science (R0)