Skip to main content

Analysis and Testing of the m-Class RDP Neural Network

  • Chapter
Constructive Neural Networks

Abstract

The Recursive Deterministic Perceptron (RDP) feed-forward multilayer neural network is a generalisation of the single layer perceptron topology. This model is capable of solving any two-class classification problem unlike the single layer perceptron which can only solve classification problems dealing with linearly separable sets. For all classification problems, the construction of an RDP is done automatically and convergence is always guaranteed. A generalisation of the 2-class Recursive Deterministic Perceptron (RDP) exists. This generalisation always allows the deterministic separation of m-classes. It is based on a new notion of linear separability and it arises naturally from the 2 valued RDP. The methods for building 2-class RDP neural networks have been extensively tested. However, no testing has been done before on the m-class RDP method. For the first time, a study on the performance of the m-class method is presented. This study will allow the highlighting of the main advantages and disadvantages of this method by comparing the results obtained while building m-class RDP neural networks with other more classical methods such as Backpropagation and Cascade Correlation in terms of level of generalisation and topology size. The networks were trained and tested using the following standard benchmark classification datasets: Glass, Wine, Zoo, Iris, Soybean, and Wisconsin Breast Cancer.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Bennett, K.P., Mangasarian, O.L.: Robust linear programming discrimination of two linearly inseparable sets. Optimization Methods and Software 1, 23–34 (1992)

    Article  Google Scholar 

  2. Dasarathy, B.W.: Nosing around the neighborhood: A new system structure and classification rule for recognition in partially exposed environments. IEEE Transactions on Pattern Analysis and Machine Intelligence 2(1), 67–71 (1980)

    Article  Google Scholar 

  3. Newman, D.J., Hettich, S., Merz, C.B.: C.: UCI repository of machine learning databases (1998), http://www.ics.uci.edu/~mlearn/MLRepository.html

  4. Elizondo, D.: The recursive determinist perceptron (rdp) and topology reduction strategies for neural networks. Ph.D. thesis, Université Louis Pasteur, Strasbourg, France (1997)

    Google Scholar 

  5. Elizondo, D.: Searching for linearly separable subsets using the class of linear separability method. In: Proceedings of the IEEE-IJCNN, pp. 955–960 (2004)

    Google Scholar 

  6. Elizondo, D.: The linear separability problem: Some testing methods. Accepted for Publication: IEEE TNN (2006)

    Google Scholar 

  7. Fisher, R.A.: The use of multiple measurements in taxonomic problems. Annual Eugenics 7(II), 179–188 (1936)

    Google Scholar 

  8. Gates, G.W.: The reduced nearest neighbor rule. IEEE Transactions on Information Theory, 431–433 (1972)

    Google Scholar 

  9. Mangasarian, O.L., Wolberg, W.H.: Cancer diagnosis via linear programming. SIAM News 23(5), 1–18 (1990)

    Google Scholar 

  10. Preparata, F.P., Shamos, M.I.: Computational Geometry. An Introduction. Springer, New York (1985)

    Google Scholar 

  11. Rosenblatt, F.: Principles of Neurodynamics. Spartan, Washington D.C (1962)

    MATH  Google Scholar 

  12. Tajine, M., Elizondo, D.: Enhancing the perceptron neural network by using functional composition. Tech. Rep. 96-07, Computer Science Department, Université Louis Pasteur, Strasbourg, France (1996)

    Google Scholar 

  13. Tajine, M., Elizondo, D., Fiesler, E., Korczak, J.: Adapting the 2 −class recursive deterministic perceptron neural network to m −classes. In: The International Conference on Neural Networks (ICNN), IEEE, Los Alamitos (1997)

    Google Scholar 

  14. Weiss, S.M., Kulikowski, C.A.: Computer Systems That Learn. Morgan Kaufmann Publishers, San Mateo (1991)

    Google Scholar 

  15. Wolberg, W.H., Mangasarian, O.: Multisurface method of pattern separation for medical diagnosis applied to breast cytology. Proceedings of the National Academy of Sciences 87, 9193–9196 (1990)

    Article  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2009 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Elizondo, D.A., Ortiz-de-Lazcano-Lobato, J.M., Birkenhead, R. (2009). Analysis and Testing of the m-Class RDP Neural Network. In: Franco, L., Elizondo, D.A., Jerez, J.M. (eds) Constructive Neural Networks. Studies in Computational Intelligence, vol 258. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-04512-7_9

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-04512-7_9

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-04511-0

  • Online ISBN: 978-3-642-04512-7

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics