Skip to main content
Log in

A New Method to Increase the Margin of Multilayer Perceptrons

  • Published:
Neural Processing Letters Aims and scope Submit manuscript

Abstract

A new method to maximize the margin of MLP classifier in classification problems is described. Thismethod is based on a new cost function which minimizes the variance ofthe mean squared error. We show that with this cost function the generalizationperformance increase. This method is tested and compared with the standard mean square errorand is applied to a face detection problem.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Bernier, O., Collobert, M., Feraud, R., Lemaire, V., Viallet, J. E. and Collobert, D.: MULTRAK: A system for Automatic Multiperson Localization and tracking in real-time, In: International Conference on Image Processing, 1998.

  2. Feraud, R. and Bernier, O.: Ensemble and modular approaches for face detection: a comparison, Neural Information Processing System 10 (1997), 472-478.

    Google Scholar 

  3. Holger, S. and Bengio, Y.: Training method for adaptative boosting of neural networks, Neural Information Processing System, 1998.

  4. Breiman, L.: Bagging predictors, Technical report TR-421, University of California, Berkley, 1994.

    Google Scholar 

  5. Le Cun, Y., Boser, B. and Denker, J. S.: Backpropagation applied to handwritten zip code recognition, Neural Computation 1 (1989), 541-551.

    Google Scholar 

  6. Rosenblatt, M.: Principles of neurodynamics: Perceptron and Theory of Brains mechanisms, Spartan Books, Washington, D.C., 1962.

    Google Scholar 

  7. Rumelhart, D. E., Hinton, G. E. and Williams, R. J.: Learning internal representations by error propagation, Parallel Distributed Processing: Explorations in the Microstructures of Cognition 1 (1986), 318-362.

    Google Scholar 

  8. Schapire, R. E., Freund, Y., Bartlett, P. and Lee,W. S.: Boosting the margin: A new explanation for the effectiveness of voting methods, Machines That Learn, 1997.

  9. White, H. and Hornik, K.: Mutilayer feedforward networks are universal approximators, Neural Network 2 (1989), 359-366.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

About this article

Cite this article

Lemaire, V., Bernier, O., Collobert, D. et al. A New Method to Increase the Margin of Multilayer Perceptrons. Neural Processing Letters 11, 7–15 (2000). https://doi.org/10.1023/A:1009607527399

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/A:1009607527399

Navigation