Skip to main content
SpringerLink
Log in

Training Multi-layer Perceptrons Using MiniMin Approach

  • Conference paper
Computational Intelligence and Security (CIS 2005)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 3801))

Included in the following conference series:

Abstract

Multi-layer perceptrons (MLPs) have been widely used in classification and regression task. How to improve the training speed of MLPs has been an interesting field of research. Instead of the classical method, we try to train MLPs by a MiniMin model which can ensure that the weights of the last layer are optimal at each step. Significant improvement on training speed has been made using our method for several big benchmark data sets.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Rumelnart, D.E., Hinton, G.E., Williams, R.J.: Learning reprensentation of backprogation errors. Nature 223, 533–536 (1986)

    Article  Google Scholar 

  2. Hornik, K., Stinchcombe, M., White, H.: Multilayer feedforward networks are univesal approximators. Neural Networks 2, 359–366 (1989)

    Article  Google Scholar 

  3. Rumelhart, D.E., Hinton, G.E., Williams, R.J.: Learning Internal Representations by Error Propagation. In: Parallel Distributed Processing: Exploration in the Microstructure of Cognition, pp. 318–362 (1986)

    Google Scholar 

  4. Battiti, R., Masulli, F.: BFGS Optimization for faster and automated supervised learing. In: International Neural Network conference, pp. 757–760 (1990)

    Google Scholar 

  5. Hagan, M.T., Menhaj, M.: Training feedforward networks with the Marquardt algrithm. IEEE Transactions on Neural Networks 5, 989–993 (1994)

    Article  Google Scholar 

  6. Moller, M.F.: A Scaled conjugate gradient algorithm for fast supervised learning. Neural Network 6, 525–533 (1993)

    Article  Google Scholar 

  7. Demuth, H., Beale, M.: Neural network toolbox for use with MATLAB. The MatWorks Inc., Natick (1998)

    Google Scholar 

  8. Hagan, M.T., Demuth, H.B., Beale, M.H.: Neural Network Design. PWS Publishing, Boston (1996)

    Google Scholar 

  9. Boyd, S., Vandenberghe, L.: Convex Optimization. Cambridge University Press, Cambridge (2004)

    MATH  Google Scholar 

  10. Michie, D., Spiegelhalter, D.J., Taylor, C.C.: Machine Learning, Neural and Statistical Classification. Prentice Hall, Englewood Cliffs (1994)

    MATH  Google Scholar 

  11. Rasmussen, C.E., Neal, R.M., Hinton, C.E., Van Gamp, D., Revow, M., Ghahramani, Z., Kustra, R., Tibshirani, R.: The Deleve Manual (1996)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Institute of Intelligent Information Processing, Xidian University, Xi’an, 710071, China

    Liefeng Bo, Ling Wang & Licheng Jiao

Authors
  1. Liefeng Bo
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ling Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Licheng Jiao
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Microelectronic Instiute, Xidian University, 710071, Xi’an, China

    Yue Hao

  2. Department of Computer Science, Hong Kong Baptist University, Kowloon Tong, Hong Kong

    Jiming Liu

  3. School of Computer Science and Technology, Xidian University, Xi’an, China

    Yuping Wang

  4. Department of Computer Science, Hong Kong Baptist University, Hong Kong,  

    Yiu-ming Cheung

  5. School of Electrical and Electronic Engineering, University of Manchester, UK

    Hujun Yin

  6. Life Science Research Center, School of Electronic Engineering, Xidian University, 710071, Xi’an, Shaanxi, China

    Licheng Jiao

  7. Key Laboratory of Computer Networks and Information Security (Ministry of Education), Xidian University, 710071, Xi’an, China

    Jianfeng Ma

  8. National Laboratory of Antennas and Microwave Technology, Xidian University, 710071, Xi’an, Shanxi, P.R. China

    Yong-Chang Jiao

Rights and permissions

Reprints and permissions

Copyright information

© 2005 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Bo, L., Wang, L., Jiao, L. (2005). Training Multi-layer Perceptrons Using MiniMin Approach. In: Hao, Y., et al. Computational Intelligence and Security. CIS 2005. Lecture Notes in Computer Science(), vol 3801. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11596448_135

Download citation

  • DOI: https://doi.org/10.1007/11596448_135

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-30818-8

  • Online ISBN: 978-3-540-31599-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation