Abstract
Extreme learning machine (ELM) is a learning algorithm for single-hidden layer feedforward neural networks (SLFNs) which randomly chooses hidden nodes and analytically determines the output weights of SLFNs. but when dealing with large datasets, we need more hidden nodes to enhance training and testing accuracy, in this case, this algorithm can’t achieve high speed any more, sometimes its training can’t be executed because the bias matrix is out of memory. We focus on this issue and use the Rank Reduced Matrix (MMR) method to calculate the hidden layer output matrix, the result showed this method can not only reach much higher speed but also better improve the generalization performance whenever the number of hidden nodes is large or not.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Huang, G.B., Zhu, Q.Y., Siew, C.K.: Extreme Learning Machine Theory and Applications. Neurocomputing 70, 489–501 (2006)
Liang, N.Y., Huang, G.B., Saratchandran, P., Sundararajan, N.: A Fast and Accurate Online Sequential Learning Algorithm for Feedforward Networks. IEEE Trans. Neural Networks 17(6), 1411–1423 (2006)
Feng, G.R., Huang, G.B., Lin, Q.P., Gay, R.: Error Minimized Extreme Learning Machine with Growth of Hidden Nodes and Incremental Learning. IEEE Trans. Neural Networks 20(8), 1352–1357 (2009)
Li, G.H., Liu, M., Dong, M.Y.: A New Online Learning Algorithm for Structure-adjustable Extreme Learning Machine. Computers and Mathematics with Applications 60, 377–389 (2010)
Rong, H.J., Ong, Y.S., Tan, A.H., Zhu, Z.X.: A Fast Pruned-extreme Learning Machine for Classification Problem. Neurocomputing 72, 359–366 (2008)
Toutounian, F., Ataei, A.: A New Method for Computing Moore-Penrose Inverse Matrice. Journal of Computational and Applied Mathematics 228, 412–417 (2009)
Petkovic, M.D., Stanimirovic, P.S.: Iterative Method for Computing the Moore-Penrose Inverse Based on Penrose Equations. Journal of Computational and Applied Mathematics 235, 1604–1613 (2011)
Israel, A.B., Greville, T.N.E.: Generalized Inverses: Theory and Applications, 2nd edn. Springer, New York (2003)
Courrieu, P.: Fast Computation of Moore-Penrose Inverse Matrices. Neural Information Processing-Letters and Reviews 8(2), 25–29 (2005)
Murphy, P.M., Aha, D.W.: UCI repository of machine learning databases (1992)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Lu, S., Zhang, G., Wang, X. (2012). A Rank Reduced Matrix Method in Extreme Learning Machine. In: Wang, J., Yen, G.G., Polycarpou, M.M. (eds) Advances in Neural Networks – ISNN 2012. ISNN 2012. Lecture Notes in Computer Science, vol 7367. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-31346-2_9
Download citation
DOI: https://doi.org/10.1007/978-3-642-31346-2_9
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-31345-5
Online ISBN: 978-3-642-31346-2
eBook Packages: Computer ScienceComputer Science (R0)