Abstract
Single-hidden-layer feedforward neural network (SLFN) is an effective model for data classification and regression. However, it has a very important defect that it is rather time-consuming to explore the training algorithm of SLFN. In order to shorten the learning time, a special non-iterative learning algorithm was proposed, named as extreme learning machine (ELM). The main idea is that the input weights and bias are chosen randomly and the output weights are calculated by a pseudo-inverse matrix. However, ELM also has a very important drawback that it cannot achieve stable solution for different runs because of randomness. In this paper, we propose a stabilized learning algorithm based on iteration correction. The convergence analysis shows that the proposed algorithm can finish the learning process in fewer steps than the number of neurons. Three theorems and their proofs can prove that the proposed algorithm is stable. Several data sets are selected from UCI databases, and the experimental results demonstrate that the proposed algorithm is effective.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Huang G, Huang G-B, Song S, You K (2015) Trends in extreme learning machines: a review. Neural Netw 61:32–48
Fernndez-Delgado M, Cernadas E, Barro S, Ribeiro J, Neves J (2014) Direct kernel perceptron (DKP): ultra-fast kernel ELM-based classification with noniterative closed-form weight calculation. Neural Netw 50:60–71
Huang G-B, Babri HA (1998) Upper bounds on the number of hidden neurons in feedforward networks with arbitrary bounded nonlinear activation functions. IEEE Trans Neural Netw 9(1):224–229
Liu X, Wang L, Huang G-B, Zhang J, Yin J (2015) Multiple kernel extreme learning machine. Neurocomputing 149:253–264
Huang G-B, Zhu Q-Y, Siew C-K (2006) Extreme learning machine: theory and applications. Neurocomputing 70(1C3):489–501
Zhu Q-Y, Qin AK, Suganthan PN, Huang G-B (2005) Evolutionary extreme learning machine. Pattern Recogn 38(10):1759–1763
Li M-B, Huang G-B, Saratchandran P, Sundararajan N (2005) Fully complex extreme learning machine. Neurocomputing 68:306–314
Yuan Y, Wang Y, Cao F (2011) Optimization approximation solution for regression problem based on extreme learning machine. Neurocomputing 74(16):2475–2482
Wang Y, Yuan Y, Cao F (2011) A study on effectiveness of extreme learning machine. Neurocomputing 74(16):2483–2490
Blake C, Merz C (1998) UCI repository of machine learning databases. In: http://archive.ics.uci.edu/ml/, Department of Information and Computer Sciences, University of California, Irvine
Acknowledgments
Authors would like to thank the reviewers for spending a lot of time reading our manuscript, and their comments are very helpful to improve the quality of this paper. This research has been supported by the National High Technology Research and Development Program of China (863 Program) under Grant No. 2015AA020107 and the National Natural Science Foundation under Grant Nos. 61272198, 60675027 and 61001200. This research has been also supported by Key Laboratory of Oceanographic Big Data Mining and Application of Zhejiang Province (No. OBDMA201507).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Pu, DM., Gao, DQ., Ruan, T. et al. A novel learning algorithm of single-hidden-layer feedforward neural networks. Neural Comput & Applic 28 (Suppl 1), 719–726 (2017). https://doi.org/10.1007/s00521-016-2372-y
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00521-016-2372-y