Abstract
Extreme learning machine (ELM) for random single-hidden-layer feedforward neural networks (SLFN) has been widely applied in many fields because of its fast learning speed and good generalization performance. Since ELM randomly selects the input weights and hidden biases, it typically requires high number of hidden neurons and thus decreases its convergence performance. To overcome the deficiency of the traditional ELM, an improved ELM based on particle swarm optimization (PSO) and input-to-output sensitivity information is proposed in this study. In the improved ELM, PSO encoding the input-to-output sensitivity information of the SLFN is used to optimize the input weights and hidden biases. The improved ELM could obtain better generalization performance and improve the conditioning of the SLFN by decreasing the input-to-output sensitivity of the network. Experiment results on the classification problems verify the improved performance of the proposed ELM.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Huang, D.S., Du, J.X.: A constructive hybrid structure optimization methodology for radial basis probabilistic neural networks. IEEE Trans. Neural Netw. 19(12), 2099–2115 (2008)
Huang, D.S.: A constructive approach for finding arbitrary roots of polynomials by neural networks. IEEE Trans. Neural Netw. 15(2), 477–491 (2004)
Pao, Y.H., Phillips, S.M., Sobajic, D.J.: Neural-net computing and the intelligent control of systems. Int. J. Control 56(2), 263–289 (1992)
Zhang, L., Suganthan, P.N.: A comprehensive evaluation of random vector functional link networks. Inf. Sci. 367–368, 1094–1105 (2016)
Schmidt, W.F., Kraaijveld, M., Duin, R.P.: Feedforward neural networks with random weights. In: Proceedings of the 11th International Conference on Pattern Recognition (IAPR 1992), pp. 1–4 (1992)
Ling, Q.H., Song, Y.Q., Han, F., et al.: An improved ensemble of random vector functional link networks based on particle swarm optimization with double optimization strategy. PLoS ONE 11(11), e0165803 (2016)
Huang, G.B., Zhu, Q.Y., Siew, C.K.: Extreme learning machine: a new learning scheme of feedforward neural networks. In: Proceedings of the 2004 International Joint Conference on Neural Networks (IJCNN 2004), pp. 985–990 (2004)
Zhu, Q.Y., Qin, A.K., Suganthan, P.N., Huang, G.-B.: Evolutionary extreme learning machine. Pattern Recogn. 38(10), 1759–1763 (2005)
Xu, Y., Shu, Y.: Evolutionary extreme learning machine – based on particle swarm optimization. In: Wang, J., Yi, Z., Zurada, J.M., Lu, B.-L., Yin, H. (eds.) ISNN 2006. LNCS, vol. 3971, pp. 644–652. Springer, Heidelberg (2006). doi:10.1007/11759966_95
Han, F., Yao, H.F., Ling, Q.H.: An improved evolutionary extreme learning machine based on particle swarm optimization. Neurocomputing. 116, 87–93 (2013)
Han, F., Ling, Q.H., Huang, D.S.: Modified constrained learning algorithms incorporating additional functional constraints into neural network. Inf. Sci. 178(3), 907–919 (2008)
Han, F., Huang, D.S.: Improved extreme learning machine for function approximation by encoding a priori information. Neurocomputing. 69(16–18), 2369–2373 (2006)
Eberhart, R.C., Kennedy, J.: Particle swarm optimization. In: Proceeding of the IEEE International Conference on Neural Network, Perth, Australia, pp. 1942–1948 (1995)
Shi, Y., Eberhart, R.C.: A modified particle swarm optimizer. In: Proceedings of the IEEE International Conference on Evolutionary Computation, pp. 69–73 (1998)
Acknowledgements
This work was supported by the National Natural Science Foundation of China (Nos. 61572241 and 61271385), the Foundation of the Peak of Six Talents of Jiangsu Province (No. 2015-DZXX-024), and the Fifth “333 High Level Talented Person Cultivating Project” of Jiangsu Province (No. (2016) III-0845).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Ling, QH., Song, YQ., Han, F., Lu, H. (2017). An Improved Evolutionary Random Neural Networks Based on Particle Swarm Optimization and Input-to-Output Sensitivity. In: Huang, DS., Bevilacqua, V., Premaratne, P., Gupta, P. (eds) Intelligent Computing Theories and Application. ICIC 2017. Lecture Notes in Computer Science(), vol 10361. Springer, Cham. https://doi.org/10.1007/978-3-319-63309-1_12
Download citation
DOI: https://doi.org/10.1007/978-3-319-63309-1_12
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-63308-4
Online ISBN: 978-3-319-63309-1
eBook Packages: Computer ScienceComputer Science (R0)