Abstract
This paper proposed an adaptive robust learning algorithm for spline-based neural network. Adaptive influence function was dynamically added before objective function to modify the learning gain of back-propagate learning method in neural networks with spline activation functions. Besides the nonlinear activation functions in neurons and linear interconnections between neurons, objective function also changes the shape during iteration. This employed neural network the robust ability to reject gross errors and to learn the underlying input-output mapping from training data. Simulation results also conformed that compared to common learning method, convergence rate of this algorithm is improved for: 1) more free parameters are updated simultaneously in each iteration; 2) the influence of incorrect samples is gracefully suppressed.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Chen, C.T., Chang, W.D.: A Feedforward Neural Network with Function Shape Auto Tuning. Neural Networks 9, 627–641 (1996)
Piazza, F., Uncini, A., Zenobi, M.: Neural Networks with Digital LUT Activation Function. In: Proc. of the IJCNN, Beijing, China, vol. 2, pp. 343–349 (1993)
Vecci, L., et al.: Learning and Approximation Capabilities of Adaptive Spline Activation Function Neural Networks. Neural Networks 11, 259–270 (1998)
Stefano, G., Francesco, P., Aurelio, U.: Multilayer Feedforward Networks with Adaptive Spline Activation Function. IEEE Trans. on Neural Networks 10, 672–683 (1999)
Hu, L., Sun, Z.: A Rapid Two-Step Learning Algorithm for Spline Activation Function Neural Networks with the Application on Biped Gait Recognition. In: Yin, F.-L., Wang, J., Guo, C. (eds.) ISNN 2004. LNCS, vol. 3173, pp. 286–292. Springer, Heidelberg (2004)
Hampel, F.R., et al.: Robust Statistics-The Approach Based on Influence Function, pp. 150–153. Wiley, New York (1986)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Hu, L., Sun, Z. (2005). A Robust Learning Algorithm for Feedforward Neural Networks with Adaptive Spline Activation Function. In: Wang, J., Liao, X., Yi, Z. (eds) Advances in Neural Networks – ISNN 2005. ISNN 2005. Lecture Notes in Computer Science, vol 3496. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11427391_90
Download citation
DOI: https://doi.org/10.1007/11427391_90
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-25912-1
Online ISBN: 978-3-540-32065-4
eBook Packages: Computer ScienceComputer Science (R0)