Abstract
With the best trigonometric polynomial approximation as a metric, the rate of approximation of the one-hidden-layer feedforward neural networks to approximate an integrable function is estimated by using a constructive approach in this paper. The obtained result shows that for any 2π-periodic integrable function, a neural networks with sigmoidal hidden neuron can be constructed to approximate the function, and that the rate of approximation do not exceed the double of the best trigonometric polynomial approximation of function.
Similar content being viewed by others
References
C. G. Looney, Pattern Recognition Using Neural Networks, Oxford University Press, New York, 1997.
C. R. Zhang and B. D. Zheng, Hopf bifurcation in numerical approximation of an n-dimension neural network model with multi-delays, Chaos, Solitons & Fractals, 2005, 25: 129–146.
G. Cybenko, Approximation by superpositions of a sigmoidal function, Math. Control Signals System, 1989, 2: 303–314.
K. Hornik, M. Stinchombe, and H. White, Multilayer feedforward networks are universal approximator, Neural Networks, 1989, 2: 359–366.
T. P. Chen, Approximation problems in system identification with neural networks, Science in China Series A, 1994, 24(1): 1–7.
T. P. Chen and H. Chen, Universal approximation to nonlinear operators by neural networks with arbitrary activation functions and its application to a dynamic system, IEEE Transaction on Neural Networks, 1995, 6: 911–917.
J. G. Attali and G. Pages, Approximation of functions by a multilayer perceptron: A new approach, Neural Networks, 1997, 10: 1069–1081.
F. L. Cao, Z. B. Xu, and J. Y. Liang, Approximation of polynomial functions by neural networks: Construction of network and algorithm of approximation, Chinese Journal of Computers, 2003, 26(8): 906–912.
Z. B. Xu and J. J. Wang, The essential order of approximation for nearly exponential type neural networks, Science in China Series F, 2006, 49(4): 446–460.
Z. B. Xu and F. L. Cao, The essential order of approximation for neural networks, Science in China Series F, 2004, 47: 97–112.
F. L. Cao, Y. Q. Zhang, and W. G. Zhang, Neural Networks with single hidden layer and the best polynomial approximation, Acta Mathematica Sinica, 2007, 50(2): 385–392.
S. Suzuki, Constructive function approximation by three-layer artificial neural networks, Neural Networks, 1998, 11: 1049–1058.
Author information
Authors and Affiliations
Corresponding author
Additional information
This paper was supported by the National Basic Research Program of China (973 Program) under Grant No. 2007CB311000, the Natural Science Foundation of China under Grant Nos. 11001227, 60972155, 10701062, the Key Project of Chinese Ministry of Education under Grant No. 108176, Natural Science Foundation Project of CQ CSTC Nos. CSTC 2009BB2306, CSTC2009BB2305, the Fundamental Research Funds for the Central Universities under Grant No. XDJK2010B005, XDJK2010C023.
This paper was recommended for publication by Editor Jinhu LÜ.
Rights and permissions
About this article
Cite this article
Wang, J., Xu, Z. Neural networks and the best trigomometric approximation. J Syst Sci Complex 24, 401–412 (2011). https://doi.org/10.1007/s11424-011-8080-x
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11424-011-8080-x