Abstract
This study investigates the universal approximation capability of a three-layered feedforward flexible approximate identity neural networks under the L p[a, b]-norm. We are motivated to study such a problem by the fact that the L p[a, b]-norm has the capability of improving approximation performance significantly. Using flexible approximate identity functions as introduced in our previous study, we prove that any Lebesgue integrable function on the closed and bounded real interval [a, b] will converge to itself under the L p[a, b]-norm if it convolves with flexible approximate identity functions. Using this result, we also establish a main theorem. The proof of the main theorem is in the framework of the theory of \(\epsilon\)-net.
Similar content being viewed by others
References
Kohli N, Chandra P (2012) A study of Lp norms. Int J Adv Comput Theory Eng 1:2319–2526
Burrascano P (1991) A norm selection criterion for the generalized delta rule. IEEE Trans Neural Netw 2:125–130
Xu Z-B, Cao F-L (2005) Simultaneous L p-approximation order for neural networks. Neural Netw 18:914–923
Zhao J-W, Cao F-L (2009) L p error estimate of approximation by a feedforward neural network. In: International conference on artificial intelligence and computational intelligence, pp 161–164
Ding C, Yuan Y, Cao F-L (2010) Approximate interpolation by a class of neural networks in Lebesgue Metric. In: 9th international conference on machine learning and cybernetics, pp 3134–3139
Cao F-L, Zhang R (2009) The errors of approximation for feedforward neural networks in the L p metric. Math Comput Model 49:1563–1572
Callegaro L, Pennecchi F, Spazzini PG (2009) Comparison of calibration curves using the L p norm. Accredit Qual Assur 14:587–592
Luo Y-h, Shen S-y (2000) L p approximation of sigma-pi neural networks. IEEE Trans Neural Netw 11:1485–1489
Long J, Wu W, Nan D (2007) L p approximation capabilities of sum-of-product and sigma-pi-sigma neural networks. Int J Neural Syst 17:419–424
Dong N, Ling LJ (2009) L p(K) approximation problems in system identification with RBF neural networks. Math Res Expo 29:124–128
Muzhou H, Xuli H (2012) Multivariate numerical approximation using constructive L p(R) RBF neural network. Neural Comput 21:25–34
Wang J-J, Chen B-L, Yang C-Y (2012) Approximation of algebraic and trigonometric polynomials by feedforward neural networks. Neural Comput 21:73–80
Zainuddin Z, Panahian Fard S (2012) Double approximate identity neural networks universal approximation in real Lebesgue spaces. In: Huang T, Zeng Z, Li C, Leung CS (eds) ICONIP 2012, part I, LNCS 7663. Springer, Heidelberg, pp 409–415
Yang X, Chen S, Chen B (2012) Plane-Gaussian artificial neural network. Neural Comput 21:305–317
Panahian Fard S, Zainuddin Z (2013) The universal approximation capabilities of Mellin approximate identity neural networks. In: Guo C, Hou Z-C, Zeng Z (eds) ISNN 2013, part I, LNCS 7951. Springer, Berlin, pp 205–213
Fernández-N F, Hervás-M C, Sanchez-M J, Gutiírrez PA (2011) MELM-GRBF: a modified version of the extreme learning machine for generalized radial basis function neural networks. Neurocomputing 74:2502–2510
Panahian Fard S, Zainuddin Z (2013) On the universal approximation capability of flexible approximate identity neural networks. In: Wong WE, Ma T (eds) Emerging technologies for information systems, computing, and management LNEE 236, part II, Springer, New York, pp 201–207
Kurpinski R, Purczynski J (2006) Approximated fast estimator for the shape parameter of generalized Gaussian distribution. Signal Process 86:205–211
Fan S-KS, Lin Y, Wu C-C (2008) Image thresholding using a novel estimation method in generalized Gaussian distribution mixture modeling. Neurocomputing 72:500–512
Rostaing P, Provost JN, Collet C (1999) Unsupervised multispectral image segmentation using generalized Gaussian noise model. Lecture Notes Comput Sci (LNCS) 1654:142–156
Epstein B (1970) Introduction to Lebesgue integration and infinite-dimensional problems. W.B. Saunders Company, Philadeiphia
Zygmund A (1968) Trigonometric series. Cambridge University Press, Cambridge
Lebedev V (1997) An introduction to functional analysis and computational mathematics. Brikhäuser, Cambridge
Jones F (1993) Lebesgue integration on Euclidean space. Jones and Bartlett, Burlington
Park J, Sandberg IW (1991) Universal approximation using radial-basis-function networks. Neural Comput 3:246–257
Wu W, Nan D, Li Z, Long J (2007) Approximation to compact set of functions by feedforward neural networks. In: 20th international joint conference on neural networks, pp 1222–1225
Acknowledgments
The authors wish to thank the anonymous referees for their precious comments and suggestions. This work was supported by Universiti Sains Malaysia (1001/PMATHS/811161).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Panahian Fard, S., Zainuddin, Z. Analyses for L p[a, b]-norm approximation capability of flexible approximate identity neural networks. Neural Comput & Applic 24, 45–50 (2014). https://doi.org/10.1007/s00521-013-1493-9
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00521-013-1493-9