Abstract
Bayesian radial basis function neural network is presented to explore the weight structure in radial-basis function neural networks for discriminant analysis. The work is motivated by the empirical experiments where the weights often follow certain probability density functions in protein sequence analysis using the bio-basis function neural network, an extension to radial basis function neural networks. An expectation-maximization learning algorithm is proposed for the estimation of the weights of the proposed Bayesian radial-basis function neural network and the simulation results show that the proposed novel radial basis function neural network performed the best among various algorithms.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Bishop, C.: Neural Networks for Pattern Recognition. Oxford Press, Oxford (1995)
Moody, J., Darken, C.: Fast learning in networks of locally tuned units. Neural Computations 1, 281–294 (1989)
Yao, X., Panaye, A., Doucet, J., Chen, H., Zhang, R., Fan, B., Liu, M., Hu, Z.: Comparative classification study of toxicity mechanisms using support vector machines and radial basis function neural networks. Analytica Chimica Acta (in press)
Liu, H., Zhang, R., Yao, X., Liu, M., Fan, B.: Prediction of electrophoretic mobility of substituted aromatic acids in different aqueous–alcoholic solvents by capillary zone electrophoresis based on support vector machine. Analytica Chimica Acta 525, 31–41 (2004)
Chen, T., Chen, H.: Approximation capability to functions of several variables, nonlinear functionals, and operators by radial basis function neural networks. IEEE Transactions on Neural Networks 6, 904–910 (1995)
Schilling, R., Carroll, J., Al-Ajlouni, A.: Approximation of nonlinear systems with radial basis function neural networks. IEEE Transactions on Neural Networks 12, 1–15 (2001)
Pedrycz, W.: Conditional fuzzy clustering in the design of radial basis function neural networks. IEEE Transactions on Neural Networks 9, 601–612 (1998)
Townsend, N., Tarassenko, L.: Estimations of error bounds for neural-network function approximators. IEEE Transactions on Neural Networks 10, 217–230 (1999)
Kaminski, K., Strumillo, P.: Kernel orthonormalization in radial basis function neural networks. IEEE Transactions on Neural Networks 8, 1177–1183 (1997)
Mao, K.Z.: RBF neural network center selection based on Fisher ratio class separability measure. IEEE Transactions on Neural Networks 13, 1211–1217 (2002)
Alexandridis, A., Patrinos, P., Sarimveis, H., Tsekouras, G.: A two-stage evolutionary algorithm for variable selection in the development of RBF neural network models. Chemometrics and Intelligent Laboratory Systems 75, 149–162 (2005)
Rivas, V., Merelo, J., Castillo, R., Arenas, M., Castellano, J.: Evolving RBF neural networks for time-series forecasting with EvRBF. Information Sciences 165, 207–220 (2004)
Chen, S., Cowan, C.F., Grant, P.M.: Orthogonal least squares learning algorithm for radial basis function networks. IEEE Transactions on Neural Networks 1, 302–309 (1991)
Thomson, R., Hodgman, C., Yang, Z.R., Doyle, A.K.: Characterising Proteolytic Cleavage Site Activity Using Bio-Basis Function Neural Network. Bioinformatics 21, 1741–1747 (2003)
Yang, Z.R., Thomson, R.: A novel neural network method in mining molecular sequence data. IEEE Trans. on Neural Networks 16, 263–274 (2005)
Yang, Z.R.: Orthogonal kernel machine in prediction of functional sites in preteins. IEEE Trans on Systems, Man and Cybernetics 35, 100–106 (2005)
Bartlett, P.L.: For valid generalization, the size of the weights is more important than the size of the network. NIPS 9, 134–140 (1997)
Geman, S., Bienenstock, E., Doursat, R.: Neural Networks and the Bias/Variance Dilemma. Neural Computation 4, 1–58 (1992)
Weigend, A., Rumelhart, D.E., Huberman, B.A.: Generalization by weight-elimination with application to forecasting. NIPSÂ 3 (1991)
Tipping, M.E.: The relevance vector machine. NIPS 12, 652–658 (2000)
Yang, Z.R., Chou, K.C.: Bio-basis function neural networks for the prediction of the Olinkage sites in glyco-proteins. Bioinformatics 20, 903–908 (2004)
Vapnik, V.: The Nature of Statistical Learning Theory. Springer, New York (1995)
Yang, Z.R., Chen, S., James, H.: Robust maximum likelihood training of probabilistic neural networks. Neural Networks 11, 739–747 (1998)
Sykacek, P.: On input selection with reversible jump Markov chain Monte Carlo sampling. NIPS 12, 638–644 (2000)
Holmes, C.C.H., Mallick, B.K.: Bayesian radial basis functions of variable dimension. Neural Computation 10, 1217–1233 (1998)
Andrieu, C., de Freitas, N., Doucet, A.: Robust full Bayesian learning for radial basis networks. Neural Computation 13, 2359–2407 (2001)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Yang, Z.R. (2005). Bayesian Radial Basis Function Neural Network. In: Gallagher, M., Hogan, J.P., Maire, F. (eds) Intelligent Data Engineering and Automated Learning - IDEAL 2005. IDEAL 2005. Lecture Notes in Computer Science, vol 3578. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11508069_28
Download citation
DOI: https://doi.org/10.1007/11508069_28
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-26972-4
Online ISBN: 978-3-540-31693-0
eBook Packages: Computer ScienceComputer Science (R0)