Abstract
We realize a multicategory Bayesian classifier by a three-layer neural network having rather a small number of hidden layer units. The state-conditional probability distributions are supposed to be multivariate normal distributions. The network has direct connections between the input and output layers. Its outputs are monotone mappings of posterior probabilities. Hence, they can be used as discriminant functions and, in addition, the posterior probabilities can be easily retrieved from the outputs.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
R.O. Duda and P.E. Hart, Pattern classification and scene analysis (John Wiley & Sons, New York, 1973).
K. Funahashi, Multilayer neural networks and Bayes decision theory, Neural Networks, 11(1998)209–213.
Y. Ito, Simultaneous L p-approximations of polynomials and derivatives on R d and their applications to neural networks. (in preparation)
Y. Ito and C. Srinivasan, Bayesian decision thoery on three layered neural networks, in: Proc. ESANN2001 (2001)377–382.
M.D. Richard and R.P. Lipmann: Neural network classifiers estimate Basian a posteriori probabilities, Neural Computation, 3(1991)461–483.
D.W. Ruck, S. Rogers, M. Kabrisky, H. Oxley, B. Sutter, The multilayer perceptron as an approximator to a Bayes optimal discriminant function, IEEE Transactions on Neural Networks, 1(1990) 296–298.
D.E. Rumelhart, G.E. Hinton and R.J. Williams, Learning internal representations by error propagation. In Parallel distributed processing ed. D.E. Rumelhart and J.L. McClelland, vol. 1(1986) 318–362.
H. White, Learning in artificial neural networks: A statistical perspective. Neural Computation, 1(1989)425–464.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2003 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Ito, Y., Srinivasan, C. (2003). Multicategory Bayesian Decision Using a Three-Layer Neural Network. In: Kaynak, O., Alpaydin, E., Oja, E., Xu, L. (eds) Artificial Neural Networks and Neural Information Processing — ICANN/ICONIP 2003. ICANN ICONIP 2003 2003. Lecture Notes in Computer Science, vol 2714. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-44989-2_31
Download citation
DOI: https://doi.org/10.1007/3-540-44989-2_31
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-40408-8
Online ISBN: 978-3-540-44989-8
eBook Packages: Springer Book Archive