Abstract
Conventional neural network training methods attempt to find a single set of values for the network weights by minimizing an error function using a gradient descent based technique. In contrast, the Bayesian approach estimates the posterior distribution of weights, and produces predictions by integrating over this distribution. A distinct advantage of the Bayesian approach is that the optimization of parameters such as weight decay regularization coefficients can be performed without use of a cross-validation procedure. In the context of mineral potential mapping, this leads to maps which display far less variability than maps produced using conventional MLP training techniques, the latter which are highly sensitive to factors such as initial weights and cross-validation partitioning.
An erratum to this chapter can be found at http://dx.doi.org/10.1007/11550907_163 .
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Bonham-Carter, G.F.: Geographic information systems for geoscientists: modeling with GIS. Pergamom Press, Oxford (1994)
Skabar, A.: Mineral Potential Mapping using Feed-Forward Neural Networks. In: Proc. Int.l Joint Conf. on Neural Networks (IJCNN). Portland, Oregon, pp. 1814–1819 (2003)
Skabar, A.: Optimization of MLP parameters on Mineral Potential Mapping Tasks. In: Proceedings of ICOTA: International Conference on Optimization: Techniques and Applications, Ballarat, Australia, December 9-11 (2004)
MacKay, D.J.C.: A practical Bayesian framework for backpropagation networks. Neural Computation 4(3), 448–472 (1992)
Neal, R.M.: Bayesian Training of Backpropagation Networks by the Hybrid Monte Carlo Method, Technical Report CRG-TR-92-1, Department of Computer Science, University of Toronto (1992)
Neal, R.M.: Bayesian Learning for Neural Networks. Springer, New York (1996)
Metropolis, N.A., Rosenbluth, A.W., Rosenbluth, M.N., Teller, A.H., Teller, E.: Equation of State Calculations by Fast Computing Machines. Journal of Chemical Physics 21(6), 1087–1092 (1953)
Bishop, C.: Neural networks for pattern recognition. Oxford University Press, Oxford (1995)
Duane, S., Kennedy, A.D., Pendleton, B.J., Roweth, D.: Hybrid Monte Carlo. Physics Letters B. 195(2), 216–222 (1987)
Geman, S., Geman, G.: Stochastic Relaxation, Gibbs Distributions and the Bayesian Restoration of Images. IEEE Transactions on Pattern Analysis and Machine Intelligence 6, 721–741 (1984)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Skabar, A. (2005). Application of Bayesian MLP Techniques to Predicting Mineralization Potential from Geoscientific Data. In: Duch, W., Kacprzyk, J., Oja, E., Zadrożny, S. (eds) Artificial Neural Networks: Formal Models and Their Applications – ICANN 2005. ICANN 2005. Lecture Notes in Computer Science, vol 3697. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11550907_152
Download citation
DOI: https://doi.org/10.1007/11550907_152
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-28755-1
Online ISBN: 978-3-540-28756-8
eBook Packages: Computer ScienceComputer Science (R0)