Abstract
In this study we investigate a hybrid neural network architecture for modelling purposes. The proposed network is based on the multilayer perceptron (MLP) network. However, in addition to the usual hidden layers the first hidden layer is selected to be a centroid layer. Each unit in this new layer incorporates a centroid that is located somewhere in the input space. The output of these units is the Euclidean distance between the centroid and the input. The centroid layer clearly resembles the hidden layer of the radial basis function (RBF) networks. Therefore the centroid based multilayer perceptron (CMLP) networks can be regarded as a hybrid of MLP and RBF networks. The presented benchmark experiments show that the proposed hybrid architecture is able to combine the good properties of MLP and RBF networks resulting fast and efficient learning, and compact network structure.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
S. Haykin, Neural Networks, a Comprehensive Foundation,Macmillan, New York, 1994.
R. Fletcher, Practical Methods of Optimization,Chichester Wiley, 2nd ed., 1990.
M. Lehtokangas, P. Salmela, J. Saarinen and K. Kaski, “Weight initialization techniques in neural network systems and their application”, to appear 1997 in C. Leondes (ed.), Neural Network Systems Techniques and Applications, International Series on Advances in Control and Dynamic Systems, Academic Press.
S. Fahlman and C. Lebiere, “The cascade-correlation learning architecture”, inD. Touretzky (ed.), Advances in Neural Information Processing Systems 2, Morgan Kaufmann, pp. 524–532, 1990.
J. Moody and C. Darken, “Fast learning innetworks of locally-tuned processing units”, Neural Computation, Vol. 1, pp. 281–294, 1989.
J. Tou and R. Gonzalez, Pattern Recognition Principles, Addison-Wesley, London, 1981.
M. Riedmiller and H. Braun, “A direct adaptive method forfaster backpropagation learning: the RPROP algorithm”, Proceedings of IEEE International Conference on Neural Networks, pp. 586–591, 1993.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Lehtokangas, M., Saarinen, J. Centroid based Multilayer Perceptron Networks. Neural Processing Letters 7, 101–106 (1998). https://doi.org/10.1023/A:1009636529053
Issue Date:
DOI: https://doi.org/10.1023/A:1009636529053