Abstract
In this paper the theory of unsupervised multi-layer stochastic vector quantiser (SVQ) networks is reviewed, and then extended to the supervised case where the network is to be used as a classifier. This leads to a hybrid approach, in which training is governed both by unsupervised and supervised pieces in the network objective function. The unsupervised piece aims to preserve enough information in the network to be able to accurately reconstruct the input (i.e. the network serves as an encoder), whereas the supervised piece aims to reproduce the classification output supplied by an external teacher (i.e. the network serves as a classifier). The tension between these two pieces of the objective function leads to an optimal network, in which typically the lower layers (near to the input) act as faithful encoders of the input, whereas the higher layers (near to the output) act as faithful classifiers. The results of some simulations are presented to illustrate these properties.
© British Crown Copyright 2001
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Kittler, J., Duin, R.P.W., Hatef, M., Matas, J.: On combining classifiers, IEEE Transactions on Pattern Analysis and Machine Intelligence, 20 (1998) 226–239
Ali, K.M., Pazzani, M.J.: On the link between error correlation and error reduction in decision tree ensembles, Technical Report 95-38, ICS-UCI, (1995)
Linde, Y., Buzo, A., Gray, R.M.: An algorithm for vector quantiser design, IEEE Trans. COM, 28(1) (1980) 84–95
Luttrell, S.P.: A theory of self-organising neural networks. In: Ellacott, S.W., Mason, J.C., Anderson, I.J. (eds.) Mathematics of Neural Networks: Models, Algorithms and Applications. Kluwer (1997) 240–244
Luttrell, S.P.: A user’s guide to stochastic encoder/decoders. DERA Technical Report, DERA/S&P/SPI/TR990290 (1999)
Luttrell, S.P.: Bayesian analysis of self-organising maps, Neural Computation, 6(5) (1994) 767–794
Luttrell, S.P.: An adaptive network for encoding data using piecewise linear functions. In: Proceedings of 9th International Conference on Artificial Neural Networks, (1999) 198–203
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2001 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Luttrell, S.P. (2001). A Self-Organising Approach to Multiple Classifier Fusion. In: Kittler, J., Roli, F. (eds) Multiple Classifier Systems. MCS 2001. Lecture Notes in Computer Science, vol 2096. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-48219-9_32
Download citation
DOI: https://doi.org/10.1007/3-540-48219-9_32
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-42284-6
Online ISBN: 978-3-540-48219-2
eBook Packages: Springer Book Archive