Abstract
A limiting factor in research on combining classifiers is a lack of awareness of the full range of available modular structures. One reason for this is that there is as yet little agreement on a means of describing and classifying types of multiple classifier system. In this paper, a categorisation scheme for the identification and description of types of multinet systems is proposed in which systems are described as (a) involving competitive or cooperative combination mechanisms; (b) combining either ensemble, modular, or hybrid components; (c) relying on either bottom-up, or top-down combination, and (d) when bottom up as using either static or fixed combination methods. It is claimed that the categorisation provides an early, but necessary, step in the process of mapping the space of multinet systems: permitting the comparison of different types of system, and facilitating their design and description. On the basis of this scheme, one ensemble and two modular multinet system designs are implemented, and applied to an engine fault diagnosis problem. The best generalisation performance was achieved from the ensemble system.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Auda, G., and Kamel, M. (1998) Modular Neural Network Classifiers: A Comparative Study. Journal of Intelligent and Robotic Systems, 21, 117–129.
Avnimelech, R. and Intrator, N. (1999) Boosted mixture of experts: an ensemble learning scheme. Neural Computation, 11,2, 483–497.
Baldi, P., and Hornik, K. (1989) Neural networks and principal component analysis: learning from examples without local minima. Neural Networks, 2,(1) 53–58.
Baxt, W.G. (1992) Improving the accuracy of an artificial neural network using multiple differently trained networks. Neural Computation, 4, 772–780.
Chandroth, G. and Sharkey, A.J.C. (1999) Utilising the rotational motion of machinery in a high resolution data acquisition system. In Proceedings of Computers and Ships, Organised by The Institute of Marine Engineers in association with The Royal Institution of Naval Architects.
Chandroth, G. (2000) Diagnostic ensembles: enforcing diversity for reliability in the combination. University of Sheffield, Phd Thesis.
Gallinari, P. (1995) Modular neural net systems: training of. In M.A. Arbib (Ed) The Handbook of Brain Theory and Neural Networks, 582–585, Bradford Books, MIT Press.
Giacinto, G. and Roli, F. (2000) Dynamic Classifier Selection, Multiple Classifier Systems 2000, Lecture Notes in Computer Science 1857, pp 177–189.
Hansen, J. (1999) Combining predictors: comparison of five meta machine learning methods, Information Science, 119(1–2), 91–105.
Haykin, S. (1999) Neural Networks-A Comprehensive Foundation, Prentice-Hall, New Jersey, Second Edition.
Jacobs, R.A., Jordan, M.I., Nowlan, S.J. and Hinton, G.E. (1991) Adaptive mixtures of local experts. Neural Computation, 3, 79–97.
Jordan, M.I., and Jacobs, R.A.. (1994) Hierarchical mixtures of expert and the em algorithm. Neural Computation 6(2) 181–214.
Kuncheva, L.I. (in press) Switching between selection and fusion in combining classifiers: An experiment. IEEE Transactions on SMC, Part B.
Nolfi, S. and Floreano, D. (2000) Evolutionary Robotics: The biology, intelligence and technology of self-organising machines A Bradford book: MIT Press.
Sharkey, A.J.C. (1996) On Combining Artificial Neural nets. Connection Science, 8,3/4, 299–314.
Sharkey, A.J.C. (1999) Multi-Net Systems. In (Ed) A.J.C. Sharkey Combining Artificial Neural Nets: Ensemble and Modular Multi-Net Systems, Springer-Verlag, pp 1–30.
Sharkey, A.J.C., Chandroth, G.O, and Sharkey, N.E. (2000) A Multi-Net System for the Fault Diagnosis of a Diesel Engine. Neural Computing and Applications, 9: 152–160.
Sharkey, A.J.C. and Sharkey, N.E. (1997) Combining Diverse Neural Nets, Knowledge Engineering Review, 12,3, 1–17.
Wolpert, D.H. (1992) Stacked generalization, Neural Networks, 5, 241–259.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2002 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Sharkey, A.J.C. (2002). Types of Multinet System. In: Roli, F., Kittler, J. (eds) Multiple Classifier Systems. MCS 2002. Lecture Notes in Computer Science, vol 2364. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45428-4_11
Download citation
DOI: https://doi.org/10.1007/3-540-45428-4_11
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-43818-2
Online ISBN: 978-3-540-45428-1
eBook Packages: Springer Book Archive