Abstract
Incomparability in classifier outputs due to the variability in their scales is a major problem in the combination of different classification systems. In order to compensate this, output normalization is generally performed where the main aim is to transform the outputs onto the same scale. In this paper, it is proposed that in selecting the transformation function, the scale similarity goal should be accomplished with two more requirements. The first one is the separability of the pattern classes in the transformed output space and the second is the compatibility of the outputs with the combination rule. A method of transformation that provides improved satisfaction of the additional requirements is proposed which is shown to improve the classification performance of both linear and Bayesian combination systems based on the use of confusion matrix based a posteriori probabilities....
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
T. Ho, J. Hull, and S. Srihari. Decision combination in multiple classifier systems. IEEE Transactions on Pattern Analysis and Machine Intelligence, 16:66–75, 1994.
L. Xu, A. Krzyzak, and C. Y. Suen. Methods of combining multiple classifiers and their applications to handwriting recognition. IEEE Transactions on Systems, Man and Cybernetics, 22:418–435, 1992.
H. Altinçay and M. Demirekler. An information theoretic framework for weight estimation in the combination of probabilistic classifiers for speaker identification. Speech Communication, 30(4):255–272, April 2000.
J. S. Denker and Y. leCun. Transforming neural-net output levels to probability distributions. Technical report, AT&T Bell Laboratories, 1991.
R. P. W. Duin and M. J. Tax. Classifier conditional posteriori probabilities. SSPR/SPR, pages 611–619, 1998.
G. Giacinto and F. Roli. Methods for dynamic classifier selection. ICIAP’99, 10th international conference on image analysis and processing, Italy, pages 659–664, September 1999.
K. Woods, W. P. Kegelmeyer, and K. Bowyer. Combination of multiple classifiers using local accuracy estimates. IEEE Transactions on Pattern Analysis and Machine Intelligence, 19(4):405–410, april 1997.
R. Brunelli and D. Falavigna. Person identification using multiple cues. IEEE Transactions on Pattern Analysis and Machine Intelligence, 17(10):955–966, 1995.
Y. S. Huang and C. Y. Suen. A method of combining multiple classifiers-a neural network approach. Proceedings of the 12th IAPR international conference, 2:473–475, 1994.
K. Chen, L. Wang, and H. Chi. Methods of combining multiple classifiers with different features and their applications to text-independent speaker identification. International Journal of Pattern Recognition and Artificial Intelligence, 11(3):417–445, 1997.
D. M. J. Tax, M. Breukelen, R. P. W. Duin, and J. Kittler. Combining multiple classifiers by averaging or by multiplying. Pattern Recognition, 33:1475–1485, 2000.
B. Achermann and H. Bunke. Combination of face classifiers for person identification. Proc. 13th International Conference on Pattern Recognition, pages 416–420, 1996.
R. Battiti and A. M. Colla. Democracy in neural nets: Voting schemes for classification. Neural Networks, 7(4):691–707, 1994.
H. Altinçay and M. Demirekler. Undesirable effects of output normalization in multiple classifier systems. Submitted to Pattern Recognition Letters.
M. Demirekler and H. Altincay. Plurality voting based multiple classifier systems: statistically independent with respect to dependent classifier sets. Accepted for publication in Pattern Recognition Journal.
C. M. Bishop. Neural Networks for Pattern Recognition. Oxford University press, 1995.
H. Gish and M. Schmidt. Text-independent speaker identification. IEEE Signal Processing Magazine, pages 18–32, October 1994.
K. Yu, X. Jiang, and H. Bunke. Lipreading: A classifier combination approach. Pattern Recognition Letters, 18:1421–1426, 1997.
X. Lin, X. Ding, M. Chen, R. Zhang, and Y. Wu. Adaptive confidence transform based classifier combination for chinese character recognition. Pattern Recognition Letters, 19:975–988, 1998.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2002 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Altinçay, H., Demirekler, M. (2002). Post-processing of Classifier Outputs in Multiple Classifier Systems. In: Roli, F., Kittler, J. (eds) Multiple Classifier Systems. MCS 2002. Lecture Notes in Computer Science, vol 2364. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45428-4_16
Download citation
DOI: https://doi.org/10.1007/3-540-45428-4_16
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-43818-2
Online ISBN: 978-3-540-45428-1
eBook Packages: Springer Book Archive