Abstract
Pattern recognition problems span a broad range of applications, where each application has its own tolerance on classification error. The varying levels of risk associated with many pattern recognition applications indicate the need for an algorithm with the ability to measure its own confidence. In this work, the supervised incremental learning algorithm Learn++ [1], which exploits the synergistic power of an ensemble of classifiers, is further developed to add the capability of assessing its own confidence using a weighted exponential majority voting technique.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
R. Polikar, L. Udpa, S. Udpa, V. Honavar. Learn++: An incremental learning algorithm for supervised neural networks. IEEE Tran. on Systems, Man, and Cybernetics(C)., Vol. 31, no. 4, November 2001.
P. Winston, “Learning structural descriptions from examples,” In The Psychology of Computer Vision P. Winston (ed.), pp. 157–209, McGraw-Hill: New York, NY, 1975.
N. Littlestone, “Learning quickly when irrelevant attributes abound,” Machine Learning, vol. 2, pp. 285–318, 1988.
P. Jantke, “Types of incremental learning,” Training Issues in Incremental Learning, A. Cornuejos (ed.) pp.26–32, The AAAI Press: Menlo Park, CA 1993.
M.A. Maloof and R.S. Michalski, “Selecting examples for partial memory learning,” Machine Learning, vol. 41, pp. 27–52, 2000.
F.S. Osario and B. Amy, “INSS: A hybrid system for constructive machine learning,” Neurocomputing, vol. 28, pp. 191–205, 1999.
J. Ghosh and A,c, Nag, “Knowledge enhancement and reuse with radial basis function networks,” Proceeding of International Joint Conference on Neural Networks, vol. 9, no. 2, pp. 1322–1327, 2002.
N. Littlestone and M. Warmuth, “Weighted Majority Algorithm,” Information and Computation, vol. 108, pp. 212–261, 1994.
Y. Freund and R. Schapire, “A decision-theoretic generalization of on-line learning and an application to boosting,” Journal of Computer and System Sciences, 1997.
R. Polikar, J. Byorick, S. Krause, A. Marino, and M. Moreton, “Learn++: A classifier independent incremental learning algorithm,” Proceedings of International Joint Conference on Neural Networks, May 2002.
C. L. Blake and C. J. Merz. (1998) UCI repository of machine learning databases. Dept. Inform. and Comput. Sci., University of California, Irvine. [Online]. Available: http://www.ics.uci.edu/~mlearn/MLRepository.html.
D. McIver and M. Friedl, “Estimating Pixel-Scale Land Cover Classification Confidence Using Nonparametric Machine Learning Methods,” IEEE Transactions on Geoscience and Remote Sensing, Vol. 39, No. 9, September 2001.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2003 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Byorick, J., Polikar, R. (2003). Confidence Estimation Using the Incremental Learning Algorithm, Learn++. In: Kaynak, O., Alpaydin, E., Oja, E., Xu, L. (eds) Artificial Neural Networks and Neural Information Processing — ICANN/ICONIP 2003. ICANN ICONIP 2003 2003. Lecture Notes in Computer Science, vol 2714. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-44989-2_23
Download citation
DOI: https://doi.org/10.1007/3-540-44989-2_23
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-40408-8
Online ISBN: 978-3-540-44989-8
eBook Packages: Springer Book Archive