Abstract
Boosting is a generic statistical process for generating accurate classifier ensembles from moderately accurate learning algorithm. This paper presents a new generic boosting style procedure, M-Boost, for learning multiclass concepts. M-Boost uses a global strategy for selecting the weak classifier, a global weight reassignment strategy, a vector valued weight for the selected classifiers, and an ensemble that outputs a probability distribution on classes.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Valiant, L.G.: A Theory of the Learnable. Communications of ACM 9 (1984)
Kearns, M., Valiant, L.G.: Cryptographic Limitations on Learning Boolean Formula and Finite Automata. In: Precedings of Twenty-First Annual ACM Symposium on Theory of Computing (1989)
Schapire, R.E.: Strength of weak learnability. J. Machine Learning 5(2), 197–227 (1990)
Freund, Y.: Boosting a Weak Learning Algorithm by Majority Vote. Information and Computation 121(2), 256–285 (1995)
Freund, Y., Schapire, R.E.: A Decision Theoretic Generlization of Online Learning. Journal of Computer and System Sciences 55(1), 119–139 (1997)
Schapire, R.E., Singer, Y.: Improved Boosting algorithm using confidence rated predictions. Machine Learning 37(3), 297–336 (1999)
Dietterich, T.G., Bakiri, G.: Solving multiclass learning problems via error correcting output codes. Journal of Artificial Intelligence Research 2, 263–286 (1995)
Schapire, R.E.: Using output codes to boost multiclass learning problems. In: Machine Learning: Proceedings of Fourth International Conference (1997)
Zhu, J., Zou, H., Saharon, R., Hastie, T.: Multi-class AdaBoost. Statistics and Its Interface 2, 349–360 (2009)
Breiman, L., Friedman, J.H., Olshen, R.A., Stone, C.J.: Classification and Regression Trees. Wadsworth Inc. (1984)
Friedman, J., Hastie, T., Tibshirani, R.: Additive logistic regression: A statistical view of boosting. The Annals of Statistics 38(2), 337–374 (2000)
Frank, A., Asuncion, A.: UCI Machine Learning Repository. School of Information and Computer Science. University of California, Irvine (2010), http://archive.ics.uci.edu/ml
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Baig, M., Awais, M.M. (2012). Global Reweighting and Weight Vector Based Strategy for Multiclass Boosting. In: Huang, T., Zeng, Z., Li, C., Leung, C.S. (eds) Neural Information Processing. ICONIP 2012. Lecture Notes in Computer Science, vol 7664. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-34481-7_55
Download citation
DOI: https://doi.org/10.1007/978-3-642-34481-7_55
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-34480-0
Online ISBN: 978-3-642-34481-7
eBook Packages: Computer ScienceComputer Science (R0)