Abstract
Combining boosting and Support Vector Machine (SVM) is proved to be beneficial, but it is too complex to be feasible. This paper introduces an efficient way to boost SVM. It embraces the idea of active learning to dynamically select “important” samples into training sample set for constructing base classifiers. This method maintains a small training sample set with settled size in order to control the complexity of each base classifier. Other than construct each base SVM classifier directly, it uses the training samples only for finding support vectors. This way to combine boosting and SVM is proved to be accurate and efficient by experimental results.
Supported by the National Grand Fundamental Research 973 Program of China under Grant No.G1998030414 and the National Natural Science Foundation of China under Grant No.79990580.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Freund, Y., Schapire, R.: A Decision-theoretic Generalization of On-line Learning and an Application to Boosting. Journal of Computer and System Sciences (1997), 55(1), 119–139
Vapnik, V.: The Nature of Statistical Learning Theory. Springer Verlag, New York (1995)
Schobkopf B., Burges C, Vapnik V.: Extracting Support Data for a Given Task. Proceedings of the First International Conference on Knowledge Discovery and Data-mining, AAAI Press, German (1996)
Hu, Y.: From Pattern Classification to Active Learning. IEEE Signal Processing Magazine (1997), 11, 39–43
Park J.M.: Intelligent Information Query and Browsing System Using Active Learning. PhD Dissertation. University of Wisconsin, Dept. of Electronic and Computer Engineering (1997)
Park J.M., Hu Y.: Online Learning for Active Pattern Recognition. IEEE Signal Processing Letters (1996), 3(11), 301–303
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2002 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Diao, L., Hu, K., Lu, Y., Shi, C. (2002). A Method to Boost Support Vector Machines. In: Chen, MS., Yu, P.S., Liu, B. (eds) Advances in Knowledge Discovery and Data Mining. PAKDD 2002. Lecture Notes in Computer Science(), vol 2336. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-47887-6_46
Download citation
DOI: https://doi.org/10.1007/3-540-47887-6_46
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-43704-8
Online ISBN: 978-3-540-47887-4
eBook Packages: Springer Book Archive