Abstract
Designing the hierarchical structure is a key issue for the decision-tree-based (DTB) support vector machines multi-class classification. Inter-class separability is an important basis for designing the hierarchical structure. A new method based on vector projection is proposed to measure inter-class separability. Furthermore, two different DTB support vector multi-class classifiers are designed based on the inter-class separability: one is in the structure of DTB-balanced branches and another is in the structure of DTB-one against all. Experiment results on three large-scale data sets indicate that the proposed method speeds up the decision-tree-based support vector machines multi-class classifiers and yields higher precision.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Vapnik, V.: The Nature of Statistical Learning Theory. Springer, New York (1995)
Ma, C., Randolph, M.A., Drish, J.: A Support Vector Machines-Based Rejection Technique for Speech Recognition. In: Proceeding of IEEE Int. Conference on Acoustics, Speech, and Signal Processing, pp. 381–384. IEEE Computer Society Press, Los Alamitos (2001)
Brunelli, R.: Identity Verification Through Finger Matching: A Comparison of Support Vector Machines and Gaussian Basis Functions Classifiers. Pattern Recognition Letters 27, 1905–1915 (2006)
Ma, X.X., Huang, X.Y., Chai, Y.: 2PTMC Classification Algorithm Based on Support Vector Machines and Its Application to Fault Diagnosis. Control and Decision 18, 272–276 (2003)
Jin, B., Tang, Y.C., Zhang, Y.Q.: Support Vector Machines with Genetic Fuzzy Feature Transformation for Biomedical Data Classification. Information Sciences 177, 476–489 (2007)
Bottou, L., Cortes, C., Denker, J.: Comparison of Classifier Methods: A Case Study in Handwriting Digit Recognition. In: Proceedings of the 12th IAPR International Conference on Pattern Recognition, pp. 77–82. IEEE Computer Society Press, Jerusalem (1994)
Kebel, U.: Pairwise Classification and Support Vector Machines. In: Advances in Kernel Methods-Support Vector Learning, pp. 255–258. MIT, Cambridge (1999)
Platt, J., Cristianini, N., Shawe-Taylor, J.: Large Margin DAG’s for Multiclass Classification. Advances in Neural Information Processing Systems 12, MA, Cambridge, 547–553 (2000)
Hsu, C.W., Lin, C.J.: A Comparison of Methods for Multi-Class Support Vector Machines. IEEE Transaction on Neural Network 13, 415–425 (2002)
Wang, X.D., Shi, Z.W., Wu, C.M. Wang, W.: An Improved Algorithm for Decision-tree-based SVM. In: Proceedings of the 6th World Congress on Intelligent Control and Automation, Dalian, China, pp. 4234–4237 (2006)
Sahbi, H., Geman, D., Perona, P.: A Hierarchy of Support Vector Machines for Pattern Detection. Journal of Machine Learning Research 7, 2087–2123 (2006)
Zhao, H., Rong, L.L., Li, X.: New Method of Design Hierarchical Support Vector Machine Multi-class Classifier. Application Research of Computers 23, 34–37 (2006)
Bennet, K.P., Cristianini, N., Shaue, T.J.: Enlarging the Margins of Perceptron Decision Trees. Machine Learning 3, 295–313 (2004)
Li, Q., Jiao, L.C., Zhou, W.D.: Pre-Extracting Support Vector for Support Vector Machine Based on Vector Projection. Chinese Journal of Computers 28, 145–152 (2005)
Platt, J.C.: Fast Training of Support Vector Machines Using Sequential Minimal Optimization. http://research.microsoft.com/~jplatt
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Zhao, L., Li, X., Zhao, G. (2007). Novel Design of Decision-Tree-Based Support Vector Machines Multi-class Classifier. In: Huang, DS., Heutte, L., Loog, M. (eds) Advanced Intelligent Computing Theories and Applications. With Aspects of Artificial Intelligence. ICIC 2007. Lecture Notes in Computer Science(), vol 4682. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-74205-0_90
Download citation
DOI: https://doi.org/10.1007/978-3-540-74205-0_90
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-74201-2
Online ISBN: 978-3-540-74205-0
eBook Packages: Computer ScienceComputer Science (R0)