Abstract
The nonlinear classifier is effective for many practical problems. We have already proposed a method for constructing a nonlinear classifier using Legendre polynomials and have obtained good results on many actual data. In this approach, a set of original features is first extended to a large number of new features in a nonlinear fashion and then some substantial features are chosen for the nonlinear classifier. In this study, we have improved the selection process in the second stage by using some conventional feature selection algorithms. In addition, important features were selected from the original features in the preprocessing stage. The reduction in the number of the original features permits the nonlinear classifier to use a higher degree of polynomials.
Chapter PDF
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Sato M., Kudo M., Toyama J., Shimbo M.: Construction of a nonlinear discrimination function based on the MDL criterion. In 1st International Workshop on Statistical Techniques in Pattern Recognition, Prague Czech Republic 1997 141–146
Rissanen J.: A Universal prior for integers and estimation by minimum description length. Ann. Stat. 11 (1983) 416–4311
Kittler J.: Feature set search algorithms. Pattern Recognition and Signal Processing (ed. by Chen C. H.), Sijthoff and Noordhoff, Netherlands 1978 41–60
Pudil P., Novovičová J., Kittler J.: Floating search methods in feature selection. Pattern Recognition Letters 15 (1994) 1119–1125
Kudo M., Shimbo M.: Feature selection based on the structural indices of categories. Pattern Recognition 26 (1993) 891–901
Murphy P. M., AhaD. W.: UCI Repository of machine learning databases [Machine-readable data repository]. University of California, Irivne, Department of Information and Computation Science 1996
Stone M.: Cross-Validatory choice and assessment of statistical predictions. J. Roy. Stat. Soc. 36 (1974) 111–147
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1998 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Sato, M., Kudo, M., Toyama, J., Shimbo, M. (1998). Feature selection for a nonlinear classifier. In: Amin, A., Dori, D., Pudil, P., Freeman, H. (eds) Advances in Pattern Recognition. SSPR /SPR 1998. Lecture Notes in Computer Science, vol 1451. Springer, Berlin, Heidelberg. https://doi.org/10.1007/BFb0033279
Download citation
DOI: https://doi.org/10.1007/BFb0033279
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-64858-1
Online ISBN: 978-3-540-68526-5
eBook Packages: Springer Book Archive