Abstract
We propose a method of nonlinear feature extraction for 2-class problems. A simple sigmoid function is used to extract features that are negatively correlated to each other. To evaluate the effectiveness of the proposed method, we employ linear and non-linear support vector machines to classify using the extracted feature sets and the original feature sets. Comparison on 4 datasets shows that our method is effective for nonlinear feature extraction.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Fisher, R.A.: The Statistical Utilization of Multiple Measurements. Ann. Eugenics 8, 376–386 (1938)
Lotlikar, R., Kothari, R.: Fractional-step Dimensionality Reduction. IEEE Trans. Pattern Analysis and Machine Intelligence 22, 623–627 (2000)
Chen, L., Liao, H., Ko, M., Lin, J., Yu, G.: A New LDA-based Face Recognition System Which Can Solve the Small Sample Size Problem. Pattern Recognition 33, 1713–1726 (2000)
Hastie, T., Tibshirani, R.: Discriminant Analysis by Gaussian Mixtures. J. Royal Statistical Soc., B 58, 155–176 (1996)
Raymer, M.L., Punch, W.F., Goodman, E.D., Kuhn, L.A., Jain, A.K.: Dimensionality Reduction Using Genetic Algorithms. IEEE T. Evolutionary Computation 4, 164–171 (2000)
Kotani, M., Nakai, M., Akazawa, K.: Feature extraction Using Evolutionary Computation. In: Proc. 1999 Congress on Evolutionary Computation (1999)
Blake, C.L., Merz, C.J.: UCI Repository of Machine Learning Databases, Univ. of California, Irvine (1996), http://www.ics.uci.edu/~mlearn/MLRepository.html
Liu, Y., Yao, X., Higuchi, T.: Evolutionary Ensembles with Negative Correlation Learning. IEEE T. Evolutionary Computation 4, 380–387 (2000)
Brown, G., Yao, X., Wyatt, J., Wersing, H., Sendhoff, B.: Exploiting Ensemble Diversity for Automatic Feature Extraction. In: P. 9th Int Conf. on Neural Information Processing (2002)
Wu, T.F., Lin, C.J., Weng, R.C.: Probability Estimates for Multi-class Classification by Pairwise Coupling. J. of Machine Learning Research 5, 975–1005 (2004)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Tang, E.K., Suganthan, P.N., Yao, X. (2004). Nonlinear Feature Extraction Using Evolutionary Algorithm. In: Pal, N.R., Kasabov, N., Mudi, R.K., Pal, S., Parui, S.K. (eds) Neural Information Processing. ICONIP 2004. Lecture Notes in Computer Science, vol 3316. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-30499-9_157
Download citation
DOI: https://doi.org/10.1007/978-3-540-30499-9_157
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-23931-4
Online ISBN: 978-3-540-30499-9
eBook Packages: Springer Book Archive