Abstract
Fisher discriminant based Foley-Sammon Transform (FST) has great influence in the area of pattern recognition. On the basis of FST, the Generalized Foley-Sammon Transform (GFST) is presented. The main difference between the GFST and the FST is that the transformed sample set by GFST has the best discriminant ability in global sense while FST has this property only in part sense. Linear discriminants are not always optimal, so a new nonlinear feature extraction method GFST with Kernels (KGFST) based on kernel trick is proposed in this paper. Linear feature extraction in feature space corresponds to non-linear feature extraction in input space. Then, KGFST is proved to correspond to a generalized eigenvalue problem. Lastly, our method is applied to digits and images recognition problems, and the experimental results show that present method is superior to the existing methods in term of space distribution and correct classification rate.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Foley, D.H., Sammon, J.W.: An Optimal Set of Discriminant Vectors. IEEE Trans on Computers 24, 281–289 (1975)
Guo, Y.F., Li, S.J., et al.: A Generalized Foley-Sammon Transform Based on Generalized Fisher Discriminant Criterion and Its Application to Face Recognition. Pattern Recognition Letters 24, 147–158 (2003)
Mika, S., Schölkopf, B., et al.: Kernel PCA and De-noising in Feature Spaces. In: Kearns, M.S., Solla, S.A., Cohn, D.A. (eds.) Advances in Neural Information Processing Systems, vol. 11, pp. 536–542. MIT Press, Cambridge (1999)
Smola, A.J., Schölkopf, B.: A Tutorial on Support Vector Regression. Technical Report (1998)
Bach, F.R., Jordan, M.I.: Kernel Independent Component Analysis (Kernel Machines Section) 3, 1–48 (2002)
Suykens, J.A.K., Gestel, T.V., et al.: Least Squares Support Vector Machines. World Scientific, Singapore (2002) ISBN 981-238-151-1
Weinberger, K., Sha, F., Saul, L.: Learning a Kernel Matrix for Nonlinear Dimensionality Reduction. Appearing in Proceedings of the 21st International Conference on Machine Learning, Banff, Canada (2004)
Glenn, F., Murat, D., et al.: A Fast Iterative Algorithm for Fisher Discriminant using Heterogeneous Kernels. Appearing in Proceedings of the 21st International Conference on Machine Learning, Banff, Canada (2004)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Chen, Z., Li, L. (2005). Generalized Foley-Sammon Transform with Kernels. In: Wang, J., Liao, X., Yi, Z. (eds) Advances in Neural Networks – ISNN 2005. ISNN 2005. Lecture Notes in Computer Science, vol 3496. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11427391_131
Download citation
DOI: https://doi.org/10.1007/11427391_131
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-25912-1
Online ISBN: 978-3-540-32065-4
eBook Packages: Computer ScienceComputer Science (R0)