Abstract
This paper presents an improved statistical learning algorithm for feature generation in pattern recognition and signal processing. It is approximately derived from geometrical interpretation of the Fisher linear discriminant analysis (FLDA). The principal component analysis (PCA) is popular for data compression and feature extraction. Furthermore, iterative learning algorithms for obtaining eigenvectors in PCA have been presented in such fields. Their effectiveness has been demonstrated in many applications. However, recently FLDA has been often used in many fields, especially face image recognition. The drawback of FLDA is a long computational time based on a large-sized covariance matrix and the issue that the within-class covariance matrix is usually singular. Generally, in FLDA, the inverse matrix of the within-class covariance matrix cannot be obtained, since data dimension is generally higher than the number of data and then it includes many zero eigenvalues. In order to overcome this difficulty, a new iterative feature generation method, the simple-FLDA was proposed by authors. In this paper, further improvement is introduced into the simple-FLDA and its effectiveness is demonstrated for preliminary personal identification problem.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Duda, R.O., Hart, P.E.: Pattern Classification and Scene Analysis. John Wiley & Sons, Chichester (1973)
Belhumeur, P.N., Hespanha, J.P., Kriegman, D.J.: Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection. IEEE Trans. on Pattern Analysis and Machine Intelligence 19(7), 711–720 (1997)
Sanger, T.D.: Optimal Unsupervised Learning in a Single Layer Linear Feedforward Neural Network. Neural Networks 2(6), 459–473 (1989)
Kung, S.Y.: Digital Neural Networks. Prentice-Hall, Englewood Cliffs (1993)
Partridge, M., Calvo, R.: Fast dimentionality reduction and simple PCA. IDA 2, 292–298 (1997)
Nakano, M., Yasukata, F., Fukumi, M.: Recognition of Smiling Faces Using Neural Networks and SPCA. International Journal of Computational Intelligence and Applications 4(2), 153–164 (2004)
Takimoto, H., Mitsukura, Y., Fukumi, M., Akamatsu, N.: A Feature Extraction Method for Personal Identification System by Using Real-Coded Genetic Algorithm. In: Proc. of 7th SCI’2003, Orlando, USA, vol. IV, pp. 66–70 (2003)
Scholkopf, B., et al.: Nonlinear Component Analysis as a Kernel Eigenvalue Problem. Technical Report No.44, Max-Planck- Institute, Germany (1996)
Yang, M.H.: Kernel Eigenfaces vs. Kernel Fisherfaces: Face Recognition Using Kernel methods. In: Yang, M.H. (ed.) Proc. of Fifth IEEE International Conference on Automatic Face and Gesture Recognition, pp. 215–220. IEEE Computer Society Press, Washington, DC (2002)
Fukumi, M., Karungaru, S., Mitsukura, Y.: Feature Generation by Simple-FLDA for Pattern Recognition. In: Proc. of CIMCA’2005, Vienna, Austria, vol. 2, pp. 730–734 (2005)
Oyama, T., Matsumura, Y., Karungaru, S., Fukumi, M.:Feature Generation Method by Geometrical Interpretation of Fisher Linear Discriminant Analysis. Trans. of IEEJ, 127-C(6) (to appear)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Fukumi, M., Karungaru, S., Tsuge, S., Nakano, M., Akashi, T., Mitsukura, Y. (2007). Fast Statistical Learning Algorithm for Feature Generation. In: Apolloni, B., Howlett, R.J., Jain, L. (eds) Knowledge-Based Intelligent Information and Engineering Systems. KES 2007. Lecture Notes in Computer Science(), vol 4694. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-74829-8_12
Download citation
DOI: https://doi.org/10.1007/978-3-540-74829-8_12
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-74828-1
Online ISBN: 978-3-540-74829-8
eBook Packages: Computer ScienceComputer Science (R0)