Abstract
This paper presents a new approach based on a Two-Stage Linear Discriminant Analysis (Two-Stage LDA) and Conjugate Gradient Algorithms (CGAs) for face recognition. A Two-Stage LDA technique is proposed that utilises the null space of the sample covariance matrix as well as using the range space of the between-class scatter matrix to extract discriminant information. Classic Back Propagation (BP) is a widely used Neural Network (NN) training algorithm in many detectors and classifiers. However, it is both too slow for many practical problems and its performance is not satisfactory in many application areas, including face recognition. To overcome these problems, four CGA algorithms (Fletcher-Reeves CGA, Polak-Ribiere CGA, Powell-Beale CGA, scaled CGA) have been proposed, the utility of which we investigate here in combination with Two-Stage LDA features. To further improve the accuracy, a modified AdaBoost.M1 approach was employed, which combines results of several NN classifiers as a single strong classifier. Experiments are performed on the ORL, FERET and AR face databases. The results show that all of the proposed methods lead to increased recognition rates and shorter training times compared to the classic BP.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Belhumeur, P.N., Hespanha, J.P., Kriegman, D.J.: Eigenfaces vs. Fisherfaces: Recognition using class specific linear projection. IEEE Transactions on Pattern Analysis & Machine Intelligence 19(7), 711–720 (1997)
Zhao, W., Chellappa, R., Rosenfeld, A., Phillips, P.J.: Face recognition: A literature survey. ACM Computing Surveys 35(4), 399–458 (2003)
Duda, R., Hart, P., Stork, D. (eds.): Pattern Classification, 2nd edn. Wiley, New York (2000)
Tian, Q., Barbero, M., Lee, Z.: Image Classification by the Foley Sammon Transform. Journal of Optical Engineering 25(7), 834–840 (1986)
Azami, H., Sanei, S., Mohammadi, K.: Improving the Neural Network Training for Face Recognition using Adaptive Learning Rate, Resilient Back Propagation and Conjugate Gradient Algorithm. International Journal of Computer Applications 34(2), 22–36 (2011)
Friedman, J., Hastie, T., Tibshirani, R.: Additive Logistic Regression: A Statistical View of Boosting. Annals of Statistics 28(2), 337–407 (2000)
Zho, M., Martinez, A.: Selecting Principal Components in a Two-Stage LDA Algorithm, pp. 132–137 (2006)
Bishop, C.M. (ed.): Neural Networks for Pattern Recognition. Clarendon, Oxford (1996)
Paulin, F., Santhakumaran, A.: Classification of Breast Cancer by Comparing Back Propagation Training Algorithms. International Journal on Computer Science and Engineering 3(1), 327–332 (2011)
Shaheed, M.: Performance analysis of 4 types of conjugate gradient algorithms in the nonlinear dynamic modelling of a TRMS using feedforward neural networks. In: Proc. 2004 IEEE Int. Conf. Systems, Man and Cybernetics, vol. 6, pp. 5985–5990 (2004)
Phung, S., Bouzerdoum, A.: A Pyramidal Neural Network for Visual Pattern Recognition. IEEE Transactions on Neural Networks 18(2), 329–343 (2007)
Hagan, M., Menhaj, M.: Training FeedForward Networks with the Marquardt Algorithm. IEEE Transactions on Neural Networks 5(6), 989–993 (1994)
Martinez, A.: Recognizing Imprecisely Localized, Partially Occluded, and Expression Variant Faces from a Single Sample per Class. IEEE Transactions on Pattern Analysis & Machine Intelligence 24(6), 748–763 (2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Bozorgtabar, B., Goecke, R. (2012). An Improved NN Training Scheme Using Two-Stage LDA Features for Face Recognition. In: Huang, T., Zeng, Z., Li, C., Leung, C.S. (eds) Neural Information Processing. ICONIP 2012. Lecture Notes in Computer Science, vol 7667. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-34500-5_78
Download citation
DOI: https://doi.org/10.1007/978-3-642-34500-5_78
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-34499-2
Online ISBN: 978-3-642-34500-5
eBook Packages: Computer ScienceComputer Science (R0)