Abstract
A concise ordinary differential equations (ODE) for eigen-decomposition problem of a symmetric positive matrix is proposed in this paper. Stability properties of the proposed ODE is obtained by the theory of first order approximation. Novel coupled neural network (CNN) algorithm for principal component analysis (PCA) is obtained based on this concise ODE model. Compared with most non-coupled neural PCA algorithms, the proposed online CNN algorithm works in a recursive manner and simultaneously estimates eigenvalue and eigenvector adaptively. Due to the fact the proposed CNN effectively makes use of online eigenvalue estimate during learning process, it reaches a fast convergence speed, which is further verified by the numerical experiment result. Adaptive algorithm for sequential extraction of subsequent principal components is also obtained by means of deflation techniques.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Oja, E.: Principal Components, Minor Components, and Linear Neural Networks. Neural Networks 5, 927–935 (1992)
Sanger, T.D.: Optimal Unsuperwised Learning in a Single-layer Linear Feedforward Neural Network. Neural Networks 2, 459–473 (1989)
Diamantaras, K.I., Kung, S.Y.: Principal Component Neural Networks—Theory and Applications. Wiley, New York (1996)
Xu, L., Yuille, A.L.: Robust Principal Component Analysis by Self-organizing Rules Based on Statistical Physics Approach. IEEE Trans. on Neural Networks 6, 131–143 (1995)
Chen, L., Chang, S.: An Adaptive Learning Algorithm for Principal Component Analysis. IEEE Trans. on Neural Networks 6, 1255–1263 (1995)
Cichocki, A., Kasprzak, W., Skarbek, W.: Adaptive Learning Algorithm for Principal Component Analysis with Partial Data. Proc. Cybernetics Syst. 2, 1014–1019 (1996)
Bannour, S., Azimi-Sadjadi, M.R.: Principal Component Extraction Using Recursive Least Squares Learning. IEEE Trans. on Neural Networks 6, 457–469 (1995)
Moller, R., Konies, A.: Coupled Principal Component Analysis. IEEE Trans. on Neural Networks 15, 214–222 (2004)
Yang, B.: Projection Approximation Subspace Tracking. IEEE Trans. on Signal Processing 43, 95–107 (1995)
Ouyang, S., Bao, Z.: Robust Recursive Least Squares Learing Algorithm for Principal Component Analysis. IEEE Trans. on Neural Netorks 11, 215–221 (2000)
Hou, L., Chen, T.P.: Online Algorithm of Coupled Principal (Minor) Component Analysis. Journal of Fudan University 45, 158–168 (2006)
Hua, Y.B., Xiang, Y., Chen, T.P.: A new Look at the Power Method for Fast Subspace Tracking. Digital Signal Processing 9, 207–314 (1999)
Ouyang, S., Bao, Z.: Fast Principal Component Extraction by a Weighted Information Criterion. IEEE Trans. on Neural Networks 11, 215–221 (2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Liu, L., Tie, J., Qiu, T. (2008). Concise Coupled Neural Network Algorithm for Principal Component Analysis. In: Sun, F., Zhang, J., Tan, Y., Cao, J., Yu, W. (eds) Advances in Neural Networks - ISNN 2008. ISNN 2008. Lecture Notes in Computer Science, vol 5263. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-87732-5_63
Download citation
DOI: https://doi.org/10.1007/978-3-540-87732-5_63
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-87731-8
Online ISBN: 978-3-540-87732-5
eBook Packages: Computer ScienceComputer Science (R0)