Abstract
This paper proposes an orthogonal least square algorithm based on QR decomposition (QR-OLS) for the neurons selection of the hidden layer of wavelet networks. This new algorithm divides the original neurons matrix into several parts to avoid comparing among the poor ones and uses QR decomposition to select the significant ones. It can avoid lots of meaningless calculation. This algorithm is applied to the wavelet network with the analysis of variance (ANOVA) expansion and one-step-ahead predictions, respectively, for the Mackey-Glass delay-differential equation and the annual sunspot data set. The results show that the QR-OLS algorithm can relieve the load of the heave calculation and has a good performance.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Robert, B.: Using Mutual Information for Selecting Features in Supervised Neural Net Learning. IEEE Transactions on Neural Networks 5(4), 537–550 (1994)
Gomm, J.B., Yu, D.L.: Order and Delay Selection for Neural Network Modelling by Identification of Linearized Models. International Journal of Systems Science 31(10), 1273–1283 (2000)
Alonge, F., D’lppolito, F., Raimondi, F.M.: System identification via optimized wavelet-based neural networks. IEEE Proc.-Control Theory Appl. 150(2), 147–154 (2003)
Billings, S.A., Wei, H.L.: A New Class of Wavelet Networks for Nonlinear System Identification. IEEE Transactions on Neural Networks 16(4), 862–874 (2005)
Cao, L.Y., Hong, Y.G., Fang, H.P., Hai, G.W.: Predicting Chaotic Time Series with Wavelet Networks. Physica D 85, 225–238 (1995)
Wei, H.L., Billings, S.A., Liu, J.: Term and Variable Selection for Nonlinear System Identification. Int. J. Control 77, 86–110 (2004)
Paulito, P.P., Taichi, H., Shiro, U.: Mutation-Based Genetic Neural Network. IEEE Transactions on Neural Networks 16(3), 587–600 (2005)
Achiya, D.: A modified Gram-Schmidt Algorithm with Iterrabive Orthogonalization and Column Pivoting. Linear Algebra and its Application 310, 25–42 (2005)
Ling, F.Y., Dimitrls, M., John, G.P.: A Recursive Modified Gram-Schmidt Algorithm for Least-Squares Estimation. IEEE Transactions on Acoustics, Speech, and Signal Processing 34(4), 829–836 (1986)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer Berlin Heidelberg
About this paper
Cite this paper
Han, M., Yin, J. (2007). Orthogonal Least Squares Based on QR Decomposition for Wavelet Networks. In: Liu, D., Fei, S., Hou, Z., Zhang, H., Sun, C. (eds) Advances in Neural Networks – ISNN 2007. ISNN 2007. Lecture Notes in Computer Science, vol 4492. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-72393-6_68
Download citation
DOI: https://doi.org/10.1007/978-3-540-72393-6_68
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-72392-9
Online ISBN: 978-3-540-72393-6
eBook Packages: Computer ScienceComputer Science (R0)