Abstract
The aim of the paper is to develop hypothesis testing procedures both for variable selection and model adequacy to facilitate a model selection strategy for neural networks. The approach, based on statical inference tools, uses the subsampling to overcome the analytical and probabilistic difficulties related to the estimation of the sampling distribution of the test statistics involved. Some illustrative examples are also discussed.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Anders, U., Korn, O.: Model selection in neural networks. Neural Networks 12, 309–323 (1999)
Barron, A.R.: Universal approximation bounds for superposition of a sigmoidal function. IEEE Transactions on Information Theory 39, 930–945 (1993)
Cottrell, M., Girard, B., Girard, Y., Mangeas, M., Muller, C.: Neural modeling for time series: a statistical stepwise method for weight elimination. IEEE Transaction on Neural Networks 6, 1355–1364 (1995)
Fukumizu, K.: Likelihood Ratio of Unidentifiable Models and Multilayer Neural Networks. The Annals of Statistics 31, 833–851 (2003)
Hastie, T., Tibshirani, R., Friedman, J.: The Elements of Statistical Learning. Springer, Heidelberg
La Rocca, M., Perna, C.: Variable selection in neural network regression models with dependent data: a subsampling approach. Computational Statistics and Data Analysis 48, 415–419 (2005)
Lee, T.H., White, H., Granger, C.W.J.: Testing for neglected nonlinearity in time series models. Journal of Econometrics 56, 269–290 (1993)
Politis, D.N., Romano, J.P., Wolf, M.: Subsampling for heteroscedastic time series. Journal of Econometrics 81, 281–317 (1997)
Politis, D.N., Romano, J.P., Wolf, M.: Subsampling. Springer, NY (1999)
Reed, R.: Pruning algorithms-a survey. Neural Networks 4, 740–747 (1993)
Refenes, A.P.N., Zapranis, A.D.: Neural model identification, variable selection and model adeguacy. Journal of Forecasting 18, 299–332 (1999)
Teraesvirta, T., Lin, C.F., Granger, C.W.J.: Power of the Neural Network Linearity Test. Journal of Time Series Analysis 14, 209–220 (1993)
White, H., Racine, J.: Statistical Inference, The Bootstrap, and Neural-Network Modeling with Application to Foreign Exchange Rates. IEEE Transactions on Neural Networks 12, 657–673 (2001)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
La Rocca, M., Perna, C. (2005). Neural Network Modeling by Subsampling. In: Cabestany, J., Prieto, A., Sandoval, F. (eds) Computational Intelligence and Bioinspired Systems. IWANN 2005. Lecture Notes in Computer Science, vol 3512. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11494669_25
Download citation
DOI: https://doi.org/10.1007/11494669_25
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-26208-4
Online ISBN: 978-3-540-32106-4
eBook Packages: Computer ScienceComputer Science (R0)