Abstract
The key issue in the frequentist model averaging is the choice of weights. In this paper, the authors advocate an asymptotic framework of mean-squared prediction error (MSPE) and develop a model averaging criterion for multistep prediction in an infinite order autoregressive (AR(∞)) process. Under the assumption that the order of the candidate model is bounded, this criterion is proved to be asymptotically optimal, in the sense of achieving the lowest out of sample MSPE for the same-realization prediction. Simulations and real data analysis further demonstrate the effectiveness and the efficiency of the theoretical results.
Similar content being viewed by others
References
Hannan E J, The estimation of mixed moving averaging autoregressive systems, Biometrika, 1969, 56: 579–593.
Box G and Jenkins G, Time Series Analysis: Forecasting and Control, Holden-Day, San Francisco, 1970.
Parzen E, Some recent advances in time series modeling, IEEE Trans. Automatic Control, 1974, 19(6): 723–730.
Anderson T, Estimation for autoregressive moving average models in the time and frequency domains, The Annals of Statistics, 1977, 5(5): 842–865.
Hamilton J D, Time Series Analysis, Princeton University Press, Princeton, 1994.
Shibata R, Asymptotically efficient selection of the order of the model for estimating parameters of a linear process, The Annals of Statistics, 1980, 8(1): 147–164.
Burnham K P and Anderson D R, Model Selection and Multimodel Inference: A Practical Information-Theoretic Approach, Springer, New York, 2002.
Ing C K and Wei C Z, Order selection for same-realization predictions in autoregressive processes, The Annals of Statistics, 2005, 33(5): 2423–2474.
Akaike H, Fitting autoregressive models for prediction, Annals of the Institute of Statistical Mathematics, 1969, 21(1): 243–247.
Akaike H, A new look at the statistical model identification, IEEE Trans. Automatic Control, 1974, 19(6): 716–723.
Ing C K, Multistep prediction in autoregressive processes, Econometric Theory, 2003, 19(2): 254–279.
Ing C K and Wei C Z, On same-realization prediction in an infinite-order autoregressive process, Journal of Multivariate Analysis, 2003, 85(1): 130–155.
Buckland S T, Burnham K P, and Augustin N H, Model selection: An intergral part of inference, Biometrika, 1997, 53: 603–618.
Hansen B E, Least squares model averaging, Econometrica, 2007, 75(4): 1175–1189.
Hansen B E and Racine J S, Jackknife model averaging, Journal of Econometrics, 2012, 167(1): 38–46.
Zhang X Y, Yu D L, Zou G H, et al., Optimal model averaging estimation for generalized linear models and generalized linear mixed-effects models, Journal of the American Statistical Association, 2016, 111: 1775–1790.
Gao Y and Zhang X Y, Model averaging based on leave-subject-out cross-validation, Journal of Econometrics, 2016, 192(1): 139–151.
Jankar J, Mandal A, and Jie Y, Optimal crossover designs for generalized linear models, J. Stat. Theory Pract., 2020, 14(2): 23–50.
Gao Y, Zhang X Y, and Wang S Y, Frequentist model averaging for threshold models, Annals of the Institute of Statistical Mathematics, 2019, 71(2): 275–306.
Chen X P, Cai G H, Gao Y, et al., Asymptotic optimality of the nonnegative Garrote estimator under heteroscedastic errors, Journal of Systems Science & Complexity, 2020, 33(2): 545–562.
Shangwei Z, Yanyuan M, Wan A T K, et al., Model averaging in a multiplicative heteroscedastic model, Econometric Reviews, 2020, 39: 1100–1124.
Wan A T K, Zhang X Y, and Zou G H, Least squares model averaging by Mallows criterion, Journal of Econometrics, 2010, 156(2): 277–283.
Hansen B E, Least-squares forecast averaging, Journal of Econometrics, 2008, 146(2): 342–350.
Liao J, Zou G H, Gao Y, and et al., Model averaging prediction for time series models with a diverging number of parameters, Journal of Econometrics, 2020, 223(1): 190–221.
Diebold F X and Mariano R S, Comparing predictive accuracy, Journal of Business and Economic Statistics, 1995, 13(3): 253–263.
Findley D F and Wei C Z, AIC overfitting principles and the boundedness of moments of inverse matrices for vector autogressions and related models, Journal of Multivariate Analysis, 2002, 83: 415–450.
Author information
Authors and Affiliations
Corresponding author
Additional information
This research was supported by the National Natural Science Foundation of China under Grant No. 11971433, First Class Discipline of Zhejiang-A (Zhejiang Gongshang University-Statistics), the Characteristic & Preponderant Discipline of Key Construction Universities in Zhejiang Province (Zhejiang Gongshang University-Statistics), Collaborative Innovation Center of Statistical Data Engineering Technology & Application.
This paper was recommended for publication by Editor ZHANG Xinyu.
Rights and permissions
About this article
Cite this article
Yuan, H., Lin, P., Jiang, T. et al. Model Averaging Multistep Prediction in an Infinite Order Autoregressive Process. J Syst Sci Complex 35, 1875–1901 (2022). https://doi.org/10.1007/s11424-022-0311-9
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11424-022-0311-9