Skip to main content
Log in

Model Averaging Multistep Prediction in an Infinite Order Autoregressive Process

  • Published:
Journal of Systems Science and Complexity Aims and scope Submit manuscript

Abstract

The key issue in the frequentist model averaging is the choice of weights. In this paper, the authors advocate an asymptotic framework of mean-squared prediction error (MSPE) and develop a model averaging criterion for multistep prediction in an infinite order autoregressive (AR(∞)) process. Under the assumption that the order of the candidate model is bounded, this criterion is proved to be asymptotically optimal, in the sense of achieving the lowest out of sample MSPE for the same-realization prediction. Simulations and real data analysis further demonstrate the effectiveness and the efficiency of the theoretical results.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Hannan E J, The estimation of mixed moving averaging autoregressive systems, Biometrika, 1969, 56: 579–593.

    Article  MathSciNet  Google Scholar 

  2. Box G and Jenkins G, Time Series Analysis: Forecasting and Control, Holden-Day, San Francisco, 1970.

    MATH  Google Scholar 

  3. Parzen E, Some recent advances in time series modeling, IEEE Trans. Automatic Control, 1974, 19(6): 723–730.

    Article  MathSciNet  Google Scholar 

  4. Anderson T, Estimation for autoregressive moving average models in the time and frequency domains, The Annals of Statistics, 1977, 5(5): 842–865.

    Article  MathSciNet  Google Scholar 

  5. Hamilton J D, Time Series Analysis, Princeton University Press, Princeton, 1994.

    Book  Google Scholar 

  6. Shibata R, Asymptotically efficient selection of the order of the model for estimating parameters of a linear process, The Annals of Statistics, 1980, 8(1): 147–164.

    Article  MathSciNet  Google Scholar 

  7. Burnham K P and Anderson D R, Model Selection and Multimodel Inference: A Practical Information-Theoretic Approach, Springer, New York, 2002.

    MATH  Google Scholar 

  8. Ing C K and Wei C Z, Order selection for same-realization predictions in autoregressive processes, The Annals of Statistics, 2005, 33(5): 2423–2474.

    Article  MathSciNet  Google Scholar 

  9. Akaike H, Fitting autoregressive models for prediction, Annals of the Institute of Statistical Mathematics, 1969, 21(1): 243–247.

    Article  MathSciNet  Google Scholar 

  10. Akaike H, A new look at the statistical model identification, IEEE Trans. Automatic Control, 1974, 19(6): 716–723.

    Article  MathSciNet  Google Scholar 

  11. Ing C K, Multistep prediction in autoregressive processes, Econometric Theory, 2003, 19(2): 254–279.

    Article  MathSciNet  Google Scholar 

  12. Ing C K and Wei C Z, On same-realization prediction in an infinite-order autoregressive process, Journal of Multivariate Analysis, 2003, 85(1): 130–155.

    Article  MathSciNet  Google Scholar 

  13. Buckland S T, Burnham K P, and Augustin N H, Model selection: An intergral part of inference, Biometrika, 1997, 53: 603–618.

    Article  Google Scholar 

  14. Hansen B E, Least squares model averaging, Econometrica, 2007, 75(4): 1175–1189.

    Article  MathSciNet  Google Scholar 

  15. Hansen B E and Racine J S, Jackknife model averaging, Journal of Econometrics, 2012, 167(1): 38–46.

    Article  MathSciNet  Google Scholar 

  16. Zhang X Y, Yu D L, Zou G H, et al., Optimal model averaging estimation for generalized linear models and generalized linear mixed-effects models, Journal of the American Statistical Association, 2016, 111: 1775–1790.

    Article  MathSciNet  Google Scholar 

  17. Gao Y and Zhang X Y, Model averaging based on leave-subject-out cross-validation, Journal of Econometrics, 2016, 192(1): 139–151.

    Article  MathSciNet  Google Scholar 

  18. Jankar J, Mandal A, and Jie Y, Optimal crossover designs for generalized linear models, J. Stat. Theory Pract., 2020, 14(2): 23–50.

    Article  MathSciNet  Google Scholar 

  19. Gao Y, Zhang X Y, and Wang S Y, Frequentist model averaging for threshold models, Annals of the Institute of Statistical Mathematics, 2019, 71(2): 275–306.

    Article  MathSciNet  Google Scholar 

  20. Chen X P, Cai G H, Gao Y, et al., Asymptotic optimality of the nonnegative Garrote estimator under heteroscedastic errors, Journal of Systems Science & Complexity, 2020, 33(2): 545–562.

    Article  MathSciNet  Google Scholar 

  21. Shangwei Z, Yanyuan M, Wan A T K, et al., Model averaging in a multiplicative heteroscedastic model, Econometric Reviews, 2020, 39: 1100–1124.

    Article  MathSciNet  Google Scholar 

  22. Wan A T K, Zhang X Y, and Zou G H, Least squares model averaging by Mallows criterion, Journal of Econometrics, 2010, 156(2): 277–283.

    Article  MathSciNet  Google Scholar 

  23. Hansen B E, Least-squares forecast averaging, Journal of Econometrics, 2008, 146(2): 342–350.

    Article  MathSciNet  Google Scholar 

  24. Liao J, Zou G H, Gao Y, and et al., Model averaging prediction for time series models with a diverging number of parameters, Journal of Econometrics, 2020, 223(1): 190–221.

    Article  MathSciNet  Google Scholar 

  25. https://data.stats.gov.cn/easyquery.htm?cn=A01.

  26. Diebold F X and Mariano R S, Comparing predictive accuracy, Journal of Business and Economic Statistics, 1995, 13(3): 253–263.

    Google Scholar 

  27. Findley D F and Wei C Z, AIC overfitting principles and the boundedness of moments of inverse matrices for vector autogressions and related models, Journal of Multivariate Analysis, 2002, 83: 415–450.

    Article  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Tao Jiang.

Additional information

This research was supported by the National Natural Science Foundation of China under Grant No. 11971433, First Class Discipline of Zhejiang-A (Zhejiang Gongshang University-Statistics), the Characteristic & Preponderant Discipline of Key Construction Universities in Zhejiang Province (Zhejiang Gongshang University-Statistics), Collaborative Innovation Center of Statistical Data Engineering Technology & Application.

This paper was recommended for publication by Editor ZHANG Xinyu.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Yuan, H., Lin, P., Jiang, T. et al. Model Averaging Multistep Prediction in an Infinite Order Autoregressive Process. J Syst Sci Complex 35, 1875–1901 (2022). https://doi.org/10.1007/s11424-022-0311-9

Download citation

  • Received:

  • Revised:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11424-022-0311-9

Keywords

Navigation