Skip to main content

Hierarchical Mixtures of Autoregressive Models for Time-Series Modeling

  • Conference paper
  • First Online:
Artificial Neural Networks and Neural Information Processing — ICANN/ICONIP 2003 (ICANN 2003, ICONIP 2003)

Abstract

A hierarchical mixture of autoregressive (AR) models is proposed for the analysis of nonlinear time-series. The model is a decision tree with soft sigmoidal splits at the inner nodes and linear autoregressive models at the leaves. The global prediction of the mixture is a weighted average of the partial predictions from each of the AR models. The weights in this average are computed by the application of the hierarchy of soft splits at the inner nodes of the tree on the input, which consists in the vector of the delayed values of the time series. The weights can be interpreted as a priori probabilities that an example is generated by the AR model at that leaf. As an illustration of the flexibility and robustness of the models generated by these mixtures, an application to the analysis of a financial time-series is presented.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. M. I. Jordan and R. A. Jacobs. Hierarchical mixtures of experts and the EM algorithm. Neural Computation, 6:181–214, 1994.

    Article  Google Scholar 

  2. A. Suárez and J. F. Lutsko. Globally optimal fuzzy decision trees for classification and regression. IEEE Trans. on Pattern Analysis and Machine Intelligence, 21(12):1297–1311, 1999.

    Article  Google Scholar 

  3. V. Medina-Chico, A. Suárez, and J. F. Lutsko. Backpropagation in decision trees for regression. In Luc De Raedt and Peter Flach, editors, Lecture Notes in Artificial Intelligence: Proceedings of the 12th European Conference on Machine Learning, volume 2167, pages 348–359, Berlin, 2001. Springer.

    Google Scholar 

  4. M. I. Jordan and R. A. Jacobs. Adaptive mixtures of local experts. Neural Computation, 3:79–87, 1991.

    Article  Google Scholar 

  5. R. Jacobs and M. Tanner. Mixtures of X. In A. J. C. Sharkey, editor, Combining Artificial Neural Nets, pages 267–296, London, 1999. Springer.

    Google Scholar 

  6. C. Schittenkopf and G. Dorffner. Risk-neutral density extraction from option prices: Improved pricing with mixture density networks. IEEE Transactions on Neural Networks, 12(4):716–725, 2001.

    Article  MathSciNet  Google Scholar 

  7. A. S. Weigend, M. Mangeas, and A. N. Srivastava. Nonlinear gated experts for time series: Discovering regimes and avoiding overfitting. International Journal of Neural Systems, 6(4):373–399, 1995.

    Article  Google Scholar 

  8. C. S. Wong and W. K. Li. On a mixture autoregressive model. Journal of the Royal Statistical Society B, 62:95–115, 2000.

    Article  MATH  MathSciNet  Google Scholar 

  9. A. Suárez. Mixtures of autorregressive models for financial risk analysis. In J. R. Dorronsoro, editor, Lecture Notes in Computer Science: Artificial Neural Networks-ICANN 2002, volume 2167, pages 1186–1191, Berlin, 2002. Springer.

    Google Scholar 

  10. P. Jorion. Value at Risk: The new Benchmark for Controlling Market Risk. McGraw-Hill, New York, 1997.

    Google Scholar 

  11. E. Eberlein and U. Keller. Hyperbolic distributions in finance. Bernoulli, 1:281–299, 1995.

    Article  MATH  Google Scholar 

  12. J. Hull and A. White. Value at risk when daily changes in market variables are not normally distributed. Journal of Derivatives, 5(3):9–19, 1998.

    Google Scholar 

  13. P. Embrechts, C. Kluplelberg, and T. Mikosch. Modelling Extremal Events for Insurance and Finance. Springer-Verlag, Berlin, 1997.

    MATH  Google Scholar 

  14. H. Tong. Non-linear Time Series. A Dynamical System Approach. Oxford University Press, New York, 1996.

    Google Scholar 

  15. G. González-Rivera. Smooth transition GARCH models. Studies in Nonlinear Dynamics and Econometrics, 3:61–78, 1998.

    Article  Google Scholar 

  16. M. Rosenblatt. Remarks on a multivariate transformation. Annals of Mathematica Statistics, 23(3):470–472, 1952.

    Article  MathSciNet  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2003 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Vidal, C., Suárez, A. (2003). Hierarchical Mixtures of Autoregressive Models for Time-Series Modeling. In: Kaynak, O., Alpaydin, E., Oja, E., Xu, L. (eds) Artificial Neural Networks and Neural Information Processing — ICANN/ICONIP 2003. ICANN ICONIP 2003 2003. Lecture Notes in Computer Science, vol 2714. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-44989-2_71

Download citation

  • DOI: https://doi.org/10.1007/3-540-44989-2_71

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-40408-8

  • Online ISBN: 978-3-540-44989-8

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics