Skip to main content

Clustering-Based Cross-Sectional Regime Identification for Financial Market Forecasting

  • Conference paper
  • First Online:
Database and Expert Systems Applications (DEXA 2022)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 13427))

Included in the following conference series:

  • 790 Accesses

Abstract

Regime switching analysis is extensively advocated in many fields to capture complex behaviors underlying an ecosystem, such as the economic or financial system. A regime can be defined as a specific group of complex patterns that share common characteristics in a specific time interval. Regime switch, caused by external and/or internal drivers, refers to the changing behaviors exhibited by a system at a specific time point. The existing regime detection methods suffer from two drawbacks: they lack the capability to identify new regimes dynamically or they ignore the cross-sectional dependencies exhibited by time series data for the forecasting. This promoted us to devise a cluster-based regime identification model that can identify cross-sectional regimes dynamically with a time-varying transition probability, and capture cross-sectional dependencies underlying financial time series for market forecasting. Our approach makes use of a nonlinear model to account for the cross-sectional regime dependencies, neglected by most existing studies, that can improve the performance of a forecasting model significantly. Experimental results on both synthetic and real-world dataset demonstrate that our model outperforms state-of-the-art forecasting models.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 89.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 119.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://ca.finance.yahoo.com/.

References

  1. Alan, N.S., Engle, R.F., Karagozoglu, A.K.: Multi-regime forecasting model for the impact of COVID-19 pandemic on volatility in global equity markets. NYU Stern School of Business (2020)

    Google Scholar 

  2. Ali, G., et al.: EGARCH, GJR-GARCH, TGARCH, AVGARCH, NGARCH, IGARCH and APARCH models for pathogens at marine recreational sites. J. Stat. Econ. Methods 2(3), 57–73 (2013)

    Google Scholar 

  3. Ang, A., Timmermann, A.: Regime changes and financial markets. Annu. Rev. Financ. Econ. 4(1), 313–337 (2012)

    Article  Google Scholar 

  4. Baillie, R.T., Morana, C.: Modelling long memory and structural breaks in conditional variances: an adaptive FIGARCH approach. J. Econ. Dyn. Control 33(8), 1577–1592 (2009)

    Article  MathSciNet  Google Scholar 

  5. Banerjee, A., Urga, G.: Modelling structural breaks, long memory and stock market volatility: an overview. J. Econom. 129(1–2), 1–34 (2005)

    Article  MathSciNet  Google Scholar 

  6. Bollerslev, T., Engle, R.F., Nelson, D.B.: Arch models. Handb. Econom. 4, 2959–3038 (1994)

    MathSciNet  Google Scholar 

  7. Boudt, K., Paulus, E.C., Rosenthal, D.W.: Funding liquidity, market liquidity and ted spread: a two-regime model. J. Empir. Financ. 43, 143–158 (2017)

    Article  Google Scholar 

  8. Charfeddine, L., Khediri, K.B.: Financial development and environmental quality in UAE: cointegration with structural breaks. Renew. Sustain. Energy Rev. 55, 1322–1335 (2016)

    Article  Google Scholar 

  9. Cheng, D., Yang, F., Xiang, S., Liu, J.: Financial time series forecasting with multi-modality graph neural network. Pattern Recogn. 121, 108218 (2022)

    Article  Google Scholar 

  10. Christensen, B.J., Prabhala, N.R.: The relation between implied and realized volatility. J. Financ. Econ. 50(2), 125–150 (1998)

    Article  Google Scholar 

  11. Faniband, M., Faniband, T.: Government bonds and stock market: volatility spillover effect. Indian J. Res. Capital Markets 8(1–2), 61–71 (2021)

    Article  Google Scholar 

  12. Hamilton, J.D.: A new approach to the economic analysis of nonstationary time series and the business cycle. Econometrica J. Econom. Soc. 357–384 (1989)

    Google Scholar 

  13. Hamilton, J.D.: Regime switching models. In: Durlauf, S.N., Blume, L.E. (eds.) Macroeconometrics and Time Series Analysis. TNPEC, pp. 202–209. Palgrave Macmillan UK, London (2010). https://doi.org/10.1057/9780230280830_23

  14. Hochstein, A., Ahn, H.I., Leung, Y.T., Denesuk, M.: Switching vector autoregressive models with higher-order regime dynamics application to prognostics and health management. In: 2014 International Conference on Prognostics and Health Management, pp. 1–10. IEEE (2014)

    Google Scholar 

  15. Hu, M., Wu, T., Weir, J.D.: An adaptive particle swarm optimization with multiple adaptive methods. IEEE Trans. Evol. Comput. 17(5), 705–720 (2012)

    Article  Google Scholar 

  16. Jackson, E.A.: Perspectives of Nonlinear Dynamics: Volume 1, vol. 1. CUP Archive (1989)

    Google Scholar 

  17. Lai, G., Chang, W.C., Yang, Y., Liu, H.: Modeling long-and short-term temporal patterns with deep neural networks. In: The 41st International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 95–104 (2018)

    Google Scholar 

  18. Li, J., Izakian, H., Pedrycz, W., Jamal, I.: Clustering-based anomaly detection in multivariate time series data. Appl. Soft Comput. 100, 106919 (2021)

    Article  Google Scholar 

  19. Liu, Y., Gong, C., Yang, L., Chen, Y.: DSTP-RNN: a dual-stage two-phase attention-based recurrent neural network for long-term and multivariate time series prediction. Expert Syst. Appl. 143, 113082 (2020)

    Article  Google Scholar 

  20. Lütkepohl, H.: Forecasting with VARMA models. Handb. Econ. Forecast. 1, 287–325 (2006)

    Article  Google Scholar 

  21. Mahmoudi, M., Ghaneei, H.: Detection of structural regimes and analyzing the impact of crude oil market on Canadian stock market: Markov regime-switching approach. Studies in Economics and Finance (2022)

    Google Scholar 

  22. Makridakis, S.: Accuracy measures: theoretical and practical concerns. Int. J. Forecast. 9(4), 527–529 (1993)

    Article  Google Scholar 

  23. Matsubara, Y., Sakurai, Y.: Regime shifts in streams: real-time forecasting of co-evolving time sequences. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 1045–1054. ACM (2016)

    Google Scholar 

  24. Rousseeuw, P.J.: Silhouettes: a graphical aid to the interpretation and validation of cluster analysis. J. Comput. Appl. Math. 20, 53–65 (1987)

    Article  Google Scholar 

  25. Sanquer, M., Chatelain, F., El-Guedri, M., Martin, N.: A smooth transition model for multiple-regime time series. IEEE Trans. Signal Process. 61(7), 1835–1847 (2012)

    Article  MathSciNet  Google Scholar 

  26. Scheffer, M., Carpenter, S., Foley, J.A., Folke, C., Walker, B.: Catastrophic shifts in ecosystems. Nature 413(6856), 591 (2001)

    Article  Google Scholar 

  27. Shih, S.Y., Sun, F.K., Lee, H.Y.: Temporal pattern attention for multivariate time series forecasting. Mach. Learn. 108(8), 1421–1441 (2019)

    Article  MathSciNet  Google Scholar 

  28. Tajeuna, E.G., Bouguessa, M., Wang, S.: Modeling regime shifts in multiple time series. arXiv preprint arXiv:2109.09692 (2021)

  29. Yu, H.F., Rao, N., Dhillon, I.S.: Temporal regularized matrix factorization for high-dimensional time series prediction. In: Advances in Neural Information Processing Systems 29 (2016)

    Google Scholar 

  30. Zhan, Z.H., Zhang, J., Li, Y., Chung, H.S.H.: Adaptive particle swarm optimization. IEEE Trans. Syst. Man Cybern. Part B (Cybern.) 39(6), 1362–1381 (2009)

    Google Scholar 

  31. Zhang, G.P.: Time series forecasting using a hybrid ARIMA and neural network model. Neurocomputing 50, 159–175 (2003)

    Article  Google Scholar 

Download references

Acknowledgements

This work was supported by NSERC CRD - Quebec Prompt - Laplace Insights - EAM - joint program under the grants CRDPJ 537461-18 and 114-IA-Wang-DRC 2019 to S. Wang and Chinese Scholarship Council scholarship to R. Chen.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Shengrui Wang .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Chen, R., Sun, M., Xu, K., Patenaude, JM., Wang, S. (2022). Clustering-Based Cross-Sectional Regime Identification for Financial Market Forecasting. In: Strauss, C., Cuzzocrea, A., Kotsis, G., Tjoa, A.M., Khalil, I. (eds) Database and Expert Systems Applications. DEXA 2022. Lecture Notes in Computer Science, vol 13427. Springer, Cham. https://doi.org/10.1007/978-3-031-12426-6_1

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-12426-6_1

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-12425-9

  • Online ISBN: 978-3-031-12426-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics