Skip to main content

Multi-task Learning Method for Hierarchical Time Series Forecasting

  • Conference paper
  • First Online:
Artificial Neural Networks and Machine Learning – ICANN 2019: Text and Time Series (ICANN 2019)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 11730))

Included in the following conference series:

Abstract

Hierarchical time series is a set of time series organized by aggregation constraints and it is widely used in many real-world applications. Usually, hierarchical time series forecasting can be realized with a two-step method, in which all time series are forecasted independently and then the forecasting results are reconciled to satisfy aggregation consistency. However, these two-step methods have a high computational complexity and are unable to ensure optimal forecasts for all time series. In this paper, we propose a novel hierarchical forecasting approach to solve the above problems. Based on multi-task learning, we construct an integrated model that combines features of the bottom level series and the hierarchical structure. Then forecasts of all time series are output simultaneously and they are aggregated consistently. The model has the advantage of utilizing the correlation between time series. And the forecasting results are overall optimal by optimizing a global loss function. In order to avoid the curse of dimensionality as the number of time series grows larger, we further learn a sparse model with group sparsity and element-wise sparsity constraints according to data characteristics. The experimental results on simulation data and tourism data demonstrate that our method has a better overall performance while simplifying forecasting process.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Athanasopoulos, G., Ahmed, R.A., Hyndman, R.J.: Hierarchical forecasts for australian domestic tourism. Int. J. Forecast. 25(1), 146–166 (2009). https://doi.org/10.1016/j.ijforecast.2008.07.004

    Article  Google Scholar 

  2. Athanasopoulos, G., Hyndman, R.J., Kourentzes, N., Petropoulos, F.: Forecasting with temporal hierarchies. Eur. J. Oper. Res. 262(1) (2017). https://doi.org/10.1016/j.ejor.2017.02.046

    Article  MathSciNet  Google Scholar 

  3. Box, G.E., Jenkins, G.M., Reinsel, G.C., Ljung, G.M.: Time Series Analysis: Forecasting and Control, 5nd edn. Wiley, New Jersey (2015). https://books.google.com/books?id=rNt5CgAAQBAJ

  4. Canberra: Tourism forecasts. Technical report, Tourism Research Australia (2015). https://www.tra.gov.au/International/International-Tourism-Forecasts

  5. Dunn, D.M., Williams, W.H., Dechaine, T.L.: Aggregate versus subaggregate models in local area forecasting. J. Am. Stat. Assoc. 71(353), 68–71 (1976). https://doi.org/10.1080/01621459.1976.10481478

    Article  Google Scholar 

  6. Holt, C.C.: Forecasting seasonals and trends by exponentially weighted moving averages. Int. J. Forecast. 20(1), 5–10 (2004). https://doi.org/10.1016/j.ijforecast.2003.09.015

    Article  Google Scholar 

  7. Hyndman, R.J.: forecast: Forecasting functions for time series and linear models (2019). http://pkg.robjhyndman.com/forecast

  8. Hyndman, R.J., Ahmed, R.A., Athanasopoulos, G., Shang, H.L.: Optimal combination forecasts for hierarchical time series. Comput. Stat. Data Anal. 55(9), 2579–2589 (2011). https://doi.org/10.1016/j.csda.2011.03.006

    Article  MathSciNet  MATH  Google Scholar 

  9. Hyndman, R.J., Athanasopoulos, G., Shang, H.L.: hts: An R package for forecasting hierarchical or grouped time series (2018). https://pkg.earo.me/hts

  10. Hyndman, R.J., Khandakar, Y.: Automatic time series forecasting: the forecast package for R. J. Stat. Softw. 26(3), 1–22 (2008). https://doi.org/10.18637/jss.v027.i03

    Article  Google Scholar 

  11. Hyndman, R.J., Lee, A.J., Wang, E.: Fast computation of reconciled forecasts for hierarchical and grouped time series. Comput. Stat. Data Anal. 97, 16–32 (2016). https://doi.org/10.1016/j.csda.2015.11.007

    Article  MathSciNet  MATH  Google Scholar 

  12. Jalali, A., Sanghavi, S., Ruan, C., Ravikumar, P.K.: A dirty model for multi-task learning. In: 24th Annual Conference on Neural Information Processing Systems, Vancouver, British Columbia, Canada, pp. 964–972. Curran Associates Inc. (2010). http://papers.nips.cc/paper/4125-a-dirty-model-for-multi-task-learning

  13. Nesterov, Y.: Gradient methods for minimizing composite functions. Math. Program. 140(1), 125–161 (2013). https://doi.org/10.1007/s10107-012-0629-5

    Article  MathSciNet  MATH  Google Scholar 

  14. Novak, J., Mcgarvie, S., Garcia, B.E.: A Bayesian model for forecasting hierarchically structured time series. arXiv preprint arXiv:1711.04738 (2017). https://arxiv.org/abs/1711.04738

  15. Pang, Y., Yao, B., Zhou, X., Zhang, Y., Xu, Y., Tan, Z.: Hierarchical electricity time series forecasting for integrating consumption patterns analysis and aggregation consistency. In: 27th International Joint Conference on Artificial Intelligence, Stockholm, Sweden, pp. 3506–3512. ijcai.org (2018). https://doi.org/10.24963/ijcai.2018/487

  16. Petersen, K.B., Pedersen, M.S.P.: The matrix cookbook. Technical University of Denmark 7(15), 510 (2008). https://doi.org/10.1.1.113.6244

  17. Shlifer, E., Wolff, R.W.: Aggregation and proration in forecasting. Manag. Sci. 25(6), 594–603 (1979). https://doi.org/10.1287/mnsc.25.6.594

    Article  MATH  Google Scholar 

  18. Taieb, S.B., Taylor, J.W., Hyndman, R.J.: Coherent probabilistic forecasts for hierarchical time series. In: 34th International Conference on Machine Learning, Sydney, NSW, Australia, pp. 3348–3357. PMLR (2017). http://dl.acm.org/citation.cfm?id=3305890.3306027

  19. Taieb, S.B., Yu, J., Barreto, M.N., Rajagopal, R.: Regularization in hierarchical time series forecasting with application to electricity smart meter data. In: 31th AAAI Conference on Artificial Intelligence, San Francisco, California, USA, pp. 4474–4480. AAAI Press (2017). https://doi.org/10.1038/nature06229

    Article  Google Scholar 

  20. Wickramasuriya, S.L., Athanasopoulos, G., Hyndman, R.J.: Optimal forecast reconciliation for hierarchical and grouped time series through trace minimization. J. Am. Stat. Assoc., 1–16 (2018). https://doi.org/10.1080/01621459.2018.1448825

    Article  MathSciNet  Google Scholar 

  21. Zellner, A., Tobias, J.: A note on aggregation, disaggregation and forecasting performance. J. Forecast. 19(5), 457–465 (2000). https://doi.org/10.1002/1099-131X(200009)19:5<457::AID-FOR761>3.0.CO;2-6

    Article  Google Scholar 

Download references

Acknowledgments

This work is supported by the National Natural Science Foundation of China under Grants 61732011, 61432011, and U1435212.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Qinghua Hu .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Yang, M., Hu, Q., Wang, Y. (2019). Multi-task Learning Method for Hierarchical Time Series Forecasting. In: Tetko, I., Kůrková, V., Karpov, P., Theis, F. (eds) Artificial Neural Networks and Machine Learning – ICANN 2019: Text and Time Series. ICANN 2019. Lecture Notes in Computer Science(), vol 11730. Springer, Cham. https://doi.org/10.1007/978-3-030-30490-4_38

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-30490-4_38

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-30489-8

  • Online ISBN: 978-3-030-30490-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics