Abstract
Hierarchical time series is a set of time series organized by aggregation constraints and it is widely used in many real-world applications. Usually, hierarchical time series forecasting can be realized with a two-step method, in which all time series are forecasted independently and then the forecasting results are reconciled to satisfy aggregation consistency. However, these two-step methods have a high computational complexity and are unable to ensure optimal forecasts for all time series. In this paper, we propose a novel hierarchical forecasting approach to solve the above problems. Based on multi-task learning, we construct an integrated model that combines features of the bottom level series and the hierarchical structure. Then forecasts of all time series are output simultaneously and they are aggregated consistently. The model has the advantage of utilizing the correlation between time series. And the forecasting results are overall optimal by optimizing a global loss function. In order to avoid the curse of dimensionality as the number of time series grows larger, we further learn a sparse model with group sparsity and element-wise sparsity constraints according to data characteristics. The experimental results on simulation data and tourism data demonstrate that our method has a better overall performance while simplifying forecasting process.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Athanasopoulos, G., Ahmed, R.A., Hyndman, R.J.: Hierarchical forecasts for australian domestic tourism. Int. J. Forecast. 25(1), 146–166 (2009). https://doi.org/10.1016/j.ijforecast.2008.07.004
Athanasopoulos, G., Hyndman, R.J., Kourentzes, N., Petropoulos, F.: Forecasting with temporal hierarchies. Eur. J. Oper. Res. 262(1) (2017). https://doi.org/10.1016/j.ejor.2017.02.046
Box, G.E., Jenkins, G.M., Reinsel, G.C., Ljung, G.M.: Time Series Analysis: Forecasting and Control, 5nd edn. Wiley, New Jersey (2015). https://books.google.com/books?id=rNt5CgAAQBAJ
Canberra: Tourism forecasts. Technical report, Tourism Research Australia (2015). https://www.tra.gov.au/International/International-Tourism-Forecasts
Dunn, D.M., Williams, W.H., Dechaine, T.L.: Aggregate versus subaggregate models in local area forecasting. J. Am. Stat. Assoc. 71(353), 68–71 (1976). https://doi.org/10.1080/01621459.1976.10481478
Holt, C.C.: Forecasting seasonals and trends by exponentially weighted moving averages. Int. J. Forecast. 20(1), 5–10 (2004). https://doi.org/10.1016/j.ijforecast.2003.09.015
Hyndman, R.J.: forecast: Forecasting functions for time series and linear models (2019). http://pkg.robjhyndman.com/forecast
Hyndman, R.J., Ahmed, R.A., Athanasopoulos, G., Shang, H.L.: Optimal combination forecasts for hierarchical time series. Comput. Stat. Data Anal. 55(9), 2579–2589 (2011). https://doi.org/10.1016/j.csda.2011.03.006
Hyndman, R.J., Athanasopoulos, G., Shang, H.L.: hts: An R package for forecasting hierarchical or grouped time series (2018). https://pkg.earo.me/hts
Hyndman, R.J., Khandakar, Y.: Automatic time series forecasting: the forecast package for R. J. Stat. Softw. 26(3), 1–22 (2008). https://doi.org/10.18637/jss.v027.i03
Hyndman, R.J., Lee, A.J., Wang, E.: Fast computation of reconciled forecasts for hierarchical and grouped time series. Comput. Stat. Data Anal. 97, 16–32 (2016). https://doi.org/10.1016/j.csda.2015.11.007
Jalali, A., Sanghavi, S., Ruan, C., Ravikumar, P.K.: A dirty model for multi-task learning. In: 24th Annual Conference on Neural Information Processing Systems, Vancouver, British Columbia, Canada, pp. 964–972. Curran Associates Inc. (2010). http://papers.nips.cc/paper/4125-a-dirty-model-for-multi-task-learning
Nesterov, Y.: Gradient methods for minimizing composite functions. Math. Program. 140(1), 125–161 (2013). https://doi.org/10.1007/s10107-012-0629-5
Novak, J., Mcgarvie, S., Garcia, B.E.: A Bayesian model for forecasting hierarchically structured time series. arXiv preprint arXiv:1711.04738 (2017). https://arxiv.org/abs/1711.04738
Pang, Y., Yao, B., Zhou, X., Zhang, Y., Xu, Y., Tan, Z.: Hierarchical electricity time series forecasting for integrating consumption patterns analysis and aggregation consistency. In: 27th International Joint Conference on Artificial Intelligence, Stockholm, Sweden, pp. 3506–3512. ijcai.org (2018). https://doi.org/10.24963/ijcai.2018/487
Petersen, K.B., Pedersen, M.S.P.: The matrix cookbook. Technical University of Denmark 7(15), 510 (2008). https://doi.org/10.1.1.113.6244
Shlifer, E., Wolff, R.W.: Aggregation and proration in forecasting. Manag. Sci. 25(6), 594–603 (1979). https://doi.org/10.1287/mnsc.25.6.594
Taieb, S.B., Taylor, J.W., Hyndman, R.J.: Coherent probabilistic forecasts for hierarchical time series. In: 34th International Conference on Machine Learning, Sydney, NSW, Australia, pp. 3348–3357. PMLR (2017). http://dl.acm.org/citation.cfm?id=3305890.3306027
Taieb, S.B., Yu, J., Barreto, M.N., Rajagopal, R.: Regularization in hierarchical time series forecasting with application to electricity smart meter data. In: 31th AAAI Conference on Artificial Intelligence, San Francisco, California, USA, pp. 4474–4480. AAAI Press (2017). https://doi.org/10.1038/nature06229
Wickramasuriya, S.L., Athanasopoulos, G., Hyndman, R.J.: Optimal forecast reconciliation for hierarchical and grouped time series through trace minimization. J. Am. Stat. Assoc., 1–16 (2018). https://doi.org/10.1080/01621459.2018.1448825
Zellner, A., Tobias, J.: A note on aggregation, disaggregation and forecasting performance. J. Forecast. 19(5), 457–465 (2000). https://doi.org/10.1002/1099-131X(200009)19:5<457::AID-FOR761>3.0.CO;2-6
Acknowledgments
This work is supported by the National Natural Science Foundation of China under Grants 61732011, 61432011, and U1435212.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Yang, M., Hu, Q., Wang, Y. (2019). Multi-task Learning Method for Hierarchical Time Series Forecasting. In: Tetko, I., Kůrková, V., Karpov, P., Theis, F. (eds) Artificial Neural Networks and Machine Learning – ICANN 2019: Text and Time Series. ICANN 2019. Lecture Notes in Computer Science(), vol 11730. Springer, Cham. https://doi.org/10.1007/978-3-030-30490-4_38
Download citation
DOI: https://doi.org/10.1007/978-3-030-30490-4_38
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-30489-8
Online ISBN: 978-3-030-30490-4
eBook Packages: Computer ScienceComputer Science (R0)