Abstract
In this work, we study the online time series forecasting problem using artificial neural network. To solve this problem, different online DCAs (Difference of Convex functions Algorithms) are investigated. We also give comparison with online gradient descent—the online version of one of the most popular optimization algorithm in the collection of neural network problems. Numerical experiments on some benchmark time series datasets validate the efficiency of the proposed methods.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
References
Anders, U., Korn, O., Schmitt, C.: Improving the pricing of options: a neural network approach. J. Forecast. 17(5–6), 369–388 (1998)
Box, G.E., Jenkins, G.M., Reinsel, G.C., Ljung, G.M.: Time series analysis: forecasting and control. Wiley (2015)
Ho, V.T., Le Thi, H.A., Bui Dinh, C.: Online DC optimization for online binary linear classification. In: Nguyen, N.T., Trawiński, B., Fujita, H., Hong, T.P. (eds.) Intelligent Information and Database Systems, pp. 661–670. Springer, Berlin (2016)
Hornik, K.: Some new results on neural network approximation. Neural Netw. 6(8), 1069–1072 (1993)
Hornik, K., Stinchcombe, M., White, H.: Multilayer feedforward networks are universal approximators. Neural Netw. 2(5), 359–366 (1989)
Kantz, H., Schreiber, T.: Nonlinear Time Series Analysis, vol. 7. Cambridge University Press (2004)
Le Thi, H.A., Pham Dinh, T.: The DC (Difference of Convex functions) programming and DCA revisited with DC models of real world nonconvex optimization problems. Ann. Oper. Res. 133(1), 23–46 (2005)
Le Thi, H.A., Pham Dinh, T.: DC programming and DCA: thirty years of developments. Math. Program. 169(1), 5–68 (2018)
LeCun, Y., Bengio, Y., Hinton, G.: Deep learning. Nature 521(7553), 436–444 (2015)
Li, Y., Yuan, Y.: Convergence analysis of two-layer neural networks with ReLU activation. In: Advances in Neural Information Processing Systems, pp. 597–607 (2017)
Medeiros, M.C., Teräsvirta, T., Rech, G.: Building neural network models for time series: a statistical approach. J. Forecast. 25(1), 49–75 (2006)
Pan, X., Srikumar, V.: Expressiveness of rectifier networks. In: Proceedings of the 33rd International Conference on International Conference on Machine Learning. ICML’16, vol. 48, pp. 2427–2435. JMLR.org (2016)
Pham Dinh, T., Le Thi, H.A.: Convex analysis approach to d.c. programming: theory, algorithm and applications. Acta Math. Vietnam. 22(01) (1997)
Shalev-Shwartz, S., Singer, Y.: Online learning: Theory, Algorithms, and Applications (2007)
Shumway, R.H., Stoffer, D.S.: Time Series Analysis and its Applications (Springer Texts in Statistics). Springer, Berlin (2005)
Yule, G.U.: On a method of investigating periodicities in disturbed series, with special reference to Wolfer’s sunspot numbers. In: Philosophical Transactions of the Royal Society of London. Series A, Containing Papers of a Mathematical or Physical Character, vol. 226, pp. 267–298 (1927)
Zinkevich, M.: Online convex programming and generalized infinitesimal gradient ascent. In: Proceedings of the 20th International Conference on Machine Learning (ICML-03), pp. 928–936 (2003)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Nguyen, V.A., Le Thi, H.A. (2020). Online DCA for Times Series Forecasting Using Artificial Neural Network. In: Le Thi, H., Le, H., Pham Dinh, T. (eds) Optimization of Complex Systems: Theory, Models, Algorithms and Applications. WCGO 2019. Advances in Intelligent Systems and Computing, vol 991. Springer, Cham. https://doi.org/10.1007/978-3-030-21803-4_33
Download citation
DOI: https://doi.org/10.1007/978-3-030-21803-4_33
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-21802-7
Online ISBN: 978-3-030-21803-4
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)