Abstract
Since 1990s, many literatures have shown that connectionist models, such as back propagation, recurrent network, and RBF (Radial Basis Function) outperform the traditional models, MA (Moving Average), AR (Auto Regressive), and ARIMA (Auto Regressive Integrated Moving Average) in time series prediction. Neural based approaches to time series prediction require the enough length of historical measurements to generate the enough number of training patterns. The more training patterns, the better the generalization of MLP is. The researches about the schemes of generating artificial training patterns and adding to the original ones have been progressed and gave me the motivation of developing VTG schemes in 1996. Virtual term is an estimated measurement, X(t+0.5) between X(t) and X(t+1), while the given measurements in the series are called actual terms. VTG (Virtual Term Generation) is the process of estimating of X(t+0.5), and VTG schemes are the techniques for the estimation of virtual terms. In this paper, the alternative VTG schemes to the VTG schemes proposed in 1996 will be proposed and applied to multivariate time series prediction. The VTG schemes proposed in 1996 are called deterministic VTG schemes, while the alternative ones are called stochastic VTG schemes in this paper.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Box, G.E.P., Jekins, G.M., Reisel, G.C.: Time Series prediction. Prentice-Hall, Englewood Cliffs (1994)
Haykine, S.: Neural Networks. Macmillan Colledge Publishing Company, Basingstoke (1994)
Weigend, A.S., Rumelhart, D.E.: Generalization through Minimal Networks with Application to Forecasting. In: The Proceedings of 23rd Interface, pp. 362–370 (1991)
Kohzadi, N., Boyd, M.S., Kermanshahi, B., Kaastra, I.: A comparison of artificial neural network and time series models for forecasting commodity process. Neurocomputing 10(2), 169–181 (1996)
Brownstone, D.: Using percentage accuracy to measure neural network prediction on Stock Market movements. Neurocomputing 10(3), 237–250 (1996)
Malliaris, M.: Using neural networks to forecast the S&P 100 implied volatility. Neurocomputing 10(2), 183–195 (1996)
Levin, A.U.: Stock Selection via Nonlinear Multi-Layer-Factor Models. Neural Information Processing Systems 8, 966–972 (1996)
Ghosn, J., Bengio, Y.: Multi-Task Learning for Stock Selection. Neural Information Processing Systems 9, 947–952 (1997)
Abu-Mustafa, Y.S.: A Method for Learning from Hints. Neural Information Processing Systems 5, 73–80 (1993)
Abu-Mustafa, Y.S.: Financial Application of Learning from Hints. Neural Information Processing Systems 7, 411–418 (1995)
Cohn, D.A., Ghahramami, Z., Jordan, M.J.: Active Learning with Statistical Models. Neural Information Processing Systems 6, 705–712 (1994)
Krogh, M., Vedelsby, J.: Neural Network Ensembles, Cross Validation, and Active Learning. Neural Information Processing Systems 7, 231–238 (1995)
An, G.: The Effects of Adding Noise During Backpropagation Training on a Generalization Performance. Neural Computation 7, 643–674 (1996)
Cho, S., Jang, M., Chang, S.: Virtual Sample Generation using a Population of Network. Neural Processing Letters 5(2), 83–89 (1996)
Saad, D., Solla, S.A.: Learning with Noise and Regularizers in Multilayer Neural Networks. Neural Information Processing Systems 9, 260–266 (1997)
Grandvalet, Y., Canu, S., Boucheron, S.: Noise Injection: Theoretical Prospects. Neural Computation 9, 1093–1108 (1997)
Jo, T., Cho, S.: Time Series Prediction using Virtual Term Generation Scheme. In: The Proceedings of ITC-CSCC 1996, pp. 1282–1285 (1996)
Jo, T.: The Prediction of the Annual Number of Sunspots with Virtual Terms Generation Schemes. In: The Proceeding of PACES/SPICIS 1997, pp. 135–141 (1997)
Jo, T.: The Connectionist Approach to Multi Variables Forecasting of Precipitation with Virtual Term Generation Schemes. In: The Proceedings of IEEE IJCNN 1998, pp. 2531–2534 (1998)
Jo, T.: Neural Approach to Forecasting of S&P 500 Stock Price Index with Virtual Term Generation. In: The Proceedings of International Conference on Artificial Intelligence 1999, pp. 502–507 (1999)
Chakraborty, K., Mehrotra, K., Mohan, C.K., Ranka, S.: Forecasting the Behavior of Multivariate Time Series using Neural Network. Neural Network 5, 961–970 (1992)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Jo, T. (2004). The Effect of Deterministic and Stochastic VTG Schemes on the Application of Backpropagation to Multivariate Time Series Prediction. In: Orchard, B., Yang, C., Ali, M. (eds) Innovations in Applied Artificial Intelligence. IEA/AIE 2004. Lecture Notes in Computer Science(), vol 3029. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-24677-0_12
Download citation
DOI: https://doi.org/10.1007/978-3-540-24677-0_12
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-22007-7
Online ISBN: 978-3-540-24677-0
eBook Packages: Springer Book Archive