skip to main content
10.1145/3340531.3412738acmconferencesArticle/Chapter ViewAbstractPublication PagescikmConference Proceedingsconference-collections
research-article

Price Forecast with High-Frequency Finance Data: An Autoregressive Recurrent Neural Network Model with Technical Indicators

Published: 19 October 2020 Publication History

Abstract

The availability of high-frequency trade data has made it possible for the intraday forecast of price patterns. With the help of technical indicators, recent studies have shown that LSTM based deep learning models are able to predict price directions (a binary classification problem) with performance better than a random guess. However, only naive recurrent networks were adopted, and these works did not compare with the tools used by finance practitioners. Our experiments show that GARCH beats their LSTM models by a large margin.
We propose to adopt an autoregressive recurrent network instead so that the loss of the prediction at every time step contributes to the model training; we also treat a rich set of technical indicators at each time step as covariates to enhance the model input. Finally, we treat the problem of price pattern forecast as a regression problem on the price itself; even for price direction prediction, we show that our performance is much better than if we model the problem as binary classification. We show that only when all these designs are adopted, an LSTM model can beat GARCH (and by a large margin).
This work corrects the poor use of LSTM networks in recent studies, and provides "the" baseline that is able to fully unleash the power of LSTM for future work to compare with. Moreover, since our model is a price regressor with very good prediction performance, it can serve as a valuable tool for designing trading strategies (including day trading). Our model has been used by quantitative analysts in Freddie Mac for over one quarter, and is found to be more effective than traditional GARCH variants in market prediction.

Supplementary Material

MOV File (3340531.3412738.mov)
This is a short 10-minute video presentation of our CIKM 2020 paper titled "Price Forecast with High-Frequency Finance Data: An Autoregressive Recurrent Neural Network Model with Technical Indicators"

References

[1]
Lei Jimmy Ba, Jamie Ryan Kiros, and Geoffrey E. Hinton. Layer normalization. CoRR, abs/1607.06450, 2016.
[2]
Wei Bao, Jun Yue, and Yulei Rao. A deep learning framework for financial time series using stacked autoencoders and long-short term memory. PloS one, 12(7):e0180944, 2017.
[3]
Tim Bollerslev. Financial econometrics: Past developments and future challenges. Journal of econometrics, 100(1):41--51, 2001.
[4]
Svetlana Borovkova and Ioannis Tsiamas. An ensemble of lstm neural networks for high-frequency stock market classification. Journal of Forecasting, 2019.
[5]
Kyunghyun Cho, Bart van Merrienboer, Dzmitry Bahdanau, and Yoshua Bengio. On the properties of neural machine translation: Encoder-decoder approaches. In SSST@EMNLP, pages 103--111, 2014.
[6]
Feike C Drost and Theo E Nijman. Temporal aggregation of garch processes. Econometrica: Journal of the Econometric Society, pages 909--927, 1993.
[7]
Bryan Ellickson, Miao Sun, Duke Whang, and Sibo Yan. Estimating a local heston model. SSRN 3108822, 2018.
[8]
Valentin Flunkert, David Salinas, and Jan Gasthaus. Deepar: Probabilistic forecasting with autoregressive recurrent networks. CoRR, abs/1704.04110, 2017.
[9]
Jan Gasthaus, Konstantinos Benidis, Yuyang Wang, Syama Sundar Rangapuram, David Salinas, Valentin Flunkert, and Tim Januschowski. Probabilistic forecasting with spline quantile function rnns. In AISTATS, pages 1901--1910, 2019.
[10]
Sepp Hochreiter and Jürgen Schmidhuber. Long short-term memory. Neural Computation, 9(8):1735--1780, 1997.
[11]
Sergey Ioffe and Christian Szegedy. Batch normalization: Accelerating deep network training by reducing internal covariate shift. In Proceedings of the 32nd International Conference on Machine Learning, ICML 2015, Lille, France, 6-11 July 2015, pages 448--456, 2015.
[12]
Taewook Kim and Ha Young Kim. Forecasting stock prices with a feature fusion lstm-cnn model using different representations of the same data. PloS one, 14(2):e0212320, 2019.
[13]
Diederik P. Kingma and Jimmy Ba. Adam: A method for stochastic optimization. In 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, May 7-9, 2015, Conference Track Proceedings, 2015.
[14]
Anshul Mittal and Arpit Goel. Stock prediction using twitter sentiment analysis. Standford University, CS229, 15, 2012.
[15]
David M. Q. Nelson, Adriano C. M. Pereira, and Renato A. de Oliveira. Stock market's price movement prediction with LSTM neural networks. In IJCNN, pages 1419--1426, 2017.
[16]
Zi Qi, Zhan Bu, Xi Xiong, Hongliang Sun, Jie Cao, and Chengcui Zhang. A stock index prediction framework: Integrating technical and topological mesoscale indicators. In IRI, pages 23--30, 2019.
[17]
Syama Sundar Rangapuram, Matthias W. Seeger, Jan Gasthaus, Lorenzo Stella, Yuyang Wang, and Tim Januschowski. Deep state space models for time series forecasting. In NeurIPS, pages 7796--7805, 2018.
[18]
Thársis TP Souza and Tomaso Aste. Predicting future stock market structure by combining social and financial network information. Physica A: Statistical Mechanics and its Applications, 535:122343, 2019.
[19]
Lan Zhang, Per A Mykland, and Yacine Aït-Sahalia. A tale of two time scales: Determining integrated volatility with noisy high-frequency data. Journal of the American Statistical Association, 100(472):1394--1411, 2005.
[20]
Zihao Zhang, Stefan Zohren, and Stephen J. Roberts. Deeplob: Deep convolutional neural networks for limit order books. IEEE Trans. Signal Processing, 67(11):3001--3012, 2019.

Cited By

View all
  • (2024)Many-to-Many Prediction for Effective Modeling of Frequent Label Transitions in Time SeriesProceedings of the 17th International Conference on PErvasive Technologies Related to Assistive Environments10.1145/3652037.3652049(265-272)Online publication date: 26-Jun-2024
  • (2024)MANA-Net: Mitigating Aggregated Sentiment Homogenization with News Weighting for Enhanced Market PredictionProceedings of the 33rd ACM International Conference on Information and Knowledge Management10.1145/3627673.3679653(2379-2389)Online publication date: 21-Oct-2024
  • (2024)LEVER: Online Adaptive Sequence Learning Framework for High-Frequency TradingIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2023.333618536:11(6547-6559)Online publication date: Nov-2024
  • Show More Cited By

Index Terms

  1. Price Forecast with High-Frequency Finance Data: An Autoregressive Recurrent Neural Network Model with Technical Indicators

        Recommendations

        Comments

        Information & Contributors

        Information

        Published In

        cover image ACM Conferences
        CIKM '20: Proceedings of the 29th ACM International Conference on Information & Knowledge Management
        October 2020
        3619 pages
        ISBN:9781450368599
        DOI:10.1145/3340531
        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Sponsors

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        Published: 19 October 2020

        Permissions

        Request permissions for this article.

        Check for updates

        Author Tags

        1. autoregressive
        2. garch
        3. high-frequency
        4. recurrent neural network
        5. stock price
        6. technical indicators

        Qualifiers

        • Research-article

        Funding Sources

        • National Science Foundation

        Conference

        CIKM '20
        Sponsor:

        Acceptance Rates

        Overall Acceptance Rate 1,861 of 8,427 submissions, 22%

        Upcoming Conference

        CIKM '25

        Contributors

        Other Metrics

        Bibliometrics & Citations

        Bibliometrics

        Article Metrics

        • Downloads (Last 12 months)66
        • Downloads (Last 6 weeks)16
        Reflects downloads up to 01 Mar 2025

        Other Metrics

        Citations

        Cited By

        View all
        • (2024)Many-to-Many Prediction for Effective Modeling of Frequent Label Transitions in Time SeriesProceedings of the 17th International Conference on PErvasive Technologies Related to Assistive Environments10.1145/3652037.3652049(265-272)Online publication date: 26-Jun-2024
        • (2024)MANA-Net: Mitigating Aggregated Sentiment Homogenization with News Weighting for Enhanced Market PredictionProceedings of the 33rd ACM International Conference on Information and Knowledge Management10.1145/3627673.3679653(2379-2389)Online publication date: 21-Oct-2024
        • (2024)LEVER: Online Adaptive Sequence Learning Framework for High-Frequency TradingIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2023.333618536:11(6547-6559)Online publication date: Nov-2024
        • (2024)Financial Market Volatility Forecasting Based on Domain Adaptation2024 International Joint Conference on Neural Networks (IJCNN)10.1109/IJCNN60899.2024.10651321(1-8)Online publication date: 30-Jun-2024
        • (2024)A decomposition-ensemble-integration framework for carbon price forecastingExpert Systems with Applications: An International Journal10.1016/j.eswa.2024.124954257:COnline publication date: 10-Dec-2024
        • (2023)AI-Driven Health Advice: Evaluating the Potential of Large Language Models as Health AssistantsJournal of Computational Methods in Engineering Applications10.62836/jcmea.v3i1.030106(1-7)Online publication date: 6-Nov-2023
        • (2023)Exploring the Factors of Supply Chain Concentration in Chinese A-Share Listed EnterprisesJournal of Computational Methods in Engineering Applications10.62836/jcmea.v3i1.030105(1-17)Online publication date: 6-Nov-2023
        • (2023)Efficient Integration of Multi-Order Dynamics and Internal Dynamics in Stock Movement PredictionProceedings of the Sixteenth ACM International Conference on Web Search and Data Mining10.1145/3539597.3570427(850-858)Online publication date: 27-Feb-2023
        • (2023)Finformer: A Static-dynamic Spatiotemporal Framework for Stock Trend Prediction2023 IEEE International Conference on Big Data (BigData)10.1109/BigData59044.2023.10386751(1460-1469)Online publication date: 15-Dec-2023
        • (2023)An improved DenseNet model for prediction of stock market using stock technical indicatorsExpert Systems with Applications10.1016/j.eswa.2023.120903232(120903)Online publication date: Dec-2023
        • Show More Cited By

        View Options

        Login options

        View options

        PDF

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        Figures

        Tables

        Media

        Share

        Share

        Share this Publication link

        Share on social media