Skip to main content

Short-Term Predictions and LIME-Based Rule Extraction for Standard and Poor’s Index

  • Conference paper
  • First Online:
Data Science (ICPCSEE 2020)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 1258))

  • 1326 Accesses

Abstract

In this paper, neural networks is proposed to predict the trend of the S.P. 500 index, comparing the effects of different data inputs and model types on the prediction results. Then the model was selected with good interpretation results to use the LIME interpretability algorithm to interpret the prediction results, and extract the prediction rules of the neural network model. It firstly compared three neural networks prediction models, including multi-layer perceptron (MLP), one-dimensional convolutional neural network (1D CNN) and long short-term memory (LSTM), with the price data, continuous technical indicators and discrete technical indicators of different time durations as inputs, and found the model and parameter configuration with good predicting effect for each type of inputs. In another aspect, the data of the first experiment was used, the rules were extracted in the model that predict the rise of the index by the LIME interpretability algorithm, and the rules with high investment utility were finally selected. The experimental result show high precision in predicting the trend of the stock index and high frequency of occurrence, with certain reference value for predicting the short-term index trend.

This work is supported by National Defense Science and Technology Innovation Special Zone Project (No. 18-163-11-ZT-002-045-04).

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Fama, E.F.: Random walks in stock market prices. Financ. Anal. J. 51(1), 75–80 (1995)

    Article  Google Scholar 

  2. Ribeiro, M.T., Singh, S., Guestrin, C.: “Why should i trust you?” Explaining the predictions of any classifier. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 1135–1144 (2016)

    Google Scholar 

  3. Xiaodan, L., Zhaodi, G., Liling, S., Maowei, H., Hanning, C.: LSTM with wavelet transform based data preprocessing for stock price prediction. Math. Probl. Eng. 2019 (2019)

    Google Scholar 

  4. Kumar, C.S.: Fusion model of wavelet transform and adaptive neuro fuzzy inference system for stock market prediction. J. Ambient Intell. Hum. Comput. (2019). https://doi.org/10.1007/s12652-019-01224-2

  5. Hong, C., Rongyao, C.: Research on stock price prediction based on PCA-BP neural network. Comput. Simul. 28(03), 365–368 (2011)

    Google Scholar 

  6. Fangzhong, Q., Shaoqian, L., Tingting, Y.: Stock price prediction model based on PCA and IFOA-BP neural network. Comput. Appl. Softw. 37(01), 116–121+156 (2020)

    Google Scholar 

  7. Sayavong, L.: Research on stock price prediction method based on convolutional neural network. In: Proceedings of 2019 International Conference on Virtual Reality and Intelligent Systems (ICVRIS 2019), vol. I, pp. 187–190 (2019)

    Google Scholar 

  8. Yu, P., Yan, X.: Stock price prediction based on deep neural networks. Neural Comput. Appl. 32(6), 1609–1628 (2019). https://doi.org/10.1007/s00521-019-04212-x

    Article  Google Scholar 

  9. Ruoyu, Q.: Stock forecasting model based on neural network. Oper. Manag. 28(10), 132–140 (2019)

    Google Scholar 

  10. Nelson, D.M.Q., Pereira, A.C.M., Oliveira, R.A.D.: Stock market’s price movement prediction with LSTM neural networks. In: 2017 International Joint Conference on Neural Networks (IJCNN), pp. 1419–1426. IEEE (2017)

    Google Scholar 

  11. Li, J., Chen, X., Hovy, E., et al.: Visualizing and understanding neural models in NLP. Comput. Sci. (2015)

    Google Scholar 

  12. Lundberg, S., Lee, S.I.: A unified approach to interpreting model predictions. In: 31st Conference on Neural Information Processing Systems (NIPS 2017), Long Beach, CA, USA (2017)

    Google Scholar 

  13. Rajab, S., Sharma, V.: An interpretable neuro-fuzzy approach to stock price forecasting. Soft. Comput. 23(3), 921–936 (2017). https://doi.org/10.1007/s00500-017-2800-7

    Article  Google Scholar 

  14. Wu, W., et al.: Preliminary study on interpreting stock price forecasting based on tree regularization of GRU. In: Mao, R., Wang, H., Xie, X., Lu, Z. (eds.) ICPCSEE 2019. CCIS, vol. 1059, pp. 476–487. Springer, Singapore (2019). https://doi.org/10.1007/978-981-15-0121-0_37

    Chapter  Google Scholar 

  15. Yakup, K., Melek, A.B., Ömer, K.B.: Predicting direction of stock price index movement using artificial neural networks and support vector machines: The sample of the Istanbul stock exchange. Expert Syst. Appl. 38(5), 5311–5319 (2011)

    Article  Google Scholar 

  16. Patel, J., Shah, S., Thakkar, P., et al.: Predicting stock and stock price index movement using trend deterministic data preparation and machine learning techniques. Expert Syst. Appl. 42(1), 259–268 (2015)

    Article  Google Scholar 

  17. Fei, W., Binbing, L., Yahong, H.: Interpretability of deep learning. Weapons Aviat. 26(01), 39–46 (2019)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Yue Wang .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Qi, C., Wang, Y., Wu, W., Wang, X. (2020). Short-Term Predictions and LIME-Based Rule Extraction for Standard and Poor’s Index. In: Qin, P., Wang, H., Sun, G., Lu, Z. (eds) Data Science. ICPCSEE 2020. Communications in Computer and Information Science, vol 1258. Springer, Singapore. https://doi.org/10.1007/978-981-15-7984-4_24

Download citation

  • DOI: https://doi.org/10.1007/978-981-15-7984-4_24

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-15-7983-7

  • Online ISBN: 978-981-15-7984-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics