Abstract
The stock market has the characteristics of changing rapidly, having many interference factors, and yielding insufficient period data. Stock trading is a game process under incomplete information, and the single-objective supervised learning model is difficult to deal with such serialization decision problems. Reinforcement learning is one of the effective ways to solve these problems. This paper proposes an ISTG model (Intelligent Stock Trader and Gym) based on deep reinforcement learning, which integrates historical data, technical indicators, macroeconomic indicators, and other data types. The model describes evaluation criteria and control strategies. It processes long-period data, implements a replay model that can incrementally expand data and features, automatically calculate reward labels, constantly train intelligent traders, and moreover, proposes a method of directly calculating the single-step deterministic action values by price. Upon testing 1479 stocks with more than ten years’ data in the China stock market, ISTG’s overall revenue reaches 13%, which is better than overall - 7% of the buy-and-hold strategy.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Zhao, X., Ding, S.: Research on deep reinforcement learning. Comput. Sci. 45(7), 1–6 (2018)
Xie, Z., Wong, H., Ip, W.C.: Artificial neuron network and its application to financial forecasting. Acta Sci. Nat. Univ. Pekin. 37(3), 421–425 (2001)
Man, Q.: An empirical research on the investment strategy of stock market based on deep reinforcement learning model. Guangdong University of Finance & Economics (2017)
Qi, Y., Huang, S.: Portfolio management based on DDPG algorithm of deep reinforcement learning. Comput. Mod. 2018(05), 93–99 (2018)
Mnih, V., Kavukcuoglu, K., Silver, D., et al.: Playing Atari with deep reinforcement learning. arXiv preprint: arXiv:1312.5602 (2013)
Mnih, V., Kavukcuoglu, K., Silver, D., et al.: Human-level control through deep reinforcement learning. Nature 518(7540), 529 (2015)
Gao, J.: The role of artificial intelligence in financial transactions and its future development direction. Electron. Technol. Softw. Eng. 2017(18), 253 (2017)
Hasselt, H., Guez, A., Silver, D.: Deep reinforcement learning with double Q-learning. In: Proceedings of the Thirtieth AAAI Conference on Artificial Intelligence, pp. 2094–2100. AAAI Press (2016)
Zhao, H., Xia, S., Zhao, J., Zhu, D., Yao, R., Niu, Q.: Pareto-based many-objective convolutional neural networks. In: Meng, X., Li, R., Wang, K., Niu, B., Wang, X., Zhao, G. (eds.) WISA 2018. LNCS, vol. 11242, pp. 3–14. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-02934-0_1
John Moody, M.S.: Reinforcement learning for trading systems and portfolios. In: Advances in Neural Information Processing Systems, vol. 17(5–6), pp. 917–923 (1998)
Deng, Y., Bao, F., Kong, Y., et al.: Deep direct reinforcement learning for financial signal representation and trading. IEEE Trans. Neural Netw. Learn. Syst. 28(3), 653–664 (2017)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Han, D., Zhang, J., Zhou, Y., Liu, Q., Yang, N. (2019). Intelligent Trader Model Based on Deep Reinforcement Learning. In: Ni, W., Wang, X., Song, W., Li, Y. (eds) Web Information Systems and Applications. WISA 2019. Lecture Notes in Computer Science(), vol 11817. Springer, Cham. https://doi.org/10.1007/978-3-030-30952-7_2
Download citation
DOI: https://doi.org/10.1007/978-3-030-30952-7_2
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-30951-0
Online ISBN: 978-3-030-30952-7
eBook Packages: Computer ScienceComputer Science (R0)
