Skip to main content

Effect of Market Spread Over Reinforcement Learning Based Market Maker

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 11943))

Abstract

Market Making (also known as liquidity providing service) is a well-known trading problem studied in multiple disciplines including Finance, Economics and Artificial Intelligence. This paper examines the impact of Market Spread over the market maker’s (or liquidity provider’s) convergence ability through testing the hypothesis that “Knowledge of market spread while learning leads to faster convergence to an optimal and less volatile market making policy”. Reinforcement Learning was used to mimic the behaviour of a liquidity provider with Limit Order Book using historical Trade and Quote data of five equities, as the trading environment. An empirical study of results obtained from experiments (comparing our reward function with benchmark) shows significant improvement in the magnitude of returns obtained by a market maker with knowledge of market spread compared to a market maker without such knowledge, which proves our stated hypothesis.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Upson, J., Van Ness, R.A.: Multiple markets, algorithmic trading, and market liquidity. J. Financ. Markets 32, 49–68 (2017)

    Google Scholar 

  2. Ho, T., Stoll, H.: Optimal dealer pricing under transactions and return uncertainty. J. Financ. Econ. 9, 47–73 (1981)

    Google Scholar 

  3. Ho, T., Macris, R.: Dealer bid-ask quotes and transaction prices: an empirical study of some AMEX options. J. Finance 39(1), 23–45 (1984)

    Google Scholar 

  4. Avellaneda, M., Stoikov, S.: High-frequency trading in a limit order book. Quant. Financ. 8(3), 217–224 (2008)

    Google Scholar 

  5. Das, S.: The effects of market-making on price dynamics. In: International Foundation for Autonomous Agents and Multiagent Systems, Richland, vol. 2, pp. 887–894 (2008)

    Google Scholar 

  6. Ait-Sahalia, Y., Sağlam, M.: High Frequency Market Making: Optimal Quoting (2017). https://ssrn.com/abstract=2331613 or http://dx.doi.org/10.2139/ssrn.2331613

  7. Chan, N.T., Shelton, C.: An Electronic Market-Maker (2001). http://hdl.handle.net/1721.1/7220

  8. Abernethy, J., Kale, S.: Adaptive market making via online learning. In: Neural Information Processing Systems (NIPS), 5–10 December 2013. Curran Associates Inc., Lake Tahoe, Nevada, USA, vol. 2, pp 2058–2066 (2013)

    Google Scholar 

  9. Spooner, T., Fearnley, J., Savani, R., Koukorinis, A.: Market making via reinforcement learning. In: International Conference on Autonomous Agents and Multiagent Systems (AAMAS), 10–15 July 2018, Stockholm, Sweden, SIGAI, IFAAMAS, International Foundation for Autonomous Agents and Multiagent Systems, Richland, vol. 17, pp. 434–442 (2018)

    Google Scholar 

  10. Sutton, R.S., Barto, A.G.: Reinforcement Learning: An Introduction, 2nd edn. MIT Press, Cambridge (2018)

    Google Scholar 

  11. Gould, M., Porter, M., Williams, S., McDonald, M., Fenn, D., Howison, S.: Limit order books. Quant. Financ. 13, 1709–1742 (2013)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Abbas Haider .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Haider, A., Wang, H., Scotney, B., Hawe, G. (2019). Effect of Market Spread Over Reinforcement Learning Based Market Maker. In: Nicosia, G., Pardalos, P., Umeton, R., Giuffrida, G., Sciacca, V. (eds) Machine Learning, Optimization, and Data Science. LOD 2019. Lecture Notes in Computer Science(), vol 11943. Springer, Cham. https://doi.org/10.1007/978-3-030-37599-7_13

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-37599-7_13

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-37598-0

  • Online ISBN: 978-3-030-37599-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics