skip to main content
10.1145/3490354.3494398acmconferencesArticle/Chapter ViewAbstractPublication PagesicaifConference Proceedingsconference-collections
research-article

High frequency automated market making algorithms with adverse selection risk control via reinforcement learning

Published:04 May 2022Publication History

ABSTRACT

Market makers provide liquidity by placing limit orders on both sides of the market (bids and offers) while aiming to earn the bid-offer (bid-ask) spread. Their long-term performance is significantly determined by their ability to mitigate the risk of adverse selection when their limit orders are picked off by informed traders possessing relevant information that moves the market to a new level resulting in losses to market makers. This paper proposes a high-frequency feature Book Exhaustion Rate (BER) and shows theoretically and empirically that the BER can serve as a direct measurement of the adverse selection risk from an equilibrium point of view. We train a market making algorithm via Reinforcement Learning using three years of limit order book data on Chicago Mercantile Exchange (CME) S&P 500 and 10-year Treasury note futures and demonstrate that with utilizing the BER allows the algorithm to avoid large losses due to adverse selection and achieve stable performance.

References

  1. Abernethy, J., Kale, S. (2013). Adaptive market making via online learning. In Advances in Neural Information Processing Systems (pp. 2058--2066).Google ScholarGoogle Scholar
  2. Andersen, T. G., & Bondarenko, O. (2015). Assessing measures of order flow toxicity and early warning signals for market turbulence. Review of Finance, 19(1), 1--54.Google ScholarGoogle ScholarCross RefCross Ref
  3. Avellaneda, M., Stoikov, S. (2008). High-frequency trading in a limit order book. Quantitative Finance, 8(3), 217--224.Google ScholarGoogle ScholarCross RefCross Ref
  4. Chakraborty, T., Kearns, M. (2011, June). Market making and mean reversion. In Proceedings of the 12th ACM conference on Electronic commerce (pp. 307--314). ACM.Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Easley, D., López de Prado, M. M., & O'Hara, M. (2012). Flow toxicity and liquidity in a high-frequency world. The Review of Financial Studies, 25(5), 1457--1493.Google ScholarGoogle ScholarCross RefCross Ref
  6. Guéant, O., Lehalle, C. A., & Fernandez-Tapia, J. (2012). Optimal portfolio liquidation with limit orders. SIAM Journal on Financial Mathematics, 3(1), 740--764.Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Guilbaud, F., Pham, H. (2013). Optimal high-frequency trading with limit and market orders. Quantitative Finance, 13(1), 79--94.Google ScholarGoogle ScholarCross RefCross Ref
  8. Huber, P. J. (1967). The behavior of maximum likelihood estimates under nonstandard conditions. In Proceedings of the fifth Berkeley symposium on mathematical statistics and probability (Vol. 1, No. 1, pp. 221--233).Google ScholarGoogle Scholar
  9. Kakade, S. M., Kearns, M., Mansour, Y., & Ortiz, L. E. (2004, May). Competitive algorithms for VWAP and limit order trading. In Proceedings of the 5th ACM conference on Electronic commerce (pp. 189--198). ACM.Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Kühn, C., Stroh, M. (2010). Optimal portfolios of a small investor in a limit order market: a shadow price approach. Mathematics and Financial Economics, 3(2), 45--72.Google ScholarGoogle ScholarCross RefCross Ref
  11. Menkveld, A. (2013) . "High frequency trading and the new market makers." Journal of Financial Markets, 16.4, 712--740.Google ScholarGoogle ScholarCross RefCross Ref
  12. Nevmyvaka, Y., Feng, Y., & Kearns, M. (2006, June). Reinforcement learning for optimized trade execution. In Proceedings of the 23rd international conference on Machine learning (pp. 673--680). ACM.Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Obizhaeva, A. A., & Wang, J. (2013). Optimal trading strategy and supply/demand dynamics. Journal of Financial Markets, 16(1), 1--32.Google ScholarGoogle ScholarCross RefCross Ref
  14. Pagano, M. (1989). Trading volume and asset liquidity. The Quarterly Journal of Economics, 104(2), 255--274.Google ScholarGoogle ScholarCross RefCross Ref
  15. Spooner, T., Fearnley, J., Savani, R., & Koukorinis, A. (2018). Market making via reinforcement learning. arXiv preprint arXiv:1804.04216.Google ScholarGoogle Scholar
  16. White, H. (1982). Maximum likelihood estimation of misspecified models. Econometrica: Journal of the econometric society, 1--25.Google ScholarGoogle ScholarCross RefCross Ref
  1. High frequency automated market making algorithms with adverse selection risk control via reinforcement learning

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      ICAIF '21: Proceedings of the Second ACM International Conference on AI in Finance
      November 2021
      450 pages
      ISBN:9781450391481
      DOI:10.1145/3490354

      Copyright © 2021 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 4 May 2022

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader