홈 › Papers

JAX-LOB: A GPU-Accelerated limit order book simulator to unlock large scale reinforcement learning for trading

2023-08-25 · Sascha Frey, Kang Li, Peer Nagy, Silvia Sapora, Chris Lu, Stefan Zohren, Jakob Foerster, Anisoara Calinescu

Financial exchanges across the world use limit order books (LOBs) to process orders and match trades. For research purposes it is important to have large scale efficient simulators of LOB dynamics. LOB simulators have previously been implemented in the context of agent-based models (ABMs), reinforcement learning (RL) environments, and generative models, processing order flows from historical data sets and hand-crafted agents alike. For many applications, there is a requirement for processing multiple books, either for the calibration of ABMs or for the training of RL agents. We showcase the first GPU-enabled LOB simulator designed to process thousands of books in parallel, with a notably reduced per-message processing time. The implementation of our simulator - JAX-LOB - is based on design choices that aim to best exploit the powers of JAX without compromising on the realism of LOB-related mechanisms. We integrate JAX-LOB with other JAX packages, to provide an example of how one may address an optimal execution problem with reinforcement learning, and to share some preliminary results from end-to-end RL training on GPUs.

📄 PDF Abstract BibTeX arXiv:2308.13289

Code (0)

등록된 구현이 없습니다.

Tasks

GPUreinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Deep Reinforcement Learning for Market Making Under a Hawkes Process-Based Limit Order Book Model

2022-07-20 · Bruno Gašperov, Zvonko Kostanjčar

The stochastic control problem of optimal market making is among the central problems in quantitative finance. In this paper, a deep reinforcement learning-based controller is trained on a weakly consistent, multivariate…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Asynchronous Deep Double Duelling Q-Learning for Trading-Signal Execution in Limit Order Book Markets

2023-01-20 · Peer Nagy, Jan-Peter Calliess, Stefan Zohren

We employ deep reinforcement learning (RL) to train an agent to successfully translate a high-frequency trading signal into a trading strategy that places individual limit orders. Based on the ABIDES limit order book sim…

Deep Reinforcement Learning Management OpenAI Gym Q-Learning+3

Learning to simulate realistic limit order book markets from data as a World Agent

2022-09-26 · Andrea Coletta, Aymeric Moulin, Svitlana Vyetrenko, Tucker Balch

Multi-agent market simulators usually require careful calibration to emulate real markets, which includes the number and the type of agents. Poorly calibrated simulators can lead to misleading conclusions, potentially ca…

Generative Adversarial Network

Risk-Sensitive Compact Decision Trees for Autonomous Execution in Presence of Simulated Market Response

2019-06-05 · Svitlana Vyetrenko, Shaojie Xu

We demonstrate an application of risk-sensitive reinforcement learning to optimizing execution in limit order book markets. We represent taking order execution decisions based on limit order book knowledge by a Markov De…

Q-Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Optimal Execution with Reinforcement Learning

2024-11-10 · Yadh Hafsi, Edoardo Vittori

This study investigates the development of an optimal execution strategy through reinforcement learning, aiming to determine the most effective approach for traders to buy and sell inventory within a limited time frame. …

reinforcement-learning Reinforcement Learning