Model-based Reinforcement Learning for Predictions and Control for Limit Order Books
We build a profitable electronic trading agent with Reinforcement Learning that places buy and sell orders in the stock market. An environment model is built only with historical observational data, and the RL agent learns the trading policy by interacting with the environment model instead of with the real-market to minimize the risk and potential monetary loss. Trained in unsupervised and self-supervised fashion, our environment model learned a temporal and causal representation of the market in latent space through deep neural networks. We demonstrate that the trading policy trained entirely within the environment model can be transferred back into the real market and maintain its profitability. We believe that this environment model can serve as a robust simulator that predicts market movement as well as trade impact for further studies.
Code (0)
등록된 구현이 없습니다.
Tasks
Model-based Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)Similar Papers 제목 키워드 기반
JAX-LOB: A GPU-Accelerated limit order book simulator to unlock large scale reinforcement learning for trading
Financial exchanges across the world use limit order books (LOBs) to process orders and match trades. For research purposes it is important to have large scale efficient simulators of LOB dynamics. LOB simulators have pr…
GPUreinforcement-learningReinforcement LearningReinforcement Learning (RL)General Compound Hawkes Processes in Limit Order Books
In this paper, we study various new Hawkes processes, namely, so-called general compound and regime-switching general compound Hawkes processes to model the price processes in the limit order books. We prove Law of Large…
General Semi-Markov Model for Limit Order Books: Theory, Implementation and Numerics
The paper considers a general semi-Markov model for Limit Order Books with two states, which incorporates price changes that are not fixed to one tick. Furthermore, we introduce an even more general case of the semi-Mark…
DiffLOB: Diffusion Models for Counterfactual Generation in Limit Order Books
Modern generative models for limit order books (LOBs) can reproduce realistic market dynamics, but remain fundamentally passive: they either model what typically happens without accounting for hypothetical future market …
Market Making with Deep Reinforcement Learning from Limit Order Books
Market making (MM) is an important research topic in quantitative finance, the agent needs to continuously optimize ask and bid quotes to provide liquidity and make profits. The limit order book (LOB) contains informatio…
Decision MakingDeep Reinforcement Learningreinforcement-learningReinforcement Learning+1