paper-with-me

홈 › Papers

Model-based Reinforcement Learning for Predictions and Control for Limit Order Books

2019-10-09 · Hao-Ran Wei, Yuanbo Wang, Lidia Mangu, Keith Decker

We build a profitable electronic trading agent with Reinforcement Learning that places buy and sell orders in the stock market. An environment model is built only with historical observational data, and the RL agent learns the trading policy by interacting with the environment model instead of with the real-market to minimize the risk and potential monetary loss. Trained in unsupervised and self-supervised fashion, our environment model learned a temporal and causal representation of the market in latent space through deep neural networks. We demonstrate that the trading policy trained entirely within the environment model can be transferred back into the real market and maintain its profitability. We believe that this environment model can serve as a robust simulator that predicts market movement as well as trade impact for further studies.

📄 PDF Abstract BibTeX arXiv:1910.03743

Code (0)

등록된 구현이 없습니다.

Tasks

Model-based Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)

Similar Papers 제목 키워드 기반

JAX-LOB: A GPU-Accelerated limit order book simulator to unlock large scale reinforcement learning for trading

2023-08-25 · Sascha Frey, Kang Li, Peer Nagy, Silvia Sapora 외

Financial exchanges across the world use limit order books (LOBs) to process orders and match trades. For research purposes it is important to have large scale efficient simulators of LOB dynamics. LOB simulators have pr…

GPUreinforcement-learningReinforcement LearningReinforcement Learning (RL)

General Compound Hawkes Processes in Limit Order Books

2017-06-27

In this paper, we study various new Hawkes processes, namely, so-called general compound and regime-switching general compound Hawkes processes to model the price processes in the limit order books. We prove Law of Large…

General Semi-Markov Model for Limit Order Books: Theory, Implementation and Numerics

2016-08-17

The paper considers a general semi-Markov model for Limit Order Books with two states, which incorporates price changes that are not fixed to one tick. Furthermore, we introduce an even more general case of the semi-Mark…

DiffLOB: Diffusion Models for Counterfactual Generation in Limit Order Books

2026-02-03 · Zhuohan Wang, Carmine Ventre arxiv

Modern generative models for limit order books (LOBs) can reproduce realistic market dynamics, but remain fundamentally passive: they either model what typically happens without accounting for hypothetical future market …

Market Making with Deep Reinforcement Learning from Limit Order Books

2023-05-25 · Hong Guo, Jianwu Lin, Fanlin Huang

Market making (MM) is an important research topic in quantitative finance, the agent needs to continuously optimize ask and bid quotes to provide liquidity and make profits. The limit order book (LOB) contains informatio…

Decision MakingDeep Reinforcement Learningreinforcement-learningReinforcement Learning+1