Deep differentiable reinforcement learning and optimal trading

2021-12-06 · Thibault Jaisson

In many reinforcement learning applications, the underlying environment reward and transition functions are explicitly known differentiable functions. This enables us to use recent research which applies machine learning tools to stochastic control to find optimal action functions. In this paper, we define differentiable reinforcement learning as a particular case of this research. We find that incorporating deep learning in this framework leads to more accurate and stable solutions than those obtained from more generic actor critic algorithms. We apply this deep differentiable reinforcement learning (DDRL) algorithm to the problem of one asset optimal trading strategies in various environments where the market dynamics are known. Thanks to the stability of this method, we are able to efficiently find optimal strategies for complex multi-scale market models. We also extend these methods to simultaneously find optimal action functions for a wide range of environment parameters. This makes it applicable to real life financial signals and portfolio optimization where the expected return has multiple time scales. In the case of a slow and a fast alpha signal, we find that the optimal trading strategy consists in using the fast signal to time the trades associated to the slow signal.

📄 PDF Abstract BibTeX arXiv:2112.02944

Code (0)

등록된 구현이 없습니다.

Tasks

Portfolio Optimization reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Deep Deterministic Portfolio Optimization

2020-03-13 · Ayman Chaouki, Stephen Hardiman, Christian Schmidt, Emmanuel Sérié 외

Can deep reinforcement learning algorithms be exploited as solvers for optimal trading strategies? The aim of this work is to test reinforcement learning algorithms on conceptually simple, but mathematically non-trivial,…

Deep Reinforcement Learning Portfolio Optimization reinforcement-learning Reinforcement Learning+1

Trading the Twitter Sentiment with Reinforcement Learning

2018-01-07 · Catherine Xiao, Wanfeng Chen

This paper is to explore the possibility to use alternative data and artificial intelligence techniques to trade stocks. The efficacy of the daily Twitter sentiment on predicting the stock return is examined using machin…

BIG-bench Machine Learning Q-Learning reinforcement-learning Reinforcement Learning+1

A* Tree Search for Portfolio Management

2019-01-07 · Xiaojie Gao, Shikui Tu, Lei Xu

We propose a planning-based method to teach an agent to manage portfolio from scratch. Our approach combines deep reinforcement learning techniques with search techniques like AlphaGo. By uniting the advantages in A* sea…

Deep Reinforcement Learning Management reinforcement-learning Reinforcement Learning+1

A Risk-Aware Reinforcement Learning Reward for Financial Trading

2025-06-04 · Uditansh Srivastava, Shivam Aryan, Shaurya Singh

We propose a novel composite reward function for reinforcement learning in financial trading that balances return and risk using four differentiable terms: annualized return downside risk differential return and the Trey…

reinforcement-learning Reinforcement Learning

Practical Deep Reinforcement Learning Approach for Stock Trading

2018-11-19 · Xiao-Yang Liu, Zhuoran Xiong, Shan Zhong, Hongyang Yang 외

Stock trading strategy plays a crucial role in investment companies. However, it is challenging to obtain optimal strategy in the complex and dynamic stock market. We explore the potential of deep reinforcement learning …

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)