Adversarial Deep Reinforcement Learning in Portfolio Management
In this paper, we implement three state-of-art continuous reinforcement learning algorithms, Deep Deterministic Policy Gradient (DDPG), Proximal Policy Optimization (PPO) and Policy Gradient (PG)in portfolio management. All of them are widely-used in game playing and robot control. What's more, PPO has appealing theoretical propeties which is hopefully potential in portfolio management. We present the performances of them under different settings, including different learning rates, objective functions, feature combinations, in order to provide insights for parameters tuning, features selection and data preparation. We also conduct intensive experiments in China Stock market and show that PG is more desirable in financial market than DDPG and PPO, although both of them are more advanced. What's more, we propose a so called Adversarial Training method and show that it can greatly improve the training efficiency and significantly promote average daily return and sharpe ratio in back test. Based on this new modification, our experiments results show that our agent based on Policy Gradient can outperform UCRP.
Code (5)
Tasks
Deep Reinforcement LearningManagementreinforcement-learningReinforcement LearningReinforcement Learning (RL)Methods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Learn To Manage Portfolio With Reinforcement Learning
Abstract： With the increase of high net worth population, wealth management is getting more and more attention. Traditional portfolio management requires a high professional threshold. Now that reinforcement learning is …
Managementreinforcement-learningReinforcement LearningReinforcement Learning (RL)Portfolio Management with Reinforcement Learning
Portfolio management is a crucial trading task for investment companies in the market. In this work, reinforcement learning (RL) incorporating the transformer structure is combined with deep learning (DL) to build an aut…
Managementreinforcement-learningReinforcement LearningReinforcement Learning (RL)Benchmarking Robustness of Deep Reinforcement Learning approaches to Online Portfolio Management
Deep Reinforcement Learning approaches to Online Portfolio Selection have grown in popularity in recent years. The sensitive nature of training Reinforcement Learning agents implies a need for extensive efforts in market…
BenchmarkingDeep Reinforcement LearningManagementreinforcement-learning+1Cryptocurrency Portfolio Management with Reinforcement Learning: Soft Actor--Critic and Deep Deterministic Policy Gradient Algorithms
This paper proposes a reinforcement learning--based framework for cryptocurrency portfolio management using the Soft Actor--Critic (SAC) and Deep Deterministic Policy Gradient (DDPG) algorithms. Traditional portfolio opt…
Reinforcement LearningPortfolio OptimizationA General Framework on Enhancing Portfolio Management with Reinforcement Learning
Portfolio management is the art and science in fiance that concerns continuous reallocation of funds and assets across financial instruments to meet the desired returns to risk profile. Deep reinforcement learning (RL) h…
Asset ManagementDeep Reinforcement LearningManagementreinforcement-learning+2