Model-Free Reinforcement Learning for Asset Allocation

2022-09-21 · Adebayo Oshingbesan, Eniola Ajiboye, Peruth Kamashazi, Timothy Mbaka

Asset allocation (or portfolio management) is the task of determining how to optimally allocate funds of a finite budget into a range of financial instruments/assets such as stocks. This study investigated the performance of reinforcement learning (RL) when applied to portfolio management using model-free deep RL agents. We trained several RL agents on real-world stock prices to learn how to perform asset allocation. We compared the performance of these RL agents against some baseline agents. We also compared the RL agents among themselves to understand which classes of agents performed better. From our analysis, RL agents can perform the task of portfolio management since they significantly outperformed two of the baseline agents (random allocation and uniform allocation). Four RL agents (A2C, SAC, PPO, and TRPO) outperformed the best baseline, MPT, overall. This shows the abilities of RL agents to uncover more profitable trading strategies. Furthermore, there were no significant performance differences between value-based and policy-based RL agents. Actor-critic agents performed better than other types of agents. Also, on-policy agents performed better than off-policy agents because they are better at policy evaluation and sample efficiency is not a significant problem in portfolio management. This study shows that RL agents can substantially improve asset allocation since they outperform strong baselines. On-policy, actor-critic RL agents showed the most promise based on our analysis.

📄 PDF Abstract BibTeX arXiv:2209.10458

Code (0)

등록된 구현이 없습니다.

Tasks

Managementmodelreinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

1x1 Convolution A 1 x 1 Convolution is a convolution with some special properties in that it can be used for dimensionality reduction,…

Entropy Regularization 설명 없음

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Dilated Convolution 설명 없음

PPO Proximal Policy Optimization, or PPO, is a policy gradient method for reinforcement learning. The motivation was to have an algorithm with the data efficiency and reliable…

Global Average Pooling Global Average Pooling is a pooling operation designed to replace fully connected layers in classical CNNs. The idea is to generate one feature map for each corresponding…

Average Pooling 설명 없음

SAC 설명 없음

Deep Reinforcement Learning for Asset Allocation in US Equities

2020-10-09 · Miquel Noguer i Alonso, Sonam Srivastava

Reinforcement learning is a machine learning approach concerned with solving dynamic optimization problems in an almost model-free way by maximizing a reward function in state and action spaces. This property makes it an…

Deep Reinforcement Learning Management reinforcement-learning Reinforcement Learning+4

Deep Reinforcement Learning for Optimal Asset Allocation Using DDPG with TiDE

2025-08-12 · Rongwei Liu, Jin Zheng, John Cartlidge arxiv

The optimal asset allocation between risky and risk-free assets is a persistent challenge due to the inherent volatility in financial markets. Conventional methods rely on strict distributional assumptions or non-additiv…

Reinforcement Learning

Reinforcement Learning Portfolio Manager Framework with Monte Carlo Simulation

2022-07-06 · Jungyu Ahn, Sungwoo Park, Jiwoon Kim, Ju-Hong Lee

Asset allocation using reinforcement learning has advantages such as flexibility in goal setting and utilization of various information. However, existing asset allocation methods do not consider the following viewpoints…

Management reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+2

Portfolio Management using Deep Reinforcement Learning

2024-05-01 · Ashish Anil Pawar, Vishnureddy Prashant Muskawar, Ritesh Tiku

Algorithmic trading or Financial robots have been conquering the stock markets with their ability to fathom complex statistical trading strategies. But with the recent development of deep learning technologies, these str…

Algorithmic Trading Deep Reinforcement Learning Management reinforcement-learning+1

Asset Allocation: From Markowitz to Deep Reinforcement Learning

2022-07-14 · Ricard Durall

Asset allocation is an investment strategy that aims to balance risk and reward by constantly redistributing the portfolio's assets according to certain goals, risk tolerance, and investment horizon. Unfortunately, there…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)