Reinforcement-Learning based Portfolio Management with Augmented Asset Movement Prediction States

2020-02-09 · Yunan Ye, Hengzhi Pei, Boxin Wang, Pin-Yu Chen, Yada Zhu, Jun Xiao, Bo Li

Portfolio management (PM) is a fundamental financial planning task that aims to achieve investment goals such as maximal profits or minimal risks. Its decision process involves continuous derivation of valuable information from various data sources and sequential decision optimization, which is a prospective research direction for reinforcement learning (RL). In this paper, we propose SARL, a novel State-Augmented RL framework for PM. Our framework aims to address two unique challenges in financial PM: (1) data heterogeneity -- the collected information for each asset is usually diverse, noisy and imbalanced (e.g., news articles); and (2) environment uncertainty -- the financial market is versatile and non-stationary. To incorporate heterogeneous data and enhance robustness against environment uncertainty, our SARL augments the asset information with their price movement prediction as additional states, where the prediction can be solely based on financial data (e.g., asset prices) or derived from alternative sources such as news. Experiments on two real-world datasets, (i) Bitcoin market and (ii) HighTech stock market with 7-year Reuters news articles, validate the effectiveness of SARL over existing PM approaches, both in terms of accumulated profits and risk-adjusted profits. Moreover, extensive simulations are conducted to demonstrate the importance of our proposed state augmentation, providing new insights and boosting performance significantly over standard RL-based PM method and other baselines.

📄 PDF Abstract BibTeX arXiv:2002.05780

Code (1)

andreaslillevangbech/PortfolioManager-pytorch pytorch

Tasks

Articles Management reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

AAMDRL: Augmented Asset Management with Deep Reinforcement Learning

2020-09-30 · Eric Benhamou, David Saltiel, Sandrine Ungari, Abhishek Mukhopadhyay 외

Can an agent learn efficiently in a noisy and self adapting environment with sequential, non-stationary and non-homogeneous observations? Through trading bots, we illustrate how Deep Reinforcement Learning (DRL) can tack…

Asset Management Deep Reinforcement Learning Management reinforcement-learning+4

A General Framework on Enhancing Portfolio Management with Reinforcement Learning

2019-11-26 · Yinheng Li, Junhao Wang, Yijie Cao

Portfolio management is the art and science in fiance that concerns continuous reallocation of funds and assets across financial instruments to meet the desired returns to risk profile. Deep reinforcement learning (RL) h…

Asset Management Deep Reinforcement Learning Management reinforcement-learning+2

Diffusion-Augmented Reinforcement Learning for Robust Portfolio Optimization under Stress Scenarios

2025-10-08 · Himanshu Choudhary, Arishi Orra, Manoj Thakur arxiv

In the ever-changing and intricate landscape of financial markets, portfolio optimisation remains a formidable challenge for investors and asset managers. Conventional methods often struggle to capture the complex dynami…

Reinforcement Learning Portfolio Optimization

Model-Free Reinforcement Learning for Asset Allocation

2022-09-21 · Adebayo Oshingbesan, Eniola Ajiboye, Peruth Kamashazi, Timothy Mbaka

Asset allocation (or portfolio management) is the task of determining how to optimally allocate funds of a finite budget into a range of financial instruments/assets such as stocks. This study investigated the performanc…

Management model reinforcement-learning Reinforcement Learning+1

A Three-Phase Foundation Model for Tax-Aware Personalized Portfolio Management

2026-06-30 · Ramin Pishehvar arxiv

We present a three-phase deep reinforcement learning system for personalized portfolio management that addresses three limitations shared by all prior financial RL work: 1) ticker lock-in, 2) monolithic objectives , and …

Self-Supervised Learning Reinforcement Learning