Deep Reinforcement Learning in Factor Investment
Deep reinforcement learning has shown promise in trade execution, yet its use in low-frequency factor portfolio construction remains under-explored. A key obstacle is the high-dimensional, unbalanced state space created by stocks that enter and exit the investable universe. We introduce Conditional Auto-encoded Factor-based Portfolio Optimisation (CAFPO), which compresses stock-level returns into a small set of latent factors conditioned on 94 firm-specific characteristics. The factors feed a DRL agent implemented with both PPO and DDPG to generate continuous long-short weights. On 20 years of U.S. equity data (2000--2020), CAFPO outperforms equal-weight, value-weight, Markowitz, vanilla DRL, and Fama--French-driven DRL, delivering a 24.6\% compound return and a Sharpe ratio of 0.94 out of sample. SHAP analysis further reveals economically intuitive factor attributions. Our results demonstrate that factor-aware representation learning can make DRL practical for institutional, low-turnover portfolio management.
Code (0)
등록된 구현이 없습니다.
Tasks
Representation LearningReinforcement LearningSimilar Papers 제목 키워드 기반
Optimization of Multi-Factor Model in Quantitative Trading Based On Reinforcement Learning
Quantitative trading strategies play an important role in stock trading, and reinforcement learning (RL) has been increasingly applied to trading activities in recent years. In this paper, we mainly study the optimizatio…
Decision Makingreinforcement-learningReinforcement Learning (RL)AlphaForge: A Framework to Mine and Dynamically Combine Formulaic Alpha Factors
The complexity of financial data, characterized by its variability and low signal-to-noise ratio, necessitates advanced methods in quantitative investment that prioritize both performance and interpretability.Transitioni…
DiversityThe Role of Intangible Investment in Predicting Stock Returns: Six Decades of Evidence
Using an intangible intensity factor that is orthogonal to the Fama--French factors, we compare the role of intangible investment in predicting stock returns over the periods 1963--1992 and 1993--2022. For 1963--1992, in…
Synergistic Formulaic Alpha Generation for Quantitative Trading based on Reinforcement Learning
Mining of formulaic alpha factors refers to the process of discovering and developing specific factors or indicators (referred to as alpha factors) for quantitative trading in stock market. To efficiently discover alpha …
reinforcement-learningReinforcement Learning (RL)Causal Inference on Investment Constraints and Non-stationarity in Dynamic Portfolio Optimization through Reinforcement Learning
In this study, we have developed a dynamic asset allocation investment strategy using reinforcement learning techniques. To begin with, we have addressed the crucial issue of incorporating non-stationarity of financial t…
Causal InferenceManagementPortfolio Optimizationreinforcement-learning+2