Bridging the gap between Markowitz planning and deep reinforcement learning

2020-09-30 · Eric Benhamou, David Saltiel, Sandrine Ungari, Abhishek Mukhopadhyay

While researchers in the asset management industry have mostly focused on techniques based on financial and risk planning techniques like Markowitz efficient frontier, minimum variance, maximum diversification or equal risk parity, in parallel, another community in machine learning has started working on reinforcement learning and more particularly deep reinforcement learning to solve other decision making problems for challenging task like autonomous driving, robot learning, and on a more conceptual side games solving like Go. This paper aims to bridge the gap between these two approaches by showing Deep Reinforcement Learning (DRL) techniques can shed new lights on portfolio allocation thanks to a more general optimization setting that casts portfolio allocation as an optimal control problem that is not just a one-step optimization, but rather a continuous control optimization with a delayed reward. The advantages are numerous: (i) DRL maps directly market conditions to actions by design and hence should adapt to changing environment, (ii) DRL does not rely on any traditional financial risk assumptions like that risk is represented by variance, (iii) DRL can incorporate additional data and be a multi inputs method as opposed to more traditional optimization methods. We present on an experiment some encouraging results using convolution networks.

📄 PDF Abstract BibTeX arXiv:2010.09108

Code (0)

등록된 구현이 없습니다.

Tasks

Asset ManagementAutonomous Driving continuous-control Continuous Control Decision MakingDeep Reinforcement LearningManagement reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Bridging Imagination and Reality for Model-Based Deep Reinforcement Learning

2020-10-23 · NeurIPS 2020 12 · Guangxiang Zhu, Minghao Zhang, Honglak Lee, Chongjie Zhang

Sample efficiency has been one of the major challenges for deep reinforcement learning. Recently, model-based reinforcement learning has been proposed to address this challenge by performing planning on imaginary traject…

Deep Reinforcement Learning Model-based Reinforcement Learning reinforcement-learning Reinforcement Learning+1

Markowitz Meets Bellman: Knowledge-distilled Reinforcement Learning for Portfolio Management

2024-05-08 · Gang Hu, Ming Gu

Investment portfolios, central to finance, balance potential returns and risks. This paper introduces a hybrid approach combining Markowitz's portfolio theory with reinforcement learning, utilizing knowledge distillation…

Knowledge Distillation Management reinforcement-learning Reinforcement Learning

Comparison of Markowitz Model and Single-Index Model on Portfolio Selection of Malaysian Stocks

2024-01-10 · Zhang Chern Lee, Wei Yun Tan, Hoong Khen Koo, Wilson Pang

Our article is focused on the application of Markowitz Portfolio Theory and the Single Index Model on 10-year historical monthly return data for 10 stocks included in FTSE Bursa Malaysia KLCI, which is also our market in…

model

Drive-R1: Bridging Reasoning and Planning in VLMs for Autonomous Driving with Reinforcement Learning

2025-06-23 · Yue Li, Meng Tian, Dechang Zhu, Jiangtong Zhu 외

Large vision-language models (VLMs) for autonomous driving (AD) are evolving beyond perception and cognition tasks toward motion planning. However, we identify two critical challenges in this direction: (1) VLMs tend to …

Autonomous Driving Motion Planning

Bridging Discrete Planning and Continuous Execution for Redundant Robot

2026-04-02 · Teng Yan, Yue Yu, Yihan Liu, Bingzhuo Zhong arxiv

Voxel-grid reinforcement learning is widely adopted for path planning in redundant manipulators due to its simplicity and reproducibility. However, direct execution through point-wise numerical inverse kinematics on 7-Do…

Reinforcement Learning