G-Learner and GIRL: Goal Based Wealth Management with Reinforcement Learning

2020-02-25 · Matthew Dixon, Igor Halperin

We present a reinforcement learning approach to goal based wealth management problems such as optimization of retirement plans or target dated funds. In such problems, an investor seeks to achieve a financial goal by making periodic investments in the portfolio while being employed, and periodically draws from the account when in retirement, in addition to the ability to re-balance the portfolio by selling and buying different assets (e.g. stocks). Instead of relying on a utility of consumption, we present G-Learner: a reinforcement learning algorithm that operates with explicitly defined one-step rewards, does not assume a data generation process, and is suitable for noisy data. Our approach is based on G-learning - a probabilistic extension of the Q-learning method of reinforcement learning. In this paper, we demonstrate how G-learning, when applied to a quadratic reward and Gaussian reference policy, gives an entropy-regulated Linear Quadratic Regulator (LQR). This critical insight provides a novel and computationally tractable tool for wealth management tasks which scales to high dimensional portfolios. In addition to the solution of the direct problem of G-learning, we also present a new algorithm, GIRL, that extends our goal-based G-learning approach to the setting of Inverse Reinforcement Learning (IRL) where rewards collected by the agent are not observed, and should instead be inferred. We demonstrate that GIRL can successfully learn the reward parameters of a G-Learner agent and thus imitate its behavior. Finally, we discuss potential applications of the G-Learner and GIRL algorithms for wealth management and robo-advising.

📄 PDF Abstract BibTeX arXiv:2002.10990

Code (0)

등록된 구현이 없습니다.

Tasks

ManagementQ-Learningreinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

Q-Learning Q-Learning is an off-policy temporal difference control algorithm: $$Q\left(S\_{t}, A\_{t}\right) \leftarrow Q\left(S\_{t}, A\_{t}\right) + \alpha\left[R_{t+1} +…

Deep Reinforcement Learning for Robust Goal-Based Wealth Management

2023-07-25 · Tessa Bauman, Bruno Gašperov, Stjepan Begušić, Zvonko Kostanjčar

Goal-based investing is an approach to wealth management that prioritizes achieving specific financial goals. It is naturally formulated as a sequential decision-making problem as it requires choosing the appropriate inv…

Decision Making Deep Reinforcement Learning Management reinforcement-learning+2

Reinforcement Learning for Portfolio Optimization with a Financial Goal and Defined Time Horizons

2025-11-22 · Fermat Leukam, Rock Stephane Koffi, Prudence Djagba arxiv

This research proposes an enhancement to the innovative portfolio optimization approach using the G-Learning algorithm, combined with parametric optimization via the GIRL algorithm (G-learning approach to the setting of …

Reinforcement Learning Portfolio Optimization

A Meta Reinforcement Learning Approach to Goals-Based Wealth Management

2026-05-04 · Sanjiv R. Das, Harshad Khadilkar, Sukrit Mittal, Daniel Ostrov 외 arxiv

Applying concepts related to zero-shot meta-learning and pre-training of foundation models, we develop a meta reinforcement learning approach (denoted MetaRL) that is pre-trained on thousands of goals-based wealth manage…

Reinforcement Learning

Learn To Manage Portfolio With Reinforcement Learning

2020-12-14 · CUHK Course IERG5350 2020 12 · Liu Yuan, Zhou Qianyu

Abstract： With the increase of high net worth population, wealth management is getting more and more attention. Traditional portfolio management requires a high professional threshold. Now that reinforcement learning is …

Management reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Towards Generalized Inverse Reinforcement Learning

2024-02-11 · Chaosheng Dong, Yijia Wang

This paper studies generalized inverse reinforcement learning (GIRL) in Markov decision processes (MDPs), that is, the problem of learning the basic components of an MDP given observed behavior (policy) that might not be…

reinforcement-learning Reinforcement Learning