A Meta Reinforcement Learning Approach to Goals-Based Wealth Management
Applying concepts related to zero-shot meta-learning and pre-training of foundation models, we develop a meta reinforcement learning approach (denoted MetaRL) that is pre-trained on thousands of goals-based wealth management (GBWM) problems. Each GBWM problem involves a multiple year scenario over which the investor looks to optimally choose an investment portfolio each year and choose to fulfill all, some, or none of the different financial goals that arise each year. These choices seek to maximize the expected total investor utility obtained from the fulfilled financial goals. By eliminating separate training and optimization for each new investor problem, the MetaRL model in inference mode produces near-optimal dynamic investment portfolio and goal-fulfilling strategies for a new GBWM problem within a few hundredths of a second. This delivers expected utilities that are, on average, 97.8% of the optimal expected utilities (determined via Dynamic Programming). These results are remarkably robust to capital market regime changes, even when training uses only one capital market regime. Further, the MetaRL approach can enable solving problems with larger state spaces where Dynamic Programming becomes computationally infeasible.
Code (0)
등록된 구현이 없습니다.
Tasks
Reinforcement LearningSimilar Papers 제목 키워드 기반
Deep Reinforcement Learning for Robust Goal-Based Wealth Management
Goal-based investing is an approach to wealth management that prioritizes achieving specific financial goals. It is naturally formulated as a sequential decision-making problem as it requires choosing the appropriate inv…
Decision MakingDeep Reinforcement LearningManagementreinforcement-learning+2Learn To Manage Portfolio With Reinforcement Learning
Abstract: With the increase of high net worth population, wealth management is getting more and more attention. Traditional portfolio management requires a high professional threshold. Now that reinforcement learning is …
Managementreinforcement-learningReinforcement LearningReinforcement Learning (RL)G-Learner and GIRL: Goal Based Wealth Management with Reinforcement Learning
We present a reinforcement learning approach to goal based wealth management problems such as optimization of retirement plans or target dated funds. In such problems, an investor seeks to achieve a financial goal by mak…
ManagementQ-Learningreinforcement-learningReinforcement Learning+1Curriculum Learning Based on Reward Sparseness for Deep Reinforcement Learning of Task Completion Dialogue Management
Learning from sparse and delayed reward is a central issue in reinforcement learning. In this paper, to tackle reward sparseness problem of task oriented dialogue management, we propose a curriculum based approach on the…
Deep Reinforcement LearningDialogue ManagementInformation RetrievalManagement+5Modelling Multi-issue Bargaining Dialogues: Data Collection, Annotation Design and Corpus
The paper describes experimental dialogue data collection activities, as well semantically annotated corpus creation undertaken within EU-funded METALOGUE project(www.metalogue.eu). The project aims to develop a dialogue…
Dialogue ManagementManagement