Model-Free Reinforcement Learning for Financial Portfolios: A Brief Survey
Financial portfolio management is one of the problems that are most frequently encountered in the investment industry. Nevertheless, it is not widely recognized that both Kelly Criterion and Risk Parity collapse into Mean Variance under some conditions, which implies that a universal solution to the portfolio optimization problem could potentially exist. In fact, the process of sequential computation of optimal component weights that maximize the portfolio's expected return subject to a certain risk budget can be reformulated as a discrete-time Markov Decision Process (MDP) and hence as a stochastic optimal control, where the system being controlled is a portfolio consisting of multiple investment components, and the control is its component weights. Consequently, the problem could be solved using model-free Reinforcement Learning (RL) without knowing specific component dynamics. By examining existing methods of both value-based and policy-based model-free RL for the portfolio optimization problem, we identify some of the key unresolved questions and difficulties facing today's portfolio managers of applying model-free RL to their investment portfolios.
Code (0)
등록된 구현이 없습니다.
Tasks
ManagementPortfolio Optimizationreinforcement-learningReinforcement LearningReinforcement Learning (RL)Similar Papers 제목 키워드 기반
Systemic Risk in Financial Networks: A Survey
We provide an overview of the relationship between financial networks and systemic risk. We present a taxonomy of different types of systemic risk, differentiating between direct externalities between financial organizat…
SurveyOptimal Regulation and Investment Incentives in Financial Networks
We examine optimal regulation of financial networks with debt interdependencies between financial firms. We first characterize when it is firms have an incentive to choose excessively risky portfolios and overly correlat…
Quantification of systemic risk from overlapping portfolios in the financial system
Financial markets are exposed to systemic risk, the risk that a substantial fraction of the system ceases to function and collapses. Systemic risk can propagate through different mechanisms and channels of contagion. One…
Non-concave utility maximisation on the positive real axis in discrete time
We treat a discrete-time asset allocation problem in an arbitrage-free, generically incomplete financial market, where the investor has a possibly non-concave utility function and wealth is restricted to remain non-negat…
Dynamic Mode Decomposition for Financial Trading Strategies
We demonstrate the application of an algorithmic trading strategy based upon the recently developed dynamic mode decomposition (DMD) on portfolios of financial data. The method is capable of characterizing complex dynami…
Algorithmic Trading