On optimal tracking portfolio in incomplete markets: The reinforcement learning approach
This paper studies an infinite horizon optimal tracking portfolio problem using capital injection in incomplete market models. The benchmark process is modelled by a geometric Brownian motion with zero drift driven by some unhedgeable risk. The relaxed tracking formulation is adopted where the fund account compensated by the injected capital needs to outperform the benchmark process at any time, and the goal is to minimize the cost of the discounted total capital injection. When model parameters are known, we formulate the equivalent auxiliary control problem with reflected state dynamics, for which the classical solution of the HJB equation with Neumann boundary condition is obtained explicitly. When model parameters are unknown, we introduce the exploratory formulation for the auxiliary control problem with entropy regularization and develop the continuous-time q-learning algorithm in models of reflected diffusion processes. In some illustrative numerical example, we show the satisfactory performance of the q-learning algorithm.
Code (0)
등록된 구현이 없습니다.
Tasks
Q-LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Cost-efficiency in Incomplete Markets
This paper studies the topic of cost-efficiency in incomplete markets. A payoff is called cost-efficient if it achieves a given probability distribution at some given investment horizon with a minimum initial budget. Ext…
Wealth Effect on Portfolio Allocation in Incomplete Markets
We develop a novel five-component decomposition of optimal dynamic portfolio choice, which reveals the simultaneous impacts from market incompleteness and wealth-dependent utilities. Under the HARA utility and a nonrando…
Optimal portfolio under ratio-type periodic evaluation in incomplete markets with stochastic factors
This paper studies a type of periodic utility maximization for portfolio management in an incomplete market model, where the underlying price diffusion process depends on some external stochastic factors. The portfolio p…
ManagementFactor Representation and Decision Making in Stock Markets Using Deep Reinforcement Learning
Deep Reinforcement learning is a branch of unsupervised learning in which an agent learns to act based on environment state in order to maximize its total reward. Deep reinforcement learning provides good opportunity to …
Decision MakingDeep Reinforcement LearningManagementreinforcement-learning+2Value-at-Risk constrained portfolios in incomplete markets: a dynamic programming approach to Heston's model
We solve an expected utility-maximization problem with a Value-at-risk constraint on the terminal portfolio value in an incomplete financial market due to stochastic volatility. To derive the optimal investment strategy,…