Deep Bellman Hedging
We present an actor-critic-type reinforcement learning algorithm for solving the problem of hedging a portfolio of financial instruments such as securities and over-the-counter derivatives using purely historic data. The key characteristics of our approach are: the ability to hedge with derivatives such as forwards, swaps, futures, options; incorporation of trading frictions such as trading cost and liquidity constraints; applicability for any reasonable portfolio of financial instruments; realistic, continuous state and action spaces; and formal risk-adjusted return objectives. Most importantly, the trained model provides an optimal hedge for arbitrary initial portfolios and market states without the need for re-training. We also prove existence of finite solutions to our Bellman equation, and show the relation to our vanilla Deep Hedging approach
Code (0)
등록된 구현이 없습니다.
Tasks
reinforcement-learningReinforcement Learning (RL)Similar Papers 제목 키워드 기반
Implementing portfolio risk management and hedging in practice
In academic literature portfolio risk management and hedging are often versed in the language of stochastic control and Hamilton--Jacobi--Bellman~(HJB) equations in continuous time. In practice the continuous-time framew…
ManagementRobust Bayesian Dynamic Programming for On-policy Risk-sensitive Reinforcement Learning
We propose a novel framework for risk-sensitive reinforcement learning (RSRL) that incorporates robustness against transition uncertainty. We define two distinct yet coupled risk measures: an inner risk measure addressin…
Reinforcement LearningAdaptive hedging horizon and hedging performance estimation
In this study, we constitute an adaptive hedging method based on empirical mode decomposition (EMD) method to extract the adaptive hedging horizon and build a time series cross-validation method for robust hedging perfor…
Time SeriesTime Series AnalysisEfficient Learning of Nested Deep Hedging using Multiple Options
Deep hedging is a framework for hedging derivatives in the presence of market frictions. In this study, we focus on the problem of hedging a given target option by using multiple options. To extend the deep hedging frame…
Mean-variance hedging of unit linked life insurance contracts in a jump-diffusion model
We consider a time-consistent mean-variance portfolio selection problem of an insurer and allow for the incorporation of basis (mortality) risk. The optimal solution is identified with a Nash subgame perfect equilibrium.…