Deep Hedging Under Non-Convexity: Limitations and a Case for AlphaZero
This paper examines replication portfolio construction in incomplete markets - a key problem in financial engineering with applications in pricing, hedging, balance sheet management, and energy storage planning. We model this as a two-player game between an investor and the market, where the investor makes strategic bets on future states while the market reveals outcomes. Inspired by the success of Monte Carlo Tree Search in stochastic games, we introduce an AlphaZero-based system and compare its performance to deep hedging - a widely used industry method based on gradient descent. Through theoretical analysis and experiments, we show that deep hedging struggles in environments where the optimal action-value function is not subject to convexity constraints - such as those involving non-convex transaction costs, capital constraints, or regulatory limitations - converging to local optima. We construct specific market environments to highlight these limitations and demonstrate that AlphaZero consistently finds near-optimal replication strategies. On the theoretical side, we establish a connection between deep hedging and convex optimization, suggesting that its effectiveness is contingent on convexity assumptions. Our experiments further suggest that AlphaZero is more sample-efficient - an important advantage in data-scarce, overfitting-prone derivative markets.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Robustness of Delta Hedging in a Jump-Diffusion Model
Suppose an investor aims at Delta hedging a European contingent claim $h(S(T))$ in a jump-diffusion model, but incorrectly specifies the stock price's volatility and jump sensitivity, so that any hedging strategy is calc…
SensitivityThe Entropy of Artificial Intelligence and a Case Study of AlphaZero from Shannon's Perspective
The recently released AlphaZero algorithm achieves superhuman performance in the games of chess, shogi and Go, which raises two open questions. Firstly, as there is a finite number of possibilities in the game, is there …
Reinforcement LearningRepresentation Matters for Mastering Chess: Improved Feature Representation in AlphaZero Outperforms Switching to Transformers
While transformers have gained recognition as a versatile tool for artificial intelligence (AI), an unexplored challenge arises in the context of chess - a classical AI benchmark. Here, incorporating Vision Transformers …
Game of ChessQuadratic Hedging and Optimization of Option Exercise Policies
Quadratic hedging of option payoffs generates the variance optimal martingale measure. When an option features an exercise policy and its cash flows are hedged according to this approach, it may be tempting to optimize s…
Experimental Analysis of Deep Hedging Using Artificial Market Simulations for Underlying Asset Simulators
Derivative hedging and pricing are important and continuously studied topics in financial markets. Recently, deep hedging has been proposed as a promising approach that uses deep learning to approximate the optimal hedgi…