Deep Reinforcement Learning Algorithms for Option Hedging

2025-04-07 · Andrei Neagu, Frédéric Godin, Leila Kosseim

Dynamic hedging is a financial strategy that consists in periodically transacting one or multiple financial assets to offset the risk associated with a correlated liability. Deep Reinforcement Learning (DRL) algorithms have been used to find optimal solutions to dynamic hedging problems by framing them as sequential decision-making problems. However, most previous work assesses the performance of only one or two DRL algorithms, making an objective comparison across algorithms difficult. In this paper, we compare the performance of eight DRL algorithms in the context of dynamic hedging; Monte Carlo Policy Gradient (MCPG), Proximal Policy Optimization (PPO), along with four variants of Deep Q-Learning (DQL) and two variants of Deep Deterministic Policy Gradient (DDPG). Two of these variants represent a novel application to the task of dynamic hedging. In our experiments, we use the Black-Scholes delta hedge as a baseline and simulate the dataset using a GJR-GARCH(1,1) model. Results show that MCPG, followed by PPO, obtain the best performance in terms of the root semi-quadratic penalty. Moreover, MCPG is the only algorithm to outperform the Black-Scholes delta hedge baseline with the allotted computational budget, possibly due to the sparsity of rewards in our environment.

📄 PDF Abstract BibTeX arXiv:2504.05521

Code (1)

andrei-t-neagu/drl_in_finance 공식 구현 pytorch

Tasks

Deep Reinforcement LearningQ-Learningreinforcement-learning Reinforcement LearningSequential Decision Making

Methods 이 논문이 사용한 방법론

Entropy Regularization 설명 없음

PPO Proximal Policy Optimization, or PPO, is a policy gradient method for reinforcement learning. The motivation was to have an algorithm with the data efficiency and reliable…

Q-Learning Q-Learning is an off-policy temporal difference control algorithm: $$Q\left(S\_{t}, A\_{t}\right) \leftarrow Q\left(S\_{t}, A\_{t}\right) + \alpha\left[R_{t+1} +…

Applying Reinforcement Learning to Option Pricing and Hedging

2023-10-06 · Zoran Stoiljkovic

This thesis provides an overview of the recent advances in reinforcement learning in pricing and hedging financial instruments, with a primary focus on a detailed explanation of the Q-Learning Black Scholes approach, int…

Q-Learning reinforcement-learning Reinforcement Learning

Reinforcement Learning for Option Hedging: Static Implied-Volatility Fit versus Shortfall-Aware Performance

2026-01-05 · Ziheng Chen, Minxuan Hu, Jiayu Yi, Wenxi Sun arxiv

We extend the Q-learner in Black-Scholes (QLBS) framework by incorporating risk aversion and trading costs, and propose a novel Replication Learning of Option Pricing (RLOP) approach. Both methods are fully compatible wi…

Reinforcement Learning

A Risk Sensitive Contract-unified Reinforcement Learning Approach for Option Hedging

2024-11-14 · Xianhua Peng, Xiang Zhou, Bo Xiao, Yi Wu

We propose a new risk sensitive reinforcement learning approach for the dynamic hedging of options. The approach focuses on the minimization of the tail risk of the final P&L of the seller of an option. Different from mo…

reinforcement-learning Reinforcement Learning

Reinforcement Learning for Credit Index Option Hedging

2023-07-19 · Francesco Mandelli, Marco Pinciroli, Michele Trapletti, Edoardo Vittori

In this paper, we focus on finding the optimal hedging strategy of a credit index option using reinforcement learning. We take a practical approach, where the focus is on realism i.e. discrete time, transaction costs; ev…