Actor-Critic Algorithm for High-dimensional Partial Differential Equations

2020-10-07 · Xiaohan Zhang

We develop a deep learning model to effectively solve high-dimensional nonlinear parabolic partial differential equations (PDE). We follow Feynman-Kac formula to reformulate PDE into the equivalent stochastic control problem governed by a Backward Stochastic Differential Equation (BSDE) system. The Markovian property of the BSDE is utilized in designing our neural network architecture, which is inspired by the Actor-Critic algorithm usually applied for deep Reinforcement Learning. Compared to the State-of-the-Art model, we make several improvements including 1) largely reduced trainable parameters, 2) faster convergence rate and 3) fewer hyperparameters to tune. We demonstrate those improvements by solving a few well-known classes of PDEs such as Hamilton-Jacobian-Bellman equation, Allen-Cahn equation and Black-Scholes equation with dimensions on the order of 100.

📄 PDF Abstract BibTeX arXiv:2010.03647

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement Learningreinforcement-learning Reinforcement Learning (RL)Vocal Bursts Intensity Prediction

Neural Actor-Critic Methods for Hamilton-Jacobi-Bellman PDEs: Asymptotic Analysis and Numerical Studies

2025-07-08 · Samuel N. Cohen, Jackson Hebner, Deqing Jiang, Justin Sirignano arxiv

We mathematically analyze and numerically study an actor-critic machine learning algorithm for solving high-dimensional Hamilton-Jacobi-Bellman (HJB) partial differential equations from stochastic control theory. The arc…

Actor-Critic Algorithm for High-dimensional PDEs

2021-09-27 · NeurIPS Workshop DLDE 2021 12 · Xiaohan Zhang

We develop a machine learning model to effectively solve high-dimensional nonlinear parabolic partial differential equations (PDE). We use Feynman-Kac formula to reformulate PDE into the equivalent stochastic control pro…

BIG-bench Machine Learning Vocal Bursts Intensity Prediction

Safe Reinforcement Learning From Pixels Using a Stochastic Latent Representation

2022-10-02 · Yannick Hogewind, Thiago D. Simao, Tal Kachman, Nils Jansen

We address the problem of safe reinforcement learning from pixel observations. Inherent challenges in such settings are (1) a trade-off between reward optimization and adhering to safety constraints, (2) partial observab…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Safe Reinforcement Learning

Residual Learning Inspired Crossover Operator and Strategy Enhancements for Evolutionary Multitasking

2025-03-27 · Ruilin Wang, Xiang Feng, Huiqun Yu, Edmund M-K Lai

In evolutionary multitasking, strategies such as crossover operators and skill factor assignment are critical for effective knowledge transfer. Existing improvements to crossover operators primarily focus on low-dimensio…

Super-Resolution Transfer Learning

Natural Actor-Critic Converges Globally for Hierarchical Linear Quadratic Regulator

2019-12-14 · Yuwei Luo, Zhuoran Yang, Zhaoran Wang, Mladen Kolar

Multi-agent reinforcement learning has been successfully applied to a number of challenging problems. Despite these empirical successes, theoretical understanding of different algorithms is lacking, primarily due to the …

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)