Reinforcement Learning Closures for Underresolved Partial Differential Equations using Synthetic Data

2025-05-16 · Lothar Heimbach, Sebastian Kaltenbach, Petr Karnakov, Francis J. Alexander, Petros Koumoutsakos

Partial Differential Equations (PDEs) describe phenomena ranging from turbulence and epidemics to quantum mechanics and financial markets. Despite recent advances in computational science, solving such PDEs for real-world applications remains prohibitively expensive because of the necessity of resolving a broad range of spatiotemporal scales. In turn, practitioners often rely on coarse-grained approximations of the original PDEs, trading off accuracy for reduced computational resources. To mitigate the loss of detail inherent in such approximations, closure models are employed to represent unresolved spatiotemporal interactions. We present a framework for developing closure models for PDEs using synthetic data acquired through the method of manufactured solutions. These data are used in conjunction with reinforcement learning to provide closures for coarse-grained PDEs. We illustrate the efficacy of our method using the one-dimensional and two-dimensional Burgers' equations and the two-dimensional advection equation. Moreover, we demonstrate that closure models trained for inhomogeneous PDEs can be effectively generalized to homogeneous PDEs. The results demonstrate the potential for developing accurate and computationally efficient closure models for systems with scarce data.

📄 PDF Abstract BibTeX arXiv:2505.11308

Code (0)

등록된 구현이 없습니다.

Closure Discovery for Coarse-Grained Partial Differential Equations Using Grid-based Reinforcement Learning

2024-02-01 · Jan-Philipp von Bassewitz, Sebastian Kaltenbach, Petros Koumoutsakos

Reliable predictions of critical phenomena, such as weather, wildfires and epidemics often rely on models described by Partial Differential Equations (PDEs). However, simulations that capture the full range of spatio-tem…

Inductive Bias Multi-agent Reinforcement Learning

Deep learning-based numerical methods for high-dimensional parabolic partial differential equations and backward stochastic differential equations

2017-06-15 · Weinan E, Jiequn Han, Arnulf Jentzen

We propose a new algorithm for solving parabolic partial differential equations (PDEs) and backward stochastic differential equations (BSDEs) in high dimension, by making an analogy between the BSDE and reinforcement lea…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Deep Reinforcement Learning for Online Control of Stochastic Partial Differential Equations

2021-10-21 · NeurIPS Workshop DLDE 2021 12 · Erfan Pirmorad, Faraz Khoshbakhtian, Farnam Mansouri, Amir-Massoud Farahmand

In many areas, such as the physical sciences, life sciences, and finance, control approaches are used to achieve a desired goal in complex dynamical systems governed by differential equations. In this work we formulate t…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning (RL)

Parameter-Aware Ensemble SINDy for Interpretable Symbolic SGS Closure

2025-08-13 · Hanseul Kang, Ville Vuorinen, Shervin Karimkashi arxiv

This work designs a scalable, parameter-aware sparse regression framework for discovering interpretable partial differential equations and subgrid-scale closures from multi-parameter simulation data. Building on SINDy (S…

Learning black- and gray-box chemotactic PDEs/closures from agent based Monte Carlo simulation data

2022-05-26 · Seungjoon Lee, Yorgos M. Psarellis, Constantinos I. Siettos, Ioannis G. Kevrekidis

We propose a machine learning framework for the data-driven discovery of macroscopic chemotactic Partial Differential Equations (PDEs) -- and the closures that lead to them -- from high-fidelity, individual-based stochas…

BIG-bench Machine Learning Gaussian Processes