paper-with-me

홈 › Papers

DynGMA: a robust approach for learning stochastic differential equations from data

2024-02-22 · Aiqing Zhu, Qianxiao Li

Learning unknown stochastic differential equations (SDEs) from observed data is a significant and challenging task with applications in various fields. Current approaches often use neural networks to represent drift and diffusion functions, and construct likelihood-based loss by approximating the transition density to train these networks. However, these methods often rely on one-step stochastic numerical schemes, necessitating data with sufficiently high time resolution. In this paper, we introduce novel approximations to the transition density of the parameterized SDE: a Gaussian density approximation inspired by the random perturbation theory of dynamical systems, and its extension, the dynamical Gaussian mixture approximation (DynGMA). Benefiting from the robust density approximation, our method exhibits superior accuracy compared to baseline methods in learning the fully unknown drift and diffusion functions and computing the invariant distribution from trajectory data. And it is capable of handling trajectory data with low time resolution and variable, even uncontrollable, time step sizes, such as data generated from Gillespie's stochastic simulations. We then conduct several experiments across various scenarios to verify the advantages and robustness of the proposed method.

📄 PDF Abstract BibTeX arXiv:2402.14475

Code (1)

aiqing-zhu/dyngma 공식 구현 pytorch

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Universal approximation property of neural stochastic differential equations

2025-03-20 · Anna P. Kwossek, David J. Prömel, Josef Teichmann

We identify various classes of neural networks that are able to approximate continuous functions locally uniformly subject to fixed global linear growth constraints. For such neural networks the associated neural stochas…

Scalable Gradients for Stochastic Differential Equations

2020-01-05 · Xuechen Li, Ting-Kam Leonard Wong, Ricky T. Q. Chen, David Duvenaud

The adjoint sensitivity method scalably computes gradients of solutions to ordinary differential equations. We generalize this method to stochastic differential equations, allowing time-efficient and constant-memory comp…

SensitivityVariational InferenceVideo Prediction

Deep Forward-Backward SDEs for Min-max Control

2019-06-11 · Ziyi Wang, Keuntaek Lee, Marcus A. Pereira, Ioannis Exarchos 외

This paper presents a novel approach to numerically solve stochastic differential games for nonlinear systems. The proposed approach relies on the nonlinear Feynman-Kac theorem that establishes a connection between parab…

Set-Valued Risk Measures as Backward Stochastic Difference Inclusions and Equations

2019-12-14 · Çağın Ararat, Zachary Feinstein

Scalar dynamic risk measures for univariate positions in continuous time are commonly represented as backward stochastic differential equations. In the multivariate setting, dynamic risk measures have been defined and st…

DiffEqFlux.jl - A Julia Library for Neural Differential Equations

2019-02-06 · Chris Rackauckas, Mike Innes, Yingbo Ma, Jesse Bettencourt 외

DiffEqFlux.jl is a library for fusing neural networks and differential equations. In this work we describe differential equations from the viewpoint of data science and discuss the complementary nature between machine le…

BIG-bench Machine Learning