paper-with-me

Papers

Variational Smoothing and Inference for SDEs from Sparse Data with Dynamic Neural Flows

2026-05-07 · Yu Wang, Arnab Ganguly arxiv

Stochastic differential equations (SDEs) provide a flexible framework for modeling temporal dynamics in partially observed systems. A central task is to calibrate such models from data, which requires inferring latent trajectories and parameters from sparse, noisy observations. Classical smoothing methods for this problem are often limited by path degeneracy and poor scalability. In this work, we developed a novel method based on characterization of the posterior SDE in terms of conditional backward-in-time score defined as the gradient of a function solving a Kolmogorov backward equation with multiplicative updates at observation times. We learn this conditional score using neural networks trained to satisfy both the governing PDE and the observation-induced jump conditions, thereby integrating continuous-time dynamics with discrete Bayesian updates. The resulting score induces a posterior SDE with the same diffusion coefficient but a modified drift, enabling efficient posterior trajectory sampling. We further derive a likelihood-based objective for learning the SDE parameters, yielding an evidence lower bound (ELBO) for joint state smoothing and parameter estimation. This leads to a variational EM-style procedure, where the neural conditional score is optimized to approximate the smoothing distribution, followed by a maximization step over the SDE parameters using samples from the induced posterior. Experiments on nonlinear systems demonstrate accurate and stable inference with a very few observations demonstrating significant improved scalability compared to classical MCMC methods.

📄 PDF Abstract BibTeX arXiv:2605.05606

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Variational Inference for SDEs Driven by Fractional Noise

2023-10-19 · Rembert Daems, Manfred Opper, Guillaume Crevecoeur, Tolga Birdal

We present a novel variational framework for performing inference in (neural) stochastic differential equations (SDEs) driven by Markov-approximate fractional Brownian motion (fBM). SDEs offer a versatile tool for modeli…

Variational InferenceVideo Prediction

Variational Inference for Lévy Process-Driven SDEs via Neural Tilting

2026-05-11 · Yaman Kindap, Manfred Opper, Benjamin Dupuis, Umut Simsekli 외 arxiv

Modelling extreme events and heavy-tailed phenomena is central to building reliable predictive systems in domains such as finance, climate science, and safety-critical AI. While Lévy processes provide a natural mathemati…

Bayesian Inference

Sparse Gaussian Processes for Stochastic Differential Equations

2021-09-27 · NeurIPS Workshop DLDE 2021 12 · Prakhar Verma, Vincent Adam, Arno Solin

We frame the problem of learning stochastic differential equations (SDEs) from noisy observations as an inference problem and aim to maximize the marginal likelihood of the observations in a joint model of the latent pat…

Gaussian ProcessesVariational Inference

Sparse Inducing Points in Deep Gaussian Processes: Enhancing Modeling with Denoising Diffusion Variational Inference

2024-07-24 · Jian Xu, Delu Zeng, John Paisley

Deep Gaussian processes (DGPs) provide a robust paradigm for Bayesian deep learning. In DGPs, a set of sparse integration locations called inducing points are selected to approximate the posterior distribution of the mod…

DenoisingGaussian ProcessesVariational Inference

Stochastic Normalizing Flows

2020-02-21 · NeurIPS 2020 12 · Liam Hodgkinson, Chris van der Heide, Fred Roosta, Michael W. Mahoney

We introduce stochastic normalizing flows, an extension of continuous normalizing flows for maximum likelihood estimation and variational inference (VI) using stochastic differential equations (SDEs). Using the theory of…

Variational Inference