paper-with-me

Papers

Variational Inference for SDEs Driven by Fractional Noise

2023-10-19 · Rembert Daems, Manfred Opper, Guillaume Crevecoeur, Tolga Birdal

We present a novel variational framework for performing inference in (neural) stochastic differential equations (SDEs) driven by Markov-approximate fractional Brownian motion (fBM). SDEs offer a versatile tool for modeling real-world continuous-time dynamic systems with inherent noise and randomness. Combining SDEs with the powerful inference capabilities of variational methods, enables the learning of representative function distributions through stochastic gradient descent. However, conventional SDEs typically assume the underlying noise to follow a Brownian motion (BM), which hinders their ability to capture long-term dependencies. In contrast, fractional Brownian motion (fBM) extends BM to encompass non-Markovian dynamics, but existing methods for inferring fBM parameters are either computationally demanding or statistically inefficient. In this paper, building upon the Markov approximation of fBM, we derive the evidence lower bound essential for efficient variational inference of posterior path measures, drawing from the well-established field of stochastic analysis. Additionally, we provide a closed-form expression to determine optimal approximation coefficients. Furthermore, we propose the use of neural networks to learn the drift, diffusion and control terms within our variational posterior, leading to the variational training of neural-SDEs. In this framework, we also optimize the Hurst index, governing the nature of our fractional noise. Beyond validation on synthetic data, we contribute a novel architecture for variational latent video prediction,-an approach that, to the best of our knowledge, enables the first variational neural-SDE application to video perception.

📄 PDF Abstract BibTeX arXiv:2310.12975

Code (0)

등록된 구현이 없습니다.

Tasks

Variational InferenceVideo Prediction

Methods 이 논문이 사용한 방법론

Variational Inference 설명 없음
Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Variational Inference for Lévy Process-Driven SDEs via Neural Tilting

2026-05-11 · Yaman Kindap, Manfred Opper, Benjamin Dupuis, Umut Simsekli 외 arxiv

Modelling extreme events and heavy-tailed phenomena is central to building reliable predictive systems in domains such as finance, climate science, and safety-critical AI. While Lévy processes provide a natural mathemati…

Bayesian Inference

SigMA: Path Signatures and Multi-head Attention for Learning Parameters in fBm-driven SDEs

2025-12-17 · Xianglin Wu, Chiheb Ben Hammouda, Cornelis W. Oosterlee arxiv

Stochastic differential equations (SDEs) driven by fractional Brownian motion (fBm) are increasingly used to model systems with rough dynamics and long-range dependence, such as those arising in quantitative finance and …

Rényi Differential Privacy for Heavy-Tailed SDEs via Fractional Poincaré Inequalities

2025-11-19 · Benjamin Dupuis, Mert Gürbüzbalaban, Umut Şimşekli, Jian Wang 외 arxiv

Characterizing the differential privacy (DP) of learning algorithms has become a major challenge in recent years. In parallel, many studies suggested investigating the behavior of stochastic gradient descent (SGD) with h…

Score-fPINN: Fractional Score-Based Physics-Informed Neural Networks for High-Dimensional Fokker-Planck-Levy Equations

2024-06-17 · Zheyuan Hu, Zhongqiang Zhang, George Em Karniadakis, Kenji Kawaguchi

We introduce an innovative approach for solving high-dimensional Fokker-Planck-L\'evy (FPL) equations in modeling non-Brownian processes across disciplines such as physics, finance, and ecology. We utilize a fractional s…

Variational inference of fractional Brownian motion with linear computational complexity

2022-03-15 · Hippolyte Verdier, François Laurent, Alhassan Cassé, Christian Vestergaard 외

We introduce a simulation-based, amortised Bayesian inference scheme to infer the parameters of random walks. Our approach learns the posterior distribution of the walks' parameters with a likelihood-free method. In the …

Bayesian InferenceGraph Neural NetworkVariational Inference