paper-with-me

홈 › Papers

Probabilistic learning of nonlinear dynamical systems using sequential Monte Carlo

2017-03-07 · Thomas B. Schön, Andreas Svensson, Lawrence Murray, Fredrik Lindsten

Probabilistic modeling provides the capability to represent and manipulate uncertainty in data, models, predictions and decisions. We are concerned with the problem of learning probabilistic models of dynamical systems from measured data. Specifically, we consider learning of probabilistic nonlinear state-space models. There is no closed-form solution available for this problem, implying that we are forced to use approximations. In this tutorial we will provide a self-contained introduction to one of the state-of-the-art methods---the particle Metropolis--Hastings algorithm---which has proven to offer a practical approximation. This is a Monte Carlo based method, where the particle filter is used to guide a Markov chain Monte Carlo method through the parameter space. One of the key merits of the particle Metropolis--Hastings algorithm is that it is guaranteed to converge to the "true solution" under mild assumptions, despite being based on a particle filter with only a finite number of particles. We will also provide a motivating numerical example illustrating the method using a modeling language tailored for sequential Monte Carlo methods. The intention of modeling languages of this kind is to open up the power of sophisticated Monte Carlo methods---including particle Metropolis--Hastings---to a large group of users without requiring them to know all the underlying mathematical details.

📄 PDF Abstract BibTeX arXiv:1703.02419

Code (0)

등록된 구현이 없습니다.

Tasks

State Space Models

Similar Papers 제목 키워드 기반

Deep Dynamic Probabilistic Canonical Correlation Analysis

2025-02-07 · Shiqin Tang, Shujian Yu, Yining Dong, S. Joe Qin

This paper presents Deep Dynamic Probabilistic Canonical Correlation Analysis (D2PCCA), a model that integrates deep learning with probabilistic modeling to analyze nonlinear dynamical systems. Building on the probabilis…

Probabilistic Numeric SMC Sampling for Bayesian Nonlinear System Identification in Continuous Time

2024-04-19 · Joe D. Longbottom, Max D. Champneys, Timothy J. Rogers

In engineering, accurately modeling nonlinear dynamic systems from data contaminated by noise is both essential and complex. Established Sequential Monte Carlo (SMC) methods, used for the Bayesian identification of these…

Numerical Integration

Delayed Sampling and Automatic Rao-Blackwellization of Probabilistic Programs

2017-08-25 · Lawrence M. Murray, Daniel Lundén, Jan Kudlicka, David Broman 외

We introduce a dynamic mechanism for the solution of analytically-tractable substructure in probabilistic programs, using conjugate priors and affine transformations to reduce variance in Monte Carlo estimators. For infe…

parameter estimationProbabilistic Programming

Data-driven Sequential Monte Carlo in Probabilistic Programming

2015-12-14 · Yura N. Perov, Tuan Anh Le, Frank Wood

Most of Markov Chain Monte Carlo (MCMC) and sequential Monte Carlo (SMC) algorithms in existing probabilistic programming systems suboptimally use only model priors as proposal distributions. In this work, we describe an…

Probabilistic Programming

Sequential Monte Carlo Bandits

2018-08-08 · Iñigo Urteaga, Chris H. Wiggins

We extend Bayesian multi-armed bandit (MAB) algorithms beyond their original setting by making use of sequential Monte Carlo (SMC) methods. A MAB is a sequential decision making problem where the goal is to learn a polic…

Decision MakingSequential Decision MakingThompson Sampling