Switching Linear Dynamics for Variational Bayes Filtering

2019-05-29 · Philip Becker-Ehmck, Jan Peters, Patrick van der Smagt

System identification of complex and nonlinear systems is a central problem for model predictive control and model-based reinforcement learning. Despite their complexity, such systems can often be approximated well by a set of linear dynamical systems if broken into appropriate subsequences. This mechanism not only helps us find good approximations of dynamics, but also gives us deeper insight into the underlying system. Leveraging Bayesian inference, Variational Autoencoders and Concrete relaxations, we show how to learn a richer and more meaningful state space, e.g. encoding joint constraints and collisions with walls in a maze, from partial and high-dimensional observations. This representation translates into a gain of accuracy of learned dynamics showcased on various simulated tasks.

📄 PDF Abstract BibTeX arXiv:1905.12434

Code (0)

등록된 구현이 없습니다.

Tasks

Bayesian InferenceModel-based Reinforcement LearningModel Predictive Controlreinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

A Generalized Framework for Multiscale State-Space Modeling with Nested Nonlinear Dynamics: An Application to Bayesian Learning under Switching Regimes

2024-10-24 · Nayely Vélez-Cruz, Manfred D. Laubichler

In this work, we introduce a generalized framework for multiscale state-space modeling that incorporates nested nonlinear dynamics, with a specific focus on Bayesian learning under switching regimes. Our framework captur…

Streaming Variational Monte Carlo

2019-06-04 · Yuan Zhao, Josue Nassar, Ian Jordan, Mónica Bugallo 외

Nonlinear state-space models are powerful tools to describe dynamical structures in complex time series. In a streaming setting where data are processed one sample at a time, simultaneous inference of the state and its n…

Gaussian Processes State Space Models Time Series Time Series Analysis+2

Bayesian Nonparametric Dynamical Clustering of Time Series

2025-10-08 · Adrián Pérez-Herrero, Paulo Félix, Jesús Presedo, Carl Henrik Ek arxiv

We present a method that models the evolution of an unbounded number of time series clusters by switching among an unknown number of regimes with linear dynamics. We develop a Bayesian non-parametric approach using a hie…

Ensemble Kalman Variational Objectives: Nonlinear Latent Trajectory Inference with A Hybrid of Variational Inference and Ensemble Kalman Filter

2020-10-17 · Tsuyoshi Ishizone, Tomoyuki Higuchi, Kazuyuki Nakamura

Variational inference (VI) combined with Bayesian nonlinear filtering produces state-of-the-art results for latent time-series modeling. A body of recent work has focused on sequential Monte Carlo (SMC) and its variants,…

Diversity State Space Models Time Series Time Series Analysis+1

Linear State-Space Model with Time-Varying Dynamics

2014-10-02 · Jaakko Luttinen, Tapani Raiko, Alexander Ilin

This paper introduces a linear state-space model with time-varying dynamics. The time dependency is obtained by forming the state dynamics matrix as a time-varying linear combination of a set of matrices. The time depend…

model