Variational Inference for Continuous-Time Switching Dynamical Systems
Switching dynamical systems provide a powerful, interpretable modeling framework for inference in time-series data in, e.g., the natural sciences or engineering applications. Since many areas, such as biology or discrete-event systems, are naturally described in continuous time, we present a model based on an Markov jump process modulating a subordinated diffusion process. We provide the exact evolution equations for the prior and posterior marginal densities, the direct solutions of which are however computationally intractable. Therefore, we develop a new continuous-time variational inference algorithm, combining a Gaussian process approximation on the diffusion level with posterior inference for Markov jump processes. By minimizing the path-wise Kullback-Leibler divergence we obtain (i) Bayesian latent state estimates for arbitrary points on the real axis and (ii) point estimates of unknown system parameters, utilizing variational expectation maximization. We extensively evaluate our algorithm under the model assumption and for real-world examples.
Code (0)
등록된 구현이 없습니다.
Tasks
Time SeriesTime Series AnalysisVariational InferenceMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Markov Chain Monte Carlo for Continuous-Time Switching Dynamical Systems
Switching dynamical systems are an expressive model class for the analysis of time-series data. As in many fields within the natural and engineering sciences, the systems under study typically evolve continuously in time…
parameter estimationTime SeriesTime Series AnalysisVariational InferenceCollapsed Amortized Variational Inference for Switching Nonlinear Dynamical Systems
We propose an efficient inference method for switching nonlinear dynamical systems. The key idea is to learn an inference network which can be used as a proposal distribution for the continuous latent variables, while pe…
Time SeriesTime Series AnalysisVariational InferenceRecurrent switching linear dynamical systems
Many natural systems, such as neurons firing in the brain or basketball teams traversing a court, give rise to time series data with complex, nonlinear dynamics. We can gain insight into these systems by decomposing the …
Bayesian InferenceTime SeriesTime Series AnalysisDeep Explicit Duration Switching Models for Time Series
Many complex time series can be effectively subdivided into distinct regimes that exhibit persistent dynamics. Discovering the switching behavior and the statistical patterns in these regimes is important for understandi…
Time SeriesTime Series AnalysisVariational Inference and Learning of Piecewise-linear Dynamical Systems
Modeling the temporal behavior of data is of primordial importance in many scientific and engineering fields. Baseline methods assume that both the dynamic and observation equations follow linear-Gaussian models. However…
Head Pose EstimationModel SelectionPose EstimationPose Tracking+2