Assumed Density Filtering and Smoothing with Neural Network Surrogate Models
The Kalman filter and Rauch-Tung-Striebel (RTS) smoother are optimal for state estimation in linear dynamic systems. With nonlinear systems, the challenge consists in how to propagate uncertainty through the state transitions and output function. For the case of a neural network model, we enable accurate uncertainty propagation using a recent state-of-the-art analytic formula for computing the mean and covariance of a deep neural network with Gaussian input. We argue that cross entropy is a more appropriate performance metric than RMSE for evaluating the accuracy of filters and smoothers. We demonstrate the superiority of our method for state estimation on a stochastic Lorenz system and a Wiener system, and find that our method enables more optimal linear quadratic regulation when the state estimate is used for feedback. Code available at https: //github.com/simontheflutist/analytic-moments.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Variational Bayesian surrogate modelling with application to robust design optimisation
Surrogate models provide a quick-to-evaluate approximation to complex computational models and are essential for multi-query problems like design optimisation. The inputs of current deterministic computational models are…
Bayesian InferenceDimensionality ReductionRobust DesignHybrid PHD-PMB Trajectory Smoothing Using Backward Simulation
The probability hypothesis density (PHD) and Poisson multi-Bernoulli (PMB) filters are two popular set-type multi-object filters. Motivated by the fact that the multi-object filtering density after each update step in th…
ObjectSIXO: Smoothing Inference with Twisted Objectives
Sequential Monte Carlo (SMC) is an inference algorithm for state space models that approximates the posterior by sampling from a sequence of target distributions. The target distributions are often chosen to be the filte…
Density Ratio EstimationState Space ModelsFiltering and smoothing estimation algorithms from uncertain nonlinear observations with time-correlated additive noise and random deception attacks
This paper discusses the problem of estimating a stochastic signal from nonlinear uncertain observations with time-correlated additive noise described by a first-order Markov process. Random deception attacks are assumed…
On latent position inference from doubly stochastic messaging activities
We model messaging activities as a hierarchical doubly stochastic point process with three main levels, and develop an iterative algorithm for inferring actors' relative latent positions from a stream of messaging activi…
Position