Scalable Bayesian Learning for State Space Models using Variational Inference with SMC Samplers
We present a scalable approach to performing approximate fully Bayesian inference in generic state space models. The proposed method is an alternative to particle MCMC that provides fully Bayesian inference of both the dynamic latent states and the static parameters of the model. We build up on recent advances in computational statistics that combine variational methods with sequential Monte Carlo sampling and we demonstrate the advantages of performing full Bayesian inference over the static parameters rather than just performing variational EM approximations. We illustrate how our approach enables scalable inference in multivariate stochastic volatility models and self-exciting point process models that allow for flexible dynamics in the latent intensity function.
Code (0)
등록된 구현이 없습니다.
Tasks
Bayesian InferenceState Space ModelsVariational InferenceSimilar Papers 제목 키워드 기반
Variational Inference for Bayesian Neural Networks under Model and Parameter Uncertainty
Bayesian neural networks (BNNs) have recently regained a significant amount of attention in the deep learning community due to the development of scalable approximate Bayesian inference techniques. There are several adva…
Bayesian InferenceVariational InferenceScalable Bayesian Low-Rank Adaptation of Large Language Models via Stochastic Variational Subspace Inference
Despite their widespread use, large language models (LLMs) are known to hallucinate incorrect information and be poorly calibrated. This makes the uncertainty quantification of these models of critical importance, especi…
Bayesian InferenceUncertainty QuantificationVariational InferenceSpecifying Weight Priors in Bayesian Deep Neural Networks with Empirical Bayes
Stochastic variational inference for Bayesian deep neural network (DNN) requires specifying priors and approximate posterior distributions over neural network weights. Specifying meaningful weight priors is a challenging…
Activity RecognitionAudio ClassificationBayesian InferenceGeneral Classification+4Combining Model and Parameter Uncertainty in Bayesian Neural Networks
Bayesian neural networks (BNNs) have recently regained a significant amount of attention in the deep learning community due to the development of scalable approximate Bayesian inference techniques. There are several adva…
Bayesian InferenceModel SelectionVariational InferenceLearning Active Subspaces for Effective and Scalable Uncertainty Quantification in Deep Neural Networks
Bayesian inference for neural networks, or Bayesian deep learning, has the potential to provide well-calibrated predictions with quantified uncertainty and robustness. However, the main hurdle for Bayesian deep learning …
Bayesian InferenceDeep LearningUncertainty QuantificationVariational Inference