An Easy to Interpret Diagnostic for Approximate Inference: Symmetric Divergence Over Simulations
It is important to estimate the errors of probabilistic inference algorithms. Existing diagnostics for Markov chain Monte Carlo methods assume inference is asymptotically exact, and are not appropriate for approximate methods like variational inference or Laplace's method. This paper introduces a diagnostic based on repeatedly simulating datasets from the prior and performing inference on each. The central observation is that it is possible to estimate a symmetric KL-divergence defined over these simulations.
Code (0)
등록된 구현이 없습니다.
Tasks
DiagnosticVariational InferenceMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Discovering Inductive Bias with Gibbs Priors: A Diagnostic Tool for Approximate Bayesian Inference
Full Bayesian posteriors are rarely analytically tractable, which is why real-world Bayesian inference heavily relies on approximate techniques. Approximations generally differ from the true posterior and require diagnos…
Bayesian InferenceDiagnosticInductive BiasL-C2ST: Local Diagnostics for Posterior Approximations in Simulation-Based Inference
Many recent works in simulation-based inference (SBI) rely on deep generative models to approximate complex, high-dimensional posterior distributions. However, evaluating whether or not these approximations can be truste…
On Calibrated Model Uncertainty in Deep Learning
Estimated uncertainty by approximate posteriors in Bayesian neural networks are prone to miscalibration, which leads to overconfident predictions in critical tasks that have a clear asymmetric cost or significant losses.…
Deep LearningDiagnosticmodelPredictionA General Framework for Symmetric Property Estimation
In this paper we provide a general framework for estimating symmetric properties of distributions from i.i.d. samples. For a broad class of symmetric properties we identify the easy region where empirical estimation work…
A Probabilistic Rotation Representation for Symmetric Shapes With an Efficiently Computable Bingham Loss Function
In recent years, a deep learning framework has been widely used for object pose estimation. While quaternion is a common choice for rotation representation, it cannot represent the ambiguity of the observation. In order …
Pose Estimation