Generalized Posteriors in Approximate Bayesian Computation
Complex simulators have become a ubiquitous tool in many scientific disciplines, providing high-fidelity, implicit probabilistic models of natural and social phenomena. Unfortunately, they typically lack the tractability required for conventional statistical analysis. Approximate Bayesian computation (ABC) has emerged as a key method in simulation-based inference, wherein the true model likelihood and posterior are approximated using samples from the simulator. In this paper, we draw connections between ABC and generalized Bayesian inference (GBI). First, we re-interpret the accept/reject step in ABC as an implicitly defined error model. We then argue that these implicit error models will invariably be misspecified. While ABC posteriors are often treated as a necessary evil for approximating the standard Bayesian posterior, this allows us to re-interpret ABC as a potential robustification strategy. This leads us to suggest the use of GBI within ABC, a use case we explore empirically.
Code (1)
Tasks
Bayesian InferenceSimilar Papers 제목 키워드 기반
Generalized Variational Inference: Three arguments for deriving new Posteriors
We advocate an optimization-centric view on and introduce a novel generalization of Bayesian inference. Our inspiration is the representation of Bayes' rule as infinite-dimensional optimization problem (Csiszar, 1975; Do…
Bayesian InferenceGaussian ProcessesVariational InferenceApproximate Decentralized Bayesian Inference
This paper presents an approximate method for performing Bayesian inference in models with conditional independence over a decentralized network of learning agents. The method first employs variational inference on each …
Bayesian InferenceVariational InferenceBayesian Joint Chance Constrained Optimization: Approximations and Statistical Consistency
This paper considers data-driven chance-constrained stochastic optimization problems in a Bayesian framework. Bayesian posteriors afford a principled mechanism to incorporate data and prior knowledge into stochastic opti…
Stochastic OptimizationBI-EqNO: Generalized Approximate Bayesian Inference with an Equivariant Neural Operator Framework
Bayesian inference offers a robust framework for updating prior beliefs based on new data using Bayes' theorem, but exact inference is often computationally infeasible, necessitating approximate methods. Though widely us…
Bayesian InferenceGaussian ProcessesGeneralized Bayes for Causal Inference
Uncertainty quantification is central to many applications of causal machine learning, yet principled Bayesian inference for causal effects remains challenging. Standard Bayesian approaches typically require specifying a…
Bayesian InferenceCausal Inference