paper-with-me

홈 › Papers

Learning Robust Statistics for Simulation-based Inference under Model Misspecification

2023-05-25 · NeurIPS 2023 11 · Daolang Huang, Ayush Bharti, Amauri Souza, Luigi Acerbi, Samuel Kaski

Simulation-based inference (SBI) methods such as approximate Bayesian computation (ABC), synthetic likelihood, and neural posterior estimation (NPE) rely on simulating statistics to infer parameters of intractable likelihood models. However, such methods are known to yield untrustworthy and misleading inference outcomes under model misspecification, thus hindering their widespread applicability. In this work, we propose the first general approach to handle model misspecification that works across different classes of SBI methods. Leveraging the fact that the choice of statistics determines the degree of misspecification in SBI, we introduce a regularized loss function that penalises those statistics that increase the mismatch between the data and the model. Taking NPE and ABC as use cases, we demonstrate the superior performance of our method on high-dimensional time-series models that are artificially misspecified. We also apply our method to real data from the field of radio propagation where the model is known to be misspecified. We show empirically that the method yields robust inference in misspecified scenarios, whilst still being accurate when the model is well-specified.

📄 PDF Abstract BibTeX arXiv:2305.15871

Code (1)

huangdaolang/robust-sbi 공식 구현 pytorch

Tasks

Time Series

Methods 이 논문이 사용한 방법론

ABC Class of methods in Bayesian Statistics where the posterior distribution is approximated over a rejection scheme on simulations because the likelihood function is…

Similar Papers 제목 키워드 기반

Simulation-based Bayesian inference under model misspecification

2025-03-16 · Ryan P. Kelly, David J. Warne, David T. Frazier, David J. Nott 외

Simulation-based Bayesian inference (SBI) methods are widely used for parameter estimation in complex models where evaluating the likelihood is challenging but generating simulations is relatively straightforward. Howeve…

Bayesian Inferencemodelparameter estimation

Detecting Model Misspecification in Amortized Bayesian Inference with Neural Networks

2021-12-16 · Marvin Schmitt, Paul-Christian Bürkner, Ullrich Köthe, Stefan T. Radev

Neural density estimators have proven remarkably powerful in performing efficient simulation-based Bayesian inference in various research domains. In particular, the BayesFlow framework uses a two-step approach to enable…

Bayesian InferenceDecision Makingparameter estimationProbabilistic Deep Learning

Misspecification-robust amortised simulation-based inference using variational methods

2025-09-06 · Matthew O'Callaghan, Kaisey S. Mandel, Gerry Gilmore arxiv

Recent advances in neural density estimation have enabled powerful simulation-based inference (SBI) methods that can flexibly approximate Bayesian inference for intractable stochastic models. Although these methods have …

Density EstimationBayesian Inference

Probably approximate Bayesian computation: nonasymptotic convergence of ABC under misspecification

2017-07-19 · James Ridgway

Approximate Bayesian computation (ABC) is a widely used inference method in Bayesian statistics to bypass the point-wise computation of the likelihood. In this paper we develop theoretical bounds for the distance between…

Investigating the Impact of Model Misspecification in Neural Simulation-based Inference

2022-09-05 · Patrick Cannon, Daniel Ward, Sebastian M. Schmon

Aided by advances in neural density estimation, considerable progress has been made in recent years towards a suite of simulation-based inference (SBI) methods capable of performing flexible, black-box, approximate Bayes…

Bayesian InferenceDensity Estimation