paper-with-me

Papers

Bayesian score calibration for approximate models

2022-11-10 · Joshua J Bon, David J Warne, David J Nott, Christopher Drovandi

Scientists continue to develop increasingly complex mechanistic models to reflect their knowledge more realistically. Statistical inference using these models can be challenging since the corresponding likelihood function is often intractable and model simulation may be computationally burdensome. Fortunately, in many of these situations, it is possible to adopt a surrogate model or approximate likelihood function. It may be convenient to conduct Bayesian inference directly with the surrogate, but this can result in bias and poor uncertainty quantification. In this paper we propose a new method for adjusting approximate posterior samples to reduce bias and produce more accurate uncertainty quantification. We do this by optimizing a transform of the approximate posterior that maximizes a scoring rule. Our approach requires only a (fixed) small number of complex model simulations and is numerically stable. We demonstrate good performance of the new method on several examples of increasing complexity.

📄 PDF Abstract BibTeX arXiv:2211.05357

Code (1)

bonstats/bayesscorecal.jl 공식 구현

Tasks

Bayesian Inferencescoring ruleUncertainty Quantification

Methods 이 논문이 사용한 방법론

BASE 설명 없음

Similar Papers 제목 키워드 기반

Uncertainty Quantification of Large Language Models using Approximate Bayesian Computation

2025-09-19 · Mridul Sharma, Adeetya Patel, Zaneta D' Souza, Samira Abbasgholizadeh Rahimi 외 arxiv

Despite their widespread applications, Large Language Models (LLMs) often struggle to express uncertainty, posing a challenge for reliable deployment in high stakes and safety critical domains like clinical diagnostics. …

Bayesian Inference

Not All Relevance Scores are Equal: Efficient Uncertainty and Calibration Modeling for Deep Retrieval Models

2021-05-10 · Daniel Cohen, Bhaskar Mitra, Oleg Lesota, Navid Rekabsaz 외

In any ranking system, the retrieval model outputs a single score for a document based on its belief on how relevant it is to a given search query. While retrieval models have continued to improve with the introduction o…

AllRerankingRetrieval

Bayesian calibration for forensic evidence reporting

2014-03-24 · Niko Brümmer, Albert Swart

We introduce a Bayesian solution for the problem in forensic speaker recognition, where there may be very little background material for estimating score calibration parameters. We work within the Bayesian paradigm of ev…

Speaker Recognition

Variational Calibration of Computer Models

2018-10-29 · Sébastien Marmin, Maurizio Filippone

Bayesian calibration of black-box computer models offers an established framework to obtain a posterior distribution over model parameters. Traditional Bayesian calibration involves the emulation of the computer model an…

Gaussian ProcessesVariational Inference

Generative Modelling for Unsupervised Score Calibration

2013-11-04 · Niko Brümmer, Daniel Garcia-Romero

Score calibration enables automatic speaker recognizers to make cost-effective accept / reject decisions. Traditional calibration requires supervised data, which is an expensive resource. We propose a 2-component GMM for…