paper-with-me

Papers

All-in-one simulation-based inference

2024-04-15 · Manuel Gloeckler, Michael Deistler, Christian Weilbach, Frank Wood, Jakob H. Macke

Amortized Bayesian inference trains neural networks to solve stochastic inference problems using model simulations, thereby making it possible to rapidly perform Bayesian inference for any newly observed data. However, current simulation-based amortized inference methods are simulation-hungry and inflexible: They require the specification of a fixed parametric prior, simulator, and inference tasks ahead of time. Here, we present a new amortized inference method -- the Simformer -- which overcomes these limitations. By training a probabilistic diffusion model with transformer architectures, the Simformer outperforms current state-of-the-art amortized inference approaches on benchmark tasks and is substantially more flexible: It can be applied to models with function-valued parameters, it can handle inference scenarios with missing or unstructured data, and it can sample arbitrary conditionals of the joint distribution of parameters and data, including both posterior and likelihood. We showcase the performance and flexibility of the Simformer on simulators from ecology, epidemiology, and neuroscience, and demonstrate that it opens up new possibilities and application domains for amortized Bayesian inference on simulation-based models.

📄 PDF Abstract BibTeX arXiv:2404.09636

Code (1)

mackelab/simformer 공식 구현 jax

Tasks

AllBayesian InferenceEpidemiology

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Simulation-Efficient Cosmological Inference with Multi-Fidelity SBI

2025-07-01 · Leander Thiele, Adrian E. Bayer, Naoya Takeishi arxiv

The simulation cost for cosmological simulation-based inference can be decreased by combining simulation sets of varying fidelity. We propose an approach to such multi-fidelity inference based on feature matching and kno…

Knowledge Distillation

Field-level weak lensing cosmology with $<100$ simulations using multifidelity simulation-based inference

2026-06-22 · Alex A. Saoulis, Kiyam Lin, Niall Jeffrey, Maximilian von Wietersheim-Kramsta 외 arxiv

We perform a realistic KiDS-Legacy mock analysis with field-level neural compression and simulation-based inference using fewer than 100 $N$-body simulations. The weak lensing shear field encodes substantially more cosmo…

Low-Budget Simulation-Based Inference with Bayesian Neural Networks

2024-08-27 · Arnaud Delaunoy, Maxence de la Brassinne Bonardeaux, Siddharth Mishra-Sharma, Gilles Louppe

Simulation-based inference methods have been shown to be inaccurate in the data-poor regime, when training simulations are limited or expensive. Under these circumstances, the inference network is particularly prone to o…

sbi reloaded: a toolkit for simulation-based inference workflows

2024-11-26 · Jan Boelts, Michael Deistler, Manuel Gloeckler, Álvaro Tejero-Cantero 외

Scientists and engineers use simulators to model empirically observed phenomena. However, tuning the parameters of a simulator to ensure its outputs match observed data presents a significant challenge. Simulation-based …

Bayesian InferenceDiagnostic

The frontier of simulation-based inference

2019-11-04 · Kyle Cranmer, Johann Brehmer, Gilles Louppe

Many domains of science have developed complex simulations to describe phenomena of interest. While these simulations provide high-fidelity models, they are poorly suited for inference and lead to challenging inverse pro…