paper-with-me

Papers

Amortized Bayesian Mixture Models

2025-01-17 · Šimon Kucharský, Paul Christian Bürkner

Finite mixtures are a broad class of models useful in scenarios where observed data is generated by multiple distinct processes but without explicit information about the responsible process for each data point. Estimating Bayesian mixture models is computationally challenging due to issues such as high-dimensional posterior inference and label switching. Furthermore, traditional methods such as MCMC are applicable only if the likelihoods for each mixture component are analytically tractable. Amortized Bayesian Inference (ABI) is a simulation-based framework for estimating Bayesian models using generative neural networks. This allows the fitting of models without explicit likelihoods, and provides fast inference. ABI is therefore an attractive framework for estimating mixture models. This paper introduces a novel extension of ABI tailored to mixture models. We factorize the posterior into a distribution of the parameters and a distribution of (categorical) mixture indicators, which allows us to use a combination of generative neural networks for parameter inference, and classification networks for mixture membership identification. The proposed framework accommodates both independent and dependent mixture models, enabling filtering and smoothing. We validate and demonstrate our approach through synthetic and real-world datasets.

📄 PDF Abstract BibTeX arXiv:2501.10229

Code (0)

등록된 구현이 없습니다.

Tasks

Bayesian Inference

Similar Papers 제목 키워드 기반

BayesFlow: Amortized Bayesian Workflows With Neural Networks

2023-06-28 · Stefan T Radev, Marvin Schmitt, Lukas Schumacher, Lasse Elsemüller 외

Modern Bayesian inference involves a mixture of computational techniques for estimating, validating, and drawing conclusions from probabilistic models as part of principled workflows for data analysis. Typical problems i…

Bayesian InferenceData Compression

Amortized Bayesian inference for clustering models

2018-11-24 · Ari Pakman, Liam Paninski

We develop methods for efficient amortized approximate Bayesian inference over posterior distributions of probabilistic clustering models, such as Dirichlet process mixture models. The approach is based on mapping distri…

Bayesian InferenceClustering

ALINE: Joint Amortization for Bayesian Inference and Active Data Acquisition

2025-06-08 · Daolang Huang, Xinyi Wen, Ayush Bharti, Samuel Kaski 외

Many critical applications, from autonomous scientific discovery to personalized medicine, demand systems that can both strategically acquire the most informative data and instantaneously perform inference based upon it.…

Active LearningBayesian InferenceExperimental Designscientific discovery

BayesFlow 2: Multi-Backend Amortized Bayesian Inference in Python

2026-02-06 · Lars Kühmichel, Jerry M. Huang, Valentin Pratz, Jonas Arruda 외 arxiv

Modern Bayesian inference involves a mixture of computational methods for estimating, validating, and drawing conclusions from probabilistic models as part of principled workflows. An overarching motif of many Bayesian m…

Hyperparameter OptimizationDensity EstimationBayesian Inference

Recursive Inference for Variational Autoencoders

2020-11-17 · NeurIPS 2020 12 · Minyoung Kim, Vladimir Pavlovic

Inference networks of traditional Variational Autoencoders (VAEs) are typically amortized, resulting in relatively inaccurate posterior approximation compared to instance-wise variational optimization. Recent semi-amorti…

Variational Inference