paper-with-me

Papers

Ai-Sampler: Adversarial Learning of Markov kernels with involutive maps

2024-06-04 · Evgenii Egorov, Ricardo Valperga, Efstratios Gavves

Markov chain Monte Carlo methods have become popular in statistics as versatile techniques to sample from complicated probability distributions. In this work, we propose a method to parameterize and train transition kernels of Markov chains to achieve efficient sampling and good mixing. This training procedure minimizes the total variation distance between the stationary distribution of the chain and the empirical distribution of the data. Our approach leverages involutive Metropolis-Hastings kernels constructed from reversible neural networks that ensure detailed balance by construction. We find that reversibility also implies $C_2$-equivariance of the discriminator function which can be used to restrict its function space.

📄 PDF Abstract BibTeX arXiv:2406.02490

Code (1)

ricvalp/aisampler 공식 구현 jax

Similar Papers 제목 키워드 기반

Asymptotically exact variational flows via involutive MCMC kernels

2025-06-02 · Zuheng Xu, Trevor Campbell

Most expressive variational families -- such as normalizing flows -- lack practical convergence guarantees, as their theoretical assurances typically hold only at the intractable global optimum. In this work, we present …

Nonparametric Involutive Markov Chain Monte Carlo

2022-11-02 · Carol Mak, Fabian Zaiser, Luke Ong

A challenging problem in probabilistic programming is to develop inference algorithms that work for arbitrary programs in a universal probabilistic programming language (PPL). We present the nonparametric involutive Mark…

Probabilistic Programming

Deep Involutive Generative Models for Neural MCMC

2020-06-26 · Span Spanbauer, Cameron Freer, Vikash Mansinghka

We introduce deep involutive generative models, a new architecture for deep generative modeling, and use them to define Involutive Neural MCMC, a new approach to fast neural MCMC. An involutive generative model represent…

valid

AutoStep: Locally adaptive involutive MCMC

2024-10-24 · Tiange Liu, Nikola Surjanovic, Miguel Biron-Lattes, Alexandre Bouchard-Côté 외

Many common Markov chain Monte Carlo (MCMC) kernels can be formulated using a deterministic involutive proposal with a step size parameter. Selecting an appropriate step size is often a challenging task in practice; and …

Transforming Worlds: Automated Involutive MCMC for Open-Universe Probabilistic Models

2020-11-23 · pproximateinference AABI Symposium 2021 1 · George Matheos, Alexander K. Lew, Matin Ghavamizadeh, Stuart Russell 외

Open-universe probabilistic models enable Bayesian inference about how many objects underlie data, and how they are related. Effective inference in OUPMs remains a challenge, however, often requiring the use of custom, t…

Bayesian InferenceProbabilistic Programmingvalid