paper-with-me

Papers

Sampling with Mirrored Stein Operators

2021-06-23 · ICLR 2022 4 · Jiaxin Shi, Chang Liu, Lester Mackey

We introduce a new family of particle evolution samplers suitable for constrained domains and non-Euclidean geometries. Stein Variational Mirror Descent and Mirrored Stein Variational Gradient Descent minimize the Kullback-Leibler (KL) divergence to constrained target distributions by evolving particles in a dual space defined by a mirror map. Stein Variational Natural Gradient exploits non-Euclidean geometry to more efficiently minimize the KL divergence to unconstrained targets. We derive these samplers from a new class of mirrored Stein operators and adaptive kernels developed in this work. We demonstrate that these new samplers yield accurate approximations to distributions on the simplex, deliver valid confidence intervals in post-selection inference, and converge more rapidly than prior methods in large-scale unconstrained posterior inference. Finally, we establish the convergence of our new procedures under verifiable conditions on the target distribution.

📄 PDF Abstract BibTeX arXiv:2106.12506

Code (2)

thjashin/mirror-stein-samplers 공식 구현 tf
louissharrock/constrained-coin-sampling

Tasks

valid

Similar Papers 제목 키워드 기반

A Note on the Convergence of Mirrored Stein Variational Gradient Descent under $(L_0,L_1)-$Smoothness Condition

2022-06-20 · Lukang Sun, Peter Richtárik

In this note, we establish a descent lemma for the population limit Mirrored Stein Variational Gradient Method~(MSVGD). This descent lemma does not rely on the path information of MSVGD but rather on a simple assumption …

LEMMA

Learning Rate Free Sampling in Constrained Domains

2023-05-24 · Louis Sharrock, Lester Mackey, Christopher Nemeth

We introduce a suite of new particle-based algorithms for sampling in constrained domains which are entirely learning rate free. Our approach leverages coin betting ideas from convex optimisation, and the viewpoint of co…

Fairness

Learning Rate Free Bayesian Inference in Constrained Domains

2023-09-21 · NeurIPS 2023 11

We introduce a suite of new particle-based algorithms for sampling on constrained domains which are entirely learning rate free. Our approach leverages coin betting ideas from convex optimisation, and the viewpoint of co…

Unsupervised Anomaly Detection with Adversarial Mirrored AutoEncoders

2020-03-24 · Gowthami Somepalli, Yexin Wu, Yogesh Balaji, Bhanukiran Vinzamuri 외

Detecting out of distribution (OOD) samples is of paramount importance in all Machine Learning applications. Deep generative modeling has emerged as a dominant paradigm to model complex data distributions without labels.…

Anomaly DetectionOut of Distribution (OOD) DetectionRepresentation LearningUnsupervised Anomaly Detection

Probabilistic Inference and Learning with Stein's Method

2026-03-08 · Qiang Liu, Lester Mackey, Chris Oates arxiv

This monograph provides a rigorous overview of theoretical and methodological aspects of probabilistic inference and learning with Stein's method. Recipes are provided for constructing Stein discrepancies from Stein oper…