paper-with-me

Papers

Stein Variational Evolution Strategies

2024-10-14 · Cornelius V. Braun, Robert T. Lange, Marc Toussaint

Stein Variational Gradient Descent (SVGD) is a highly efficient method to sample from an unnormalized probability distribution. However, the SVGD update relies on gradients of the log-density, which may not always be available. Existing gradient-free versions of SVGD make use of simple Monte Carlo approximations or gradients from surrogate distributions, both with limitations. To improve gradient-free Stein variational inference, we combine SVGD steps with evolution strategy (ES) updates. Our results demonstrate that the resulting algorithm generates high-quality samples from unnormalized target densities without requiring gradient information. Compared to prior gradient-free SVGD methods, we find that the integration of the ES update in SVGD significantly improves the performance on multiple challenging benchmark problems.

📄 PDF Abstract BibTeX arXiv:2410.10390

Code (0)

등록된 구현이 없습니다.

Tasks

Variational Inference

Similar Papers 제목 키워드 기반

Sampling with Mirrored Stein Operators

2021-06-23 · ICLR 2022 4 · Jiaxin Shi, Chang Liu, Lester Mackey

We introduce a new family of particle evolution samplers suitable for constrained domains and non-Euclidean geometries. Stein Variational Mirror Descent and Mirrored Stein Variational Gradient Descent minimize the Kullba…

valid

Ancestral protein sequence reconstruction using a tree-structured Ornstein-Uhlenbeck variational autoencoder

2021-09-29 · ICLR 2022 4 · Lys Sanz Moreta, Ola Rønning, Ahmad Salim Al-Sibahi, Jotun Hein 외

We introduce a deep generative model for representation learning of biological sequences that, unlike existing models, explicitly represents the evolutionary process. The model makes use of a tree-structured Ornstein-Uhl…

Representation Learning

Regularized Stein Variational Gradient Flow

2022-11-15 · Ye He, Krishnakumar Balasubramanian, Bharath K. Sriperumbudur, Jianfeng Lu

The Stein Variational Gradient Descent (SVGD) algorithm is a deterministic particle method for sampling. However, a mean-field analysis reveals that the gradient flow corresponding to the SVGD algorithm (i.e., the Stein …

Wasserstein Variational Inference

2018-05-29 · NeurIPS 2018 12 · Luca Ambrogioni, Umut Güçlü, Yağmur Güçlütürk, Max Hinne 외

This paper introduces Wasserstein variational inference, a new form of approximate Bayesian inference based on optimal transport theory. Wasserstein variational inference uses a new family of divergences that includes bo…

Bayesian InferenceVariational Inference

EinSteinVI: General and Integrated Stein Variational Inference

2021-09-29 · Ola Rønning, Ahmad Salim Al-Sibahi, Christophe Ley, Thomas Hamelryck

Stein variational inference is a technique for approximate Bayesian inference that has recently gained popularity because it combines the scalability of variational inference (VI) with the flexibility of non-parametric i…

Bayesian InferenceProbabilistic ProgrammingVariational Inference