paper-with-me

Papers

Metropolis Sampling for Constrained Diffusion Models

2023-07-11 · NeurIPS 2023 11

Denoising diffusion models have recently emerged as the predominant paradigm for generative modelling on image domains. In addition, their extension to Riemannian manifolds has facilitated a range of applications across the natural sciences. While many of these problems stand to benefit from the ability to specify arbitrary, domain-informed constraints, this setting is not covered by the existing (Riemannian) diffusion model methodology. Recent work has attempted to address this issue by constructing novel noising processes based on the reflected Brownian motion and logarithmic barrier methods. However, the associated samplers are either computationally burdensome or only apply to convex subsets of Euclidean space. In this paper, we introduce an alternative, simple noising scheme based on Metropolis sampling that affords substantial gains in computational efficiency and empirical performance compared to the earlier samplers. Of independent interest, we prove that this new process corresponds to a valid discretisation of the reflected Brownian motion. We demonstrate the scalability and flexibility of our approach on a range of problem settings with convex and non-convex constraints, including applications from geospatial modelling, robotics and protein design.

📄 PDF Abstract BibTeX arXiv:2307.05439

Code (0)

등록된 구현이 없습니다.

Tasks

Computational EfficiencyDenoisingProtein Designvalid

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Fast sampling from constrained spaces using the Metropolis-adjusted Mirror Langevin algorithm

2023-12-14 · Vishwak Srinivasan, Andre Wibisono, Ashia Wilson

We propose a new method called the Metropolis-adjusted Mirror Langevin algorithm for approximate sampling from distributions whose support is a compact and convex set. This algorithm adds an accept-reject filter to the M…

Score-Based Metropolis-Hastings Algorithms

2024-12-31 · Ahmed Aloui, Ali Hasan, Juncheng Dong, Zihao Wu 외

In this paper, we introduce a new approach for integrating score-based models with the Metropolis-Hastings algorithm. While traditional score-based diffusion models excel in accurately learning the score function from da…

Sampling Data with Chains of Forward-Backward Diffusion Steps

2026-05-26 · Hyunmo Kang, Noam Itzhak Levi, Corinna Elena Wegner, Daniel J. Korchinski 외 arxiv

Sampling from learned high-dimensional distributions is a foundational computational problem. We introduce U-turn chains: Markov chains obtained by iterating short forward-backward steps of a diffusion model, in which ea…

Jump-Diffusion Langevin Dynamics for Multimodal Posterior Sampling

2022-11-02 · Jacopo Guidolin, Vyacheslav Kungurtsev, Ondřej Kuželka

Bayesian methods of sampling from a posterior distribution are becoming increasingly popular due to their ability to precisely display the uncertainty of a model fit. Classical methods based on iterative random sampling …

Optimal dimension dependence of the Metropolis-Adjusted Langevin Algorithm

2020-12-23 · Sinho Chewi, Chen Lu, Kwangjun Ahn, Xiang Cheng 외

Conventional wisdom in the sampling literature, backed by a popular diffusion scaling limit, suggests that the mixing time of the Metropolis-Adjusted Langevin Algorithm (MALA) scales as $O(d^{1/3})$, where $d$ is the dim…