paper-with-me

홈 › Papers

Diffusion Models for Constrained Domains

2023-04-11 · Nic Fishman, Leo Klarner, Valentin De Bortoli, Emile Mathieu, Michael Hutchinson

Denoising diffusion models are a novel class of generative algorithms that achieve state-of-the-art performance across a range of domains, including image generation and text-to-image tasks. Building on this success, diffusion models have recently been extended to the Riemannian manifold setting, broadening their applicability to a range of problems from the natural and engineering sciences. However, these Riemannian diffusion models are built on the assumption that their forward and backward processes are well-defined for all times, preventing them from being applied to an important set of tasks that consider manifolds defined via a set of inequality constraints. In this work, we introduce a principled framework to bridge this gap. We present two distinct noising processes based on (i) the logarithmic barrier metric and (ii) the reflected Brownian motion induced by the constraints. As existing diffusion model techniques cannot be applied in this setting, we derive new tools to define such models in our framework. We then demonstrate the practical utility of our methods on a number of synthetic and real-world tasks, including applications from robotics and protein design.

📄 PDF Abstract BibTeX arXiv:2304.05364

Code (1)

oxcsml/constrained-diffusion 공식 구현 jax

Tasks

DenoisingImage GenerationProtein DesignUnconditional Image Generation

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Mirror Diffusion Models

2023-08-11 · Jaesung Tae

Diffusion models have successfully been applied to generative tasks in various continuous domains. However, applying diffusion to discrete categorical data remains a non-trivial task. Moreover, generation in continuous d…

Text Generation

Reflected Schrödinger Bridge for Constrained Generative Modeling

2024-01-06 · Wei Deng, Yu Chen, Nicole Tianjiao Yang, Hengrong Du 외

Diffusion models have become the go-to method for large-scale generative models in real-world applications. These applications often involve data distributions confined within bounded domains, typically requiring ad-hoc …

Mirror Diffusion Models for Constrained and Watermarked Generation

2023-10-02 · NeurIPS 2023 11 · Guan-Horng Liu, Tianrong Chen, Evangelos A. Theodorou, Molei Tao

Modern successes of diffusion models in learning complex, high-dimensional data distributions are attributed, in part, to their capability to construct diffusion processes with analytic transition kernels and score funct…

Diffusion-MPC in Discrete Domains: Feasibility Constraints, Horizon Effects, and Critic Alignment: Case study with Tetris

2026-03-02 · Haochuan Kevin Wang arxiv

We study diffusion-based model predictive control (Diffusion-MPC) in discrete combinatorial domains using Tetris as a case study. Our planner samples candidate placement sequences with a MaskGIT-style discrete denoiser a…

Constrained Diffusion with Trust Sampling

2024-11-17 · William Huang, Yifeng Jiang, Tom Van Wouwe, C. Karen Liu

Diffusion models have demonstrated significant promise in various generative tasks; however, they often struggle to satisfy challenging constraints. Our approach addresses this limitation by rethinking training-free loss…

Motion Generation