paper-with-me

Papers

Unleashing the Denoising Capability of Diffusion Prior for Solving Inverse Problems

2024-06-11 · Jiawei Zhang, Jiaxin Zhuang, Cheng Jin, Gen Li, Yuantao Gu

The recent emergence of diffusion models has significantly advanced the precision of learnable priors, presenting innovative avenues for addressing inverse problems. Since inverse problems inherently entail maximum a posteriori estimation, previous works have endeavored to integrate diffusion priors into the optimization frameworks. However, prevailing optimization-based inverse algorithms primarily exploit the prior information within the diffusion models while neglecting their denoising capability. To bridge this gap, this work leverages the diffusion process to reframe noisy inverse problems as a two-variable constrained optimization task by introducing an auxiliary optimization variable. By employing gradient truncation, the projection gradient descent method is efficiently utilized to solve the corresponding optimization problem. The proposed algorithm, termed ProjDiff, effectively harnesses the prior information and the denoising capability of a pre-trained diffusion model within the optimization framework. Extensive experiments on the image restoration tasks and source separation and partial generation tasks demonstrate that ProjDiff exhibits superior performance across various linear and nonlinear inverse problems, highlighting its potential for practical applications. Code is available at https://github.com/weigerzan/ProjDiff/.

📄 PDF Abstract BibTeX arXiv:2406.06959

Code (1)

weigerzan/projdiff 공식 구현 pytorch

Tasks

DenoisingImage Restoration

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Structured 3D Latents Are Surprisingly Powerful: Unleashing Generalizable Style with 2D Diffusion

2026-05-06 · Yiran Qiao, Yiren Lu, Yunlai Zhou, Disheng Liu 외 arxiv

3D asset generation plays a pivotal role in fields such as gaming and virtual reality, enabling the rapid synthesis of high-fidelity 3D objects from a single or multiple images. Building on this capability, enabling styl…

Style Transfer3D Generation

Unleashing Guidance Without Classifiers for Human-Object Interaction Animation

2026-03-26 · Ziyin Wang, Sirui Xu, Chuan Guo, Bing Zhou 외 arxiv

Generating realistic human-object interaction (HOI) animations remains challenging because it requires jointly modeling dynamic human actions and diverse object geometries. Prior diffusion-based approaches often rely on …

JPEG Artifact Correction using Denoising Diffusion Restoration Models

2022-09-23 · Bahjat Kawar, Jiaming Song, Stefano Ermon, Michael Elad

Diffusion models can be used as learned priors for solving various inverse problems. However, most existing approaches are restricted to linear inverse problems, limiting their applicability to more general cases. In thi…

DenoisingJPEG Artifact Correction

Intriguing Properties of Diffusion Models: An Empirical Study of the Natural Attack Capability in Text-to-Image Generative Models

2023-08-30 · CVPR 2024 1 · Takami Sato, Justin Yue, Nanze Chen, Ningfei Wang 외

Denoising probabilistic diffusion models have shown breakthrough performance to generate more photo-realistic images or human-level illustrations than the prior models such as GANs. This high image-generation capability …

DenoisingImage Generation

Unleashing Uncertainty: Efficient Machine Unlearning for Generative AI

2025-08-28 · Christoforos N. Spartalis, Theodoros Semertzidis, Petros Daras, Efstratios Gavves arxiv

We introduce SAFEMax, a novel method for Machine Unlearning in diffusion models. Grounded in information-theoretic principles, SAFEMax maximizes the entropy in generated images, causing the model to generate Gaussian noi…