paper-with-me

홈 › Papers

Enhancing Diffusion Model Stability for Image Restoration via Gradient Management

2025-07-09 · Hongjie Wu, Mingqin Zhang, Linchao He, Ji-Zhe Zhou, Jiancheng Lv arxiv

Diffusion models have shown remarkable promise for image restoration by leveraging powerful priors. Prominent methods typically frame the restoration problem within a Bayesian inference framework, which iteratively combines a denoising step with a likelihood guidance step. However, the interactions between these two components in the generation process remain underexplored. In this paper, we analyze the underlying gradient dynamics of these components and identify significant instabilities. Specifically, we demonstrate conflicts between the prior and likelihood gradient directions, alongside temporal fluctuations in the likelihood gradient itself. We show that these instabilities disrupt the generative process and compromise restoration performance. To address these issues, we propose Stabilized Progressive Gradient Diffusion (SPGD), a novel gradient management technique. SPGD integrates two synergistic components: (1) a progressive likelihood warm-up strategy to mitigate gradient conflicts; and (2) adaptive directional momentum (ADM) smoothing to reduce fluctuations in the likelihood gradient. Extensive experiments across diverse restoration tasks demonstrate that SPGD significantly enhances generation stability, leading to state-of-the-art performance in quantitative metrics and visually superior results. Code is available at https://github.com/74587887/SPGD.

📄 PDF Abstract BibTeX arXiv:2507.06656

Code (0)

등록된 구현이 없습니다.

Tasks

Bayesian InferenceImage Restoration

Similar Papers 제목 키워드 기반

GAN-Diff : Coupling Pretrained WGAN-GP Features with Conditional Diffusion U-Nets

2026-08-23 · Saif Ahmed, Asadullah Hil Galib, S. M. Riaz Rahman Antu, Ahmed Faizul Haque Dhrubo 외 arxiv

Generative adversarial networks (GANs) can provide efficient image generation, while diffusion models offer high-quality image restoration but require iterative sampling. This paper presents a hybrid GAN-guided diffusion…

Image RestorationImage Generation

DGSolver: Diffusion Generalist Solver with Universal Posterior Sampling for Image Restoration

2025-04-30 · Hebaixu Wang, Jing Zhang, HaoNan Guo, Di Wang 외

Diffusion models have achieved remarkable progress in universal image restoration. While existing methods speed up inference by reducing sampling steps, substantial step intervals often introduce cumulative errors. Moreo…

Image RestorationNoise Estimation

Multi-Step Guided Diffusion for Image Restoration on Edge Devices: Toward Lightweight Perception in Embodied AI

2025-06-08 · Aditya Chakravarty

Diffusion models have shown remarkable flexibility for solving inverse problems without task-specific retraining. However, existing approaches such as Manifold Preserving Guided Diffusion (MPGD) apply only a single gradi…

DeblurringDenoisingImage RestorationSuper-Resolution

Enhanced Control for Diffusion Bridge in Image Restoration

2024-08-29 · Conghan Yue, Zhengwei Peng, Junlong Ma, Dongyu Zhang

Image restoration refers to the process of restoring a damaged low-quality image back to its corresponding high-quality image. Typically, we use convolutional neural networks to directly learn the mapping from low-qualit…

DenoisingImage RestorationRain RemovalSuper-Resolution

SVFR: A Unified Framework for Generalized Video Face Restoration

2025-01-02 · CVPR 2025 1 · Zhiyao Wang, Xu Chen, Chengming Xu, Junwei Zhu 외

Face Restoration (FR) is a crucial area within image and video processing, focusing on reconstructing high-quality portraits from degraded inputs. Despite advancements in image FR, video FR remains relatively under-explo…

ColorizationRepresentation Learning