paper-with-me

홈 › Papers

Elucidating and Endowing the Diffusion Training Paradigm for General Image Restoration

2025-06-26 · Xin Lu, Xueyang Fu, Jie Xiao, Zihao Fan, Yurui Zhu, Zheng-Jun Zha

While diffusion models demonstrate strong generative capabilities in image restoration (IR) tasks, their complex architectures and iterative processes limit their practical application compared to mainstream reconstruction-based general ordinary IR networks. Existing approaches primarily focus on optimizing network architecture and diffusion paths but overlook the integration of the diffusion training paradigm within general ordinary IR frameworks. To address these challenges, this paper elucidates key principles for adapting the diffusion training paradigm to general IR training through systematic analysis of time-step dependencies, network hierarchies, noise-level relationships, and multi-restoration task correlations, proposing a new IR framework supported by diffusion-based training. To enable IR networks to simultaneously restore images and model generative representations, we introduce a series of regularization strategies that align diffusion objectives with IR tasks, improving generalization in single-task scenarios. Furthermore, recognizing that diffusion-based generation exerts varying influences across different IR tasks, we develop an incremental training paradigm and task-specific adaptors, further enhancing performance in multi-task unified IR. Experiments demonstrate that our method significantly improves the generalization of IR networks in single-task IR and achieves superior performance in multi-task unified IR. Notably, the proposed framework can be seamlessly integrated into existing general IR architectures.

📄 PDF Abstract BibTeX arXiv:2506.21722

Code (0)

등록된 구현이 없습니다.

Tasks

Image Restoration

Methods 이 논문이 사용한 방법론

ALIGN In the ALIGN method, visual and language representations are jointly trained from noisy image alt-text data. The image and text encoders are learned via contrastive loss…
Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…
Focus 설명 없음

Similar Papers 제목 키워드 기반

Latent Diffusion Counterfactual Explanations

2023-10-10 · Karim Farid, Simon Schrodi, Max Argus, Thomas Brox

Counterfactual explanations have emerged as a promising method for elucidating the behavior of opaque black-box models. Recently, several works leveraged pixel-space diffusion models for counterfactual generation. To han…

counterfactual

An Efficient Framework for Enhancing Discriminative Models via Diffusion Techniques

2024-12-12 · Chunxiao Li, Xiaoxiao Wang, Boming Miao, Chuanlong Xie 외

Image classification serves as the cornerstone of computer vision, traditionally achieved through discriminative models based on deep neural networks. Recent advancements have introduced classification methods derived fr…

Classificationimage-classificationImage Classificationzero-shot-classification+1

Elucidating Representation Degradation Problem in Diffusion Model Training

2026-05-11 · Zhipeng Yao, Dazhou Li, Zitong Zhang, Durude Mahee 외 arxiv

Diffusion models have achieved remarkable success, yet their training remains inefficient due to a severe optimization bottleneck, which we term Representation Degradation. As noise levels increase, the outputs of the tr…

Representation Learning

Elucidating the solution space of extended reverse-time SDE for diffusion models

2023-09-12 · Qinpeng Cui, Xinyi Zhang, Zongqing Lu, Qingmin Liao

Diffusion models (DMs) demonstrate potent image generation capabilities in various generative modeling tasks. Nevertheless, their primary limitation lies in slow sampling speed, requiring hundreds or thousands of sequent…

Image Generation

Elucidating The Design Space of Classifier-Guided Diffusion Generation

2023-10-17 · Jiajun Ma, Tianyang Hu, Wenjia Wang, Jiacheng Sun

Guidance in conditional diffusion generation is of great importance for sample quality and controllability. However, existing guidance schemes are to be desired. On one hand, mainstream methods such as classifier guidanc…

Conditional Image GenerationImage GenerationText to Image GenerationText-to-Image Generation