paper-with-me

홈 › Papers

DeeDSR: Towards Real-World Image Super-Resolution via Degradation-Aware Stable Diffusion

2024-03-31 · Chunyang Bi, Xin Luo, Sheng Shen, Mengxi Zhang, Huanjing Yue, Jingyu Yang

Diffusion models, known for their powerful generative capabilities, play a crucial role in addressing real-world super-resolution challenges. However, these models often focus on improving local textures while neglecting the impacts of global degradation, which can significantly reduce semantic fidelity and lead to inaccurate reconstructions and suboptimal super-resolution performance. To address this issue, we introduce a novel two-stage, degradation-aware framework that enhances the diffusion model's ability to recognize content and degradation in low-resolution images. In the first stage, we employ unsupervised contrastive learning to obtain representations of image degradations. In the second stage, we integrate a degradation-aware module into a simplified ControlNet, enabling flexible adaptation to various degradations based on the learned representations. Furthermore, we decompose the degradation-aware features into global semantics and local details branches, which are then injected into the diffusion denoising module to modulate the target generation. Our method effectively recovers semantically precise and photorealistic details, particularly under significant degradation conditions, demonstrating state-of-the-art performance across various benchmarks. Codes will be released at https://github.com/bichunyang419/DeeDSR.

📄 PDF Abstract BibTeX arXiv:2404.00661

Code (1)

bichunyang419/deedsr 공식 구현 pytorch

Tasks

Contrastive LearningDenoisingImage Super-ResolutionSuper-Resolution

Methods 이 논문이 사용한 방법론

Contrastive Learning 설명 없음
Focus 설명 없음
Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Real-World Single Image Super-Resolution Under Rainy Condition

2022-06-16 · Mohammad Shahab Uddin

Image super-resolution is an important research area in computer vision that has a wide variety of applications including surveillance, medical imaging etc. Real-world signal image super-resolution has become very popula…

Image Super-ResolutionSuper-Resolution

High-Resolution Be Aware! Improving the Self-Supervised Real-World Super-Resolution

2024-11-25 · Yuehan Zhang, Angela Yao

Self-supervised learning is crucial for super-resolution because ground-truth images are usually unavailable for real-world settings. Existing methods derive self-supervision from low-resolution images by creating pseudo…

Self-Supervised LearningSuper-Resolution

Real-World Image Super Resolution via Unsupervised Bi-directional Cycle Domain Transfer Learning based Generative Adversarial Network

2022-11-19 · Xiang Wang, Yimin Yang, Zhichang Guo, Zhili Zhou 외

Deep Convolutional Neural Networks (DCNNs) have exhibited impressive performance on image super-resolution tasks. However, these deep learning-based super-resolution methods perform poorly in real-world super-resolution …

Generative Adversarial NetworkImage Super-ResolutionSuper-ResolutionTransfer Learning

Real-World Super-Resolution via Kernel Estimation and Noise Injection

2020-06-19 · CVPRW 2020 6 · Xiaozhong Ji, Yun Cao, Ying Tai, Chengjie Wang 외

Recent state-of-the-art super-resolution methods have achieved impressive performance on ideal datasets regardless of blur and noise. However, these methods always fail in real-world image super-resolution, since most of…

Image Super-ResolutionSuper-ResolutionVideo Super-Resolution

Unsupervised Learning for Real-World Super-Resolution

2019-09-20 · Andreas Lugmayr, Martin Danelljan, Radu Timofte

Most current super-resolution methods rely on low and high resolution image pairs to train a network in a fully supervised manner. However, such image pairs are not available in real-world applications. Instead of direct…

Image Super-ResolutionSuper-Resolution