paper-with-me

홈 › Papers

GenDeg: Diffusion-Based Degradation Synthesis for Generalizable All-in-One Image Restoration

2024-11-26 · CVPR 2025 1 · Sudarshan Rajagopalan, Nithin Gopalakrishnan Nair, Jay N. Paranjape, Vishal M. Patel

Deep learning-based models for All-In-One Image Restoration (AIOR) have achieved significant advancements in recent years. However, their practical applicability is limited by poor generalization to samples outside the training distribution. This limitation arises primarily from insufficient diversity in degradation variations and scenes within existing datasets, resulting in inadequate representations of real-world scenarios. Additionally, capturing large-scale real-world paired data for degradations such as haze, low-light, and raindrops is often cumbersome and sometimes infeasible. In this paper, we leverage the generative capabilities of latent diffusion models to synthesize high-quality degraded images from their clean counterparts. Specifically, we introduce GenDeg, a degradation and intensity-aware conditional diffusion model capable of producing diverse degradation patterns on clean images. Using GenDeg, we synthesize over 550k samples across six degradation types: haze, rain, snow, motion blur, low-light, and raindrops. These generated samples are integrated with existing datasets to form the GenDS dataset, comprising over 750k samples. Our experiments reveal that image restoration models trained on the GenDS dataset exhibit significant improvements in out-of-distribution performance compared to those trained solely on existing datasets. Furthermore, we provide comprehensive analyses on the implications of diffusion model-based synthetic degradations for AIOR. The code will be made publicly available.

📄 PDF Abstract BibTeX arXiv:2411.17687

Code (0)

등록된 구현이 없습니다.

Tasks

AllImage Restoration

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

GAURA: Generalizable Approach for Unified Restoration and Rendering of Arbitrary Views

2024-07-11 · Vinayak Gupta, Rongali Simhachala Venkata Girish, Mukund Varma T, Ayush Tewari 외

Neural rendering methods can achieve near-photorealistic image synthesis of scenes from posed input images. However, when the images are imperfect, e.g., captured in very low-light conditions, state-of-the-art methods fa…

DeblurringImage GenerationNeural RenderingNovel View Synthesis+1

DiHuR: Diffusion-Guided Generalizable Human Reconstruction

2024-11-16 · Jinnan Chen, Chen Li, Gim Hee Lee

We introduce DiHuR, a novel Diffusion-guided model for generalizable Human 3D Reconstruction and view synthesis from sparse, minimally overlapping images. While existing generalizable human radiance fields excel at novel…

3D ReconstructionNovel View SynthesisTransfer Learning

One-Shot Novel View and Pose Human Image Synthesis via 3D Prior Guided Diffusion Model

2026-06-18 · Shenjian Gong, Kangkan Wang, Shanshan Zhang, Jian Yang arxiv

This paper addresses the challenge of one-shot novel view and pose human image synthesis. The existing methods transfer the reference human image to a target pose using a set of 2D pose keypoints or synthesize human imag…

Pose Transfer

Towards Generalizable Tumor Synthesis

2024-02-29 · CVPR 2024 1 · Qi Chen, Xiaoxi Chen, Haorui Song, Zhiwei Xiong 외

Tumor synthesis enables the creation of artificial tumors in medical images, facilitating the training of AI models for tumor detection and segmentation. However, success in tumor synthesis hinges on creating visually re…

Computed Tomography (CT)

FeatureNeRF: Learning Generalizable NeRFs by Distilling Foundation Models

2023-03-22 · ICCV 2023 1 · Jianglong Ye, Naiyan Wang, Xiaolong Wang

Recent works on generalizable NeRFs have shown promising results on novel view synthesis from single or few images. However, such models have rarely been applied on other downstream tasks beyond synthesis such as semanti…

NeRFNeural RenderingNovel View Synthesis