Towards a Universal Image Degradation Model via Content-Degradation Disentanglement
Image degradation synthesis is highly desirable in a wide variety of applications ranging from image restoration to simulating artistic effects. Existing models are designed to generate one specific or a narrow set of degradations, which often require user-provided degradation parameters. As a result, they lack the generalizability to synthesize degradations beyond their initial design or adapt to other applications. Here we propose the first universal degradation model that can synthesize a broad spectrum of complex and realistic degradations containing both homogeneous (global) and inhomogeneous (spatially varying) components. Our model automatically extracts and disentangles homogeneous and inhomogeneous degradation features, which are later used for degradation synthesis without user intervention. A disentangle-by-compression method is proposed to separate degradation information from images. Two novel modules for extracting and incorporating inhomogeneous degradations are created to model inhomogeneous components in complex degradations. We demonstrate the model's accuracy and adaptability in film-grain simulation and blind image restoration tasks. The demo video, code, and dataset of this project will be released upon publication at github.com/yangwenbo99/content-degradation-disentanglement.
Code (0)
등록된 구현이 없습니다.
Tasks
DisentanglementImage RestorationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
DDTNet: Degradation Disentanglement and Transfer Network for Test-Time All-in-One De-weathering Adaptation
All-in-one adverse weather image restoration aims to remove multiple degradations, such as rain, haze, and snow, using a single unified model. Despite their broad applicability, existing methods typically compromise perf…
Image RestorationCausal Disentanglement-Inspired Degradation Representation Learning for Full-Reference Image Quality Assessment
Existing deep network-based full-reference image quality assessment (FR-IQA) models typically work by performing pairwise comparisons of deep features from the reference and distorted images. In this paper, we approach t…
Dimensionality ReductionImage Quality AssessmentRepresentation LearningDomain GeneralizationNight-to-Day Translation via Illumination Degradation Disentanglement
Night-to-Day translation (Night2Day) aims to achieve day-like vision for nighttime scenes. However, processing night images with complex degradations remains a significant challenge under unpaired conditions. Previous me…
Contrastive LearningDisentanglementTranslationDiff-Restorer: Unleashing Visual Prompts for Diffusion-based Universal Image Restoration
Image restoration is a classic low-level problem aimed at recovering high-quality images from low-quality images with various degradations such as blur, noise, rain, haze, etc. However, due to the inherent complexity and…
DecoderImage RestorationLanguage ModellingLearning Continuous Wasserstein Barycenter Space for Generalized All-in-One Image Restoration
Despite substantial advances in all-in-one image restoration for addressing diverse degradations within a unified model, existing methods remain vulnerable to out-of-distribution degradations, thereby limiting their gene…
Representation LearningImage Restoration