paper-with-me

Papers

Learning Conditional Knowledge Distillation for Degraded-Reference Image Quality Assessment

2021-08-18 · ICCV 2021 10 · Heliang Zheng, Huan Yang, Jianlong Fu, Zheng-Jun Zha, Jiebo Luo

An important scenario for image quality assessment (IQA) is to evaluate image restoration (IR) algorithms. The state-of-the-art approaches adopt a full-reference paradigm that compares restored images with their corresponding pristine-quality images. However, pristine-quality images are usually unavailable in blind image restoration tasks and real-world scenarios. In this paper, we propose a practical solution named degraded-reference IQA (DR-IQA), which exploits the inputs of IR models, degraded images, as references. Specifically, we extract reference information from degraded images by distilling knowledge from pristine-quality images. The distillation is achieved through learning a reference space, where various degraded images are encouraged to share the same feature statistics with pristine-quality images. And the reference space is optimized to capture deep image priors that are useful for quality assessment. Note that pristine-quality images are only used during training. Our work provides a powerful and differentiable metric for blind IRs, especially for GAN-based methods. Extensive experiments show that our results can even be close to the performance of full-reference settings.

📄 PDF Abstract BibTeX arXiv:2108.07948

Code (1)

researchmm/ckdn 공식 구현 pytorch

Tasks

Image Quality AssessmentImage RestorationKnowledge Distillation

Similar Papers 제목 키워드 기반

Data-free Distillation with Degradation-prompt Diffusion for Multi-weather Image Restoration

2024-09-05 · Pei Wang, Xiaotong Luo, Yuan Xie, Yanyun Qu

Multi-weather image restoration has witnessed incredible progress, while the increasing model capacity and expensive data acquisition impair its applications in memory-limited devices. Data-free distillation provides an …

Image RestorationKnowledge Distillation

Distilling GANs with Style-Mixed Triplets for X2I Translation with Limited Data

2021-09-29 · ICLR 2022 4 · Yaxing Wang, Joost Van de Weijer, Lu Yu, Shangling Jui

Conditional image synthesis is an integral part of many X2I translation systems, including image-to-image, text-to-image and audio-to-image translation systems. Training these large systems generally requires huge amount…

Image GenerationKnowledge DistillationSemantic SegmentationTranslation

RestoRect: Degraded Image Restoration via Latent Rectified Flow & Feature Distillation

2025-09-27 · Shourya Verma, Mengbo Wang, Nadia Atallah Lanman, Ananth Grama arxiv

Current approaches for restoration of degraded images face a trade-off: high-performance models are slow for practical use, while fast models produce poor results. Knowledge distillation transfers teacher knowledge to st…

Knowledge DistillationOutlier DetectionImage Restoration

DreOPD: Degraded-Reference Extrapolative On-Policy Distillation for Flow-matching Models

2026-08-10 · Mingfeng Lin, Chengfei Cai, Lin Xu, Yuxiang Wei 외 arxiv

Flow-matching models are now a mainstream method to image generation, but its adaptation to diverse downstream scenarios typically relies on post-training, which may cause conflicts among task-specific optimization objec…

Reinforcement LearningImage Generation

Knowledge Distillation for Image Restoration : Simultaneous Learning from Degraded and Clean Images

2025-01-16 · Yongheng Zhang, Danfeng Yan

Model compression through knowledge distillation has seen extensive application in classification and segmentation tasks. However, its potential in image-to-image translation, particularly in image restoration, remains u…

DecoderImage ReconstructionImage RestorationImage-to-Image Translation+2