Learning Conditional Knowledge Distillation for Degraded-Reference Image Quality Assessment
An important scenario for image quality assessment (IQA) is to evaluate image restoration (IR) algorithms. The state-of-the-art approaches adopt a full-reference paradigm that compares restored images with their corresponding pristine-quality images. However, pristine-quality images are usually unavailable in blind image restoration tasks and real-world scenarios. In this paper, we propose a practical solution named degraded-reference IQA (DR-IQA), which exploits the inputs of IR models, degraded images, as references. Specifically, we extract reference information from degraded images by distilling knowledge from pristine-quality images. The distillation is achieved through learning a reference space, where various degraded images are encouraged to share the same feature statistics with pristine-quality images. And the reference space is optimized to capture deep image priors that are useful for quality assessment. Note that pristine-quality images are only used during training. Our work provides a powerful and differentiable metric for blind IRs, especially for GAN-based methods. Extensive experiments show that our results can even be close to the performance of full-reference settings.
Code (1)
Tasks
Image Quality AssessmentImage RestorationKnowledge DistillationSimilar Papers 제목 키워드 기반
Data-free Distillation with Degradation-prompt Diffusion for Multi-weather Image Restoration
Multi-weather image restoration has witnessed incredible progress, while the increasing model capacity and expensive data acquisition impair its applications in memory-limited devices. Data-free distillation provides an …
Image RestorationKnowledge DistillationDistilling GANs with Style-Mixed Triplets for X2I Translation with Limited Data
Conditional image synthesis is an integral part of many X2I translation systems, including image-to-image, text-to-image and audio-to-image translation systems. Training these large systems generally requires huge amount…
Image GenerationKnowledge DistillationSemantic SegmentationTranslationRestoRect: Degraded Image Restoration via Latent Rectified Flow & Feature Distillation
Current approaches for restoration of degraded images face a trade-off: high-performance models are slow for practical use, while fast models produce poor results. Knowledge distillation transfers teacher knowledge to st…
Knowledge DistillationOutlier DetectionImage RestorationDreOPD: Degraded-Reference Extrapolative On-Policy Distillation for Flow-matching Models
Flow-matching models are now a mainstream method to image generation, but its adaptation to diverse downstream scenarios typically relies on post-training, which may cause conflicts among task-specific optimization objec…
Reinforcement LearningImage GenerationKnowledge Distillation for Image Restoration : Simultaneous Learning from Degraded and Clean Images
Model compression through knowledge distillation has seen extensive application in classification and segmentation tasks. However, its potential in image-to-image translation, particularly in image restoration, remains u…
DecoderImage ReconstructionImage RestorationImage-to-Image Translation+2