Bridging the Synthetic-to-Authentic Gap: Distortion-Guided Unsupervised Domain Adaptation for Blind Image Quality Assessment
The annotation of blind image quality assessment (BIQA) is labor-intensive and time-consuming, especially for authentic images. Training on synthetic data is expected to be beneficial, but synthetically trained models often suffer from poor generalization in real domains due to domain gaps. In this work, we make a key observation that introducing more distortion types in the synthetic dataset may not improve or even be harmful to generalizing authentic image quality assessment. To solve this challenge, we propose distortion-guided unsupervised domain adaptation for BIQA (DGQA), a novel framework that leverages adaptive multi-domain selection via prior knowledge from distortion to match the data distribution between the source domains and the target domain, thereby reducing negative transfer from the outlier source domains. Extensive experiments on two cross-domain settings (synthetic distortion to authentic distortion and synthetic distortion to algorithmic distortion) have demonstrated the effectiveness of our proposed DGQA. Besides, DGQA is orthogonal to existing model-based BIQA methods, and can be used in combination with such models to improve performance with less training data.
Code (1)
Tasks
Blind Image Quality AssessmentDomain AdaptationImage Quality AssessmentUnsupervised Domain AdaptationSimilar Papers 제목 키워드 기반
Blind Image Quality Assessment Using A Deep Bilinear Convolutional Neural Network
We propose a deep bilinear model for blind image quality assessment (BIQA) that handles both synthetic and authentic distortions. Our model consists of two convolutional neural networks (CNN), each of which specializes i…
image-classificationImage ClassificationImage Quality AssessmentNo-Reference Image Quality AssessmentHiRQA: Hierarchical Ranking and Quality Alignment for Opinion-Unaware Image Quality Assessment
Despite significant progress in no-reference image quality assessment (NR-IQA), dataset biases and reliance on subjective labels continue to hinder their generalization performance. We propose HiRQA (Hierarchical Ranking…
No-Reference Image Quality AssessmentContrastive LearningBlindly Assess Image Quality in the Wild Guided by a Self-Adaptive Hyper Network
Blind image quality assessment (BIQA) for authentically distorted images has always been a challenging problem, since images captured in the wild include varies contents and diverse types of distortions. The vast majorit…
Image Quality AssessmentNo-Reference Image Quality AssessmentBridging the Gap between Synthetic and Authentic Images for Multimodal Machine Translation
Multimodal machine translation (MMT) simultaneously takes the source sentence and a relevant image as input for translation. Since there is no paired image available for the input sentence in most cases, recent studies s…
DecoderImage GenerationMachine TranslationMultimodal Machine Translation+4GreenBIQA: A Lightweight Blind Image Quality Assessment Method
Deep neural networks (DNNs) achieve great success in blind image quality assessment (BIQA) with large pre-trained models in recent years. Their solutions cannot be easily deployed at mobile or edge devices, and a lightwe…
Blind Image Quality Assessmentfeature selectionImage Quality Assessment