Scale Contrastive Learning with Selective Attentions for Blind Image Quality Assessment
Blind image quality assessment (BIQA) serves as a fundamental task in computer vision, yet it often fails to consistently align with human subjective perception. Recent advances show that multi-scale evaluation strategies are promising due to their ability to replicate the hierarchical structure of human vision. However, the effectiveness of these strategies is limited by a lack of understanding of how different image scales influence perceived quality. This paper addresses two primary challenges: the significant redundancy of information across different scales, and the confusion caused by combining features from these scales, which may vary widely in quality. To this end, a new multi-scale BIQA framework is proposed, namely Contrast-Constrained Scale-Focused IQA Framework (CSFIQA). CSFIQA features a selective focus attention mechanism to minimize information redundancy and highlight critical quality-related information. Additionally, CSFIQA includes a scale-level contrastive learning module equipped with a noise sample matching mechanism to identify quality discrepancies across the same image content at different scales. By exploring the intrinsic relationship between image scales and the perceived quality, the proposed CSFIQA achieves leading performance on eight benchmark datasets, e.g., achieving SRCC values of 0.967 (versus 0.947 in CSIQ) and 0.905 (versus 0.876 in LIVEC).
Code (0)
등록된 구현이 없습니다.
Tasks
Blind Image Quality AssessmentContrastive LearningImage Quality AssessmentMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Rethinking Transformer-Based Blind-Spot Network for Self-Supervised Image Denoising
Blind-spot networks (BSN) have been prevalent neural architectures in self-supervised image denoising (SSID). However, most existing BSNs are conducted with convolution layers. Although transformers have shown the potent…
Computational EfficiencyDenoisingImage DenoisingImage Restoration+1Feature Selective Transformer for Semantic Image Segmentation
Recently, it has attracted more and more attentions to fuse multi-scale features for semantic image segmentation. Various works were proposed to employ progressive local or global fusion, but the feature fusions are not …
feature selectionImage SegmentationSegmentationSemantic SegmentationHierarchical Contrastive Learning for Pattern-Generalizable Image Corruption Detection
Effective image restoration with large-size corruptions, such as blind image inpainting, entails precise detection of corruption region masks which remains extremely challenging due to diverse shapes and patterns of corr…
Contrastive LearningImage InpaintingImage RestorationBlind Image Super-Resolution via Contrastive Representation Learning
Image super-resolution (SR) research has witnessed impressive progress thanks to the advance of convolutional neural networks (CNNs) in recent years. However, most existing SR methods are non-blind and assume that degrad…
Contrastive LearningImage Super-ResolutionRepresentation LearningSuper-ResolutionStatistical Test for Attention Map in Vision Transformer
The Vision Transformer (ViT) demonstrates exceptional performance in various computer vision tasks. Attention is crucial for ViT to capture complex wide-ranging relationships among image patches, allowing the model to we…
Decision Making