Local Manifold Learning for No-Reference Image Quality Assessment
Contrastive learning has considerably advanced the field of Image Quality Assessment (IQA), emerging as a widely adopted technique. The core mechanism of contrastive learning involves minimizing the distance between quality-similar (positive) examples while maximizing the distance between quality-dissimilar (negative) examples. Despite its successes, current contrastive learning methods often neglect the importance of preserving the local manifold structure. This oversight can result in a high degree of similarity among hard examples within the feature space, thereby impeding effective differentiation and assessment. To address this issue, we propose an innovative framework that integrates local manifold learning with contrastive learning for No-Reference Image Quality Assessment (NR-IQA). Our method begins by sampling multiple crops from a given image, identifying the most visually salient crop. This crop is then used to cluster other crops from the same image as the positive class, while crops from different images are treated as negative classes to increase inter-class distance. Uniquely, our approach also considers non-saliency crops from the same image as intra-class negative classes to preserve their distinctiveness. Additionally, we employ a mutual learning framework, which further enhances the model's ability to adaptively learn and identify visual saliency regions. Our approach demonstrates a better performance compared to state-of-the-art methods in 7 standard datasets, achieving PLCC values of 0.942 (compared to 0.908 in TID2013) and 0.914 (compared to 0.894 in LIVEC).
Code (0)
등록된 구현이 없습니다.
Tasks
Contrastive LearningImage Quality AssessmentNo-Reference Image Quality AssessmentNR-IQAMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
ARNIQA: Learning Distortion Manifold for Image Quality Assessment
No-Reference Image Quality Assessment (NR-IQA) aims to develop methods to measure image quality in alignment with human perception without the need for a high-quality reference image. In this work, we propose a self-supe…
Image Quality AssessmentNo-Reference Image Quality AssessmentLocally Linear Image Structural Embedding for Image Structure Manifold Learning
Most of existing manifold learning methods rely on Mean Squared Error (MSE) or $\ell_2$ norm. However, for the problem of image quality assessment, these are not promising measure. In this paper, we introduce the concept…
Dimensionality ReductionImage Quality AssessmentSSIMAttention Down-Sampling Transformer, Relative Ranking and Self-Consistency for Blind Image Quality Assessment
The no-reference image quality assessment is a challenging domain that addresses estimating image quality without the original reference. We introduce an improved mechanism to extract local and non-local information from…
Blind Image Quality AssessmentImage Quality AssessmentNo-Reference Image Quality AssessmentNR-IQANo-Reference Quality Assessment of Authentically Distorted Images Based on Local and Global Features
With the development of digital imaging techniques, image quality assessment methods are receiving more attention in the literature. Since distortion-free versions of camera images in many practical, everyday application…
Image Quality AssessmentNo-Reference Image Quality AssessmentSaliency-Guided Local Full-Reference Image Quality Assessment
Research and development of image quality assessment (IQA) algorithms have been in the focus of the computer vision and image processing community for decades. The intent of IQA methods is to estimate the perceptual qual…
Full reference image quality assessmentFull-Reference Image Quality AssessmentImage Quality Assessment