Deep Learning of Human Visual Sensitivity in Image Quality Assessment Framework
Since human observers are the ultimate receivers of digital images, image quality metrics should be designed from a human-oriented perspective. Conventionally, a number of full-reference image quality assessment (FR-IQA) methods adopted various computational models of the human visual system (HVS) from psychological vision science research. In this paper, we propose a novel convolutional neural networks (CNN) based FR-IQA model, named Deep Image Quality Assessment (DeepQA), where the behavior of the HVS is learned from the underlying data distribution of IQA databases. Different from previous studies, our model seeks the optimal visual weight based on understanding of database information itself without any prior knowledge of the HVS. Through the experiments, we show that the predicted visual sensitivity maps agree with the human subjective opinions. In addition, DeepQA achieves the state-of-the-art prediction accuracy among FR-IQA models.
Code (1)
Tasks
Full reference image quality assessmentFull-Reference Image Quality AssessmentImage Quality AssessmentSensitivitySimilar Papers 제목 키워드 기반
HarmonyIQA: Pioneering Benchmark and Model for Image Harmonization Quality Assessment
Image composition involves extracting a foreground object from one image and pasting it into another image through Image harmonization algorithms (IHAs), which aim to adjust the appearance of the foreground object to bet…
Image HarmonizationImage Quality AssessmentSelf-Supervised LearningCenter Emphasized Visual Saliency and a Contrast-based Full Reference Image Quality Index
Objective image quality assessment (IQA) is imperative in the current multimedia-intensive world, in order to assess the visual quality of an image at close to a human level of ability. Many~parameters such as color inte…
Full reference image quality assessmentFull-Reference Image Quality AssessmentImage Quality AssessmentApples and Oranges? Assessing Image Quality over Content Recognition
Image recognition and quality assessment are two important viewing tasks, while potentially following different visual mechanisms. This paper investigates if the two tasks can be performed in a multitask learning manner.…
Text-Visual Semantic Constrained AI-Generated Image Quality Assessment
With the rapid advancements in Artificial Intelligence Generated Image (AGI) technology, the accurate assessment of their quality has become an increasingly vital requirement. Prevailing methods typically rely on cross-m…
Image DescriptionImage Quality AssessmentAnalysis and Interpretation of Deep CNN Representations as Perceptual Quality Features
Pre-trained Deep Convolutional Neural Network (CNN) features have popularly been used as full-reference perceptual quality features for CNN based image quality assessment, super-resolution, image restoration and a variet…
Image Quality AssessmentImage RestorationImage-to-Image Translationobject-detection+2