Deep Shape-Texture Statistics for Completely Blind Image Quality Evaluation
Opinion-Unaware Blind Image Quality Assessment (OU-BIQA) models aim to predict image quality without training on reference images and subjective quality scores. Thereinto, image statistical comparison is a classic paradigm, while the performance is limited by the representation ability of visual descriptors. Deep features as visual descriptors have advanced IQA in recent research, but they are discovered to be highly texture-biased and lack of shape-bias. On this basis, we find out that image shape and texture cues respond differently towards distortions, and the absence of either one results in an incomplete image representation. Therefore, to formulate a well-round statistical description for images, we utilize the shapebiased and texture-biased deep features produced by Deep Neural Networks (DNNs) simultaneously. More specifically, we design a Shape-Texture Adaptive Fusion (STAF) module to merge shape and texture information, based on which we formulate qualityrelevant image statistics. The perceptual quality is quantified by the variant Mahalanobis Distance between the inner and outer Shape-Texture Statistics (DSTS), wherein the inner and outer statistics respectively describe the quality fingerprints of the distorted image and natural images. The proposed DSTS delicately utilizes shape-texture statistical relations between different data scales in the deep domain, and achieves state-of-the-art (SOTA) quality prediction performance on images with artificial and authentic distortions.
Code (0)
등록된 구현이 없습니다.
Tasks
Blind Image Quality AssessmentImage Quality AssessmentSimilar Papers 제목 키워드 기반
Texture Characterization by Using Shape Co-occurrence Patterns
Texture characterization is a key problem in image understanding and pattern recognition. In this paper, we present a flexible shape-based texture representation using shape co-occurrence patterns. More precisely, textur…
DescriptiveTexture ClassificationLearned Shape-Tailored Descriptors for Segmentation
We address the problem of texture segmentation by grouping dense pixel-wise descriptors. We introduce and construct learned Shape-Tailored Descriptors that aggregate image statistics only within regions of interest to av…
SegmentationDeep Learning for Cornea Microscopy Blind Deblurring
The goal of this project is to build a deep-learning solution that deblurs cornea scans, used for medical examination. The spherical shape of the eye prevents ophtamologist from having completely sharp image. Provided wi…
DeblurringDeep LearningSuper-ResolutionPermuted AdaIN: Reducing the Bias Towards Global Statistics in Image Classification
Recent work has shown that convolutional neural network classifiers overly rely on texture at the expense of shape cues. We make a similar but different distinction between shape and local image cues, on the one hand, an…
Domain AdaptationDomain GeneralizationGeneral Classificationimage-classification+4Significance of Natural Scene Statistics in Understanding the Anisotropies of Perceptual Filling-in at the Blind Spot
Psychophysical experiments reveal our horizontal preference in perceptual filling-in at the blind spot. On the other hand, vertical preference is exhibited in the case of tolerance in filling-in. What causes this anisotr…