Subjective Image Quality Assessment with Boosted Triplet Comparisons
In subjective full-reference image quality assessment, differences between perceptual image qualities of the reference image and its distorted versions are evaluated, often using degradation category ratings (DCR). However, the DCR has been criticized since differences between rating categories on this ordinal scale might not be perceptually equidistant, and observers may have different understandings of the categories. Pair comparisons (PC) of distorted images, followed by Thurstonian reconstruction of scale values, overcome these problems. In addition, PC is more sensitive than DCR, and it can provide scale values in fractional, just noticeable difference (JND) units that express a precise perceptional interpretation. Still, the comparison of images of nearly the same quality can be difficult. We introduce boosting techniques embedded in more general triplet comparisons (TC) that increase the sensitivity even more. Boosting amplifies the artefacts of distorted images, enlarges their visual representation by zooming, increases the visibility of the distortions by a flickering effect, or combines some of the above. Experimental results show the effectiveness of boosted TC for seven types of distortion. We crowdsourced over 1.7 million responses to triplet questions. A detailed analysis shows that boosting increases the discriminatory power and allows to reduce the number of subjective ratings without sacrificing the accuracy of the resulting relative image quality values. Our technique paves the way to fine-grained image quality datasets, allowing for more distortion levels, yet with high-quality subjective annotations. We also provide the details for Thurstonian scale reconstruction from TC and our annotated dataset, KonFiG-IQA, containing 10 source images, processed using 7 distortion types at 12 or even 30 levels, uniformly spaced over a span of 3 JND units.
Code (0)
등록된 구현이 없습니다.
Tasks
Full reference image quality assessmentFull-Reference Image Quality AssessmentImage Quality AssessmentTripletMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Subjective Visual Quality Assessment for High-Fidelity Learning-Based Image Compression
Learning-based image compression methods have recently emerged as promising alternatives to traditional codecs, offering improved rate-distortion performance and perceptual quality. JPEG AI represents the latest standard…
BenchmarkingImage CompressionImage ReconstructionTripletFine-grained subjective visual quality assessment for high-fidelity compressed images
Advances in image compression, storage, and display technologies have made high-quality images and videos widely accessible. At this level of quality, distinguishing between compressed and original content becomes diffic…
Image CompressionImage Quality AssessmentPerceptual Quality Assessment for Video Frame Interpolation
The quality of frames is significant for both research and application of video frame interpolation (VFI). In recent VFI studies, the methods of full-reference image quality assessment have generally been used to evaluat…
Full reference image quality assessmentFull-Reference Image Quality AssessmentImage Quality AssessmentTriplet+1TRIQA: Image Quality Assessment by Contrastive Pretraining on Ordered Distortion Triplets
Image Quality Assessment (IQA) models aim to predict perceptual image quality in alignment with human judgments. No-Reference (NR) IQA remains particularly challenging due to the absence of a reference image. While deep …
Image Quality AssessmentSubjective Quality Assessment of Ground-based Camera Images
Image quality assessment is critical to control and maintain the perceived quality of visual content. Both subjective and objective evaluations can be utilised, however, subjective image quality assessment is currently c…
Image Quality Assessment