paper-with-me

홈 › Papers

From Global to Granular: Revealing IQA Model Performance via Correlation Surface

2026-01-29 · Baoliang Chen, Danni Huang, Hanwei Zhu, Lingyu Zhu, Wei Zhou, Shiqi Wang, Yuming Fang, Weisi Lin arxiv

Evaluation of Image Quality Assessment (IQA) models has long been dominated by global correlation metrics, such as Pearson Linear Correlation Coefficient (PLCC) and Spearman Rank-Order Correlation Coefficient (SRCC). While widely adopted, these metrics reduce performance to a single scalar, failing to capture how ranking consistency varies across the local quality spectrum. For example, two IQA models may achieve identical SRCC values, yet one ranks high-quality images (related to high Mean Opinion Score, MOS) more reliably, while the other better discriminates image pairs with small quality/MOS differences (related to $|Δ$MOS$|$). Such complementary behaviors are invisible under global metrics. Moreover, SRCC and PLCC are sensitive to test-sample quality distributions, yielding unstable comparisons across test sets. To address these limitations, we propose \textbf{Granularity-Modulated Correlation (GMC)}, which provides a structured, fine-grained analysis of IQA performance. GMC includes: (1) a \textbf{Granularity Modulator} that applies Gaussian-weighted correlations conditioned on absolute MOS values and pairwise MOS differences ($|Δ$MOS$|$) to examine local performance variations, and (2) a \textbf{Distribution Regulator} that regularizes correlations to mitigate biases from non-uniform quality distributions. The resulting \textbf{correlation surface} maps correlation values as a joint function of MOS and $|Δ$MOS$|$, providing a 3D representation of IQA performance. Experiments on standard benchmarks show that GMC reveals performance characteristics invisible to scalar metrics, offering a more informative and reliable paradigm for analyzing, comparing, and deploying IQA models. Codes are available at https://github.com/Dniaaa/GMC.

📄 PDF Abstract BibTeX arXiv:2601.21738

Code (0)

등록된 구현이 없습니다.

Tasks

Image Quality Assessment

Similar Papers 제목 키워드 기반

Analyzing and Evaluating Correlation Measures in NLG Meta-Evaluation

2024-10-22 · Mingqi Gao, Xinyu Hu, Li Lin, Xiaojun Wan

The correlation between NLG automatic evaluation metrics and human evaluation is often regarded as a critical criterion for assessing the capability of an evaluation metric. However, different grouping methods and correl…

nlg evaluation

IMSurReal: IMS at the Surface Realization Shared Task 2019

2019-11-01 · WS 2019 11 · Xiang Yu, Agnieszka Falenska, Marina Haid, Ngoc Thang Vu 외

We introduce the IMS contribution to the Surface Realization Shared Task 2019. Our submission achieves the state-of-the-art performance without using any external resources. The system takes a pipeline approach consistin…

GlobalBuildingMap -- Unveiling the Mystery of Global Buildings

2024-04-22 · Xiao Xiang Zhu, Qingyu Li, Yilei Shi, Yuanyuan Wang 외

Understanding how buildings are distributed globally is crucial to revealing the human footprint on our home planet. This built environment affects local climate, land surface albedo, resource distribution, and many othe…

LAVA: Explainability for Unsupervised Latent Embeddings

2025-09-25 · Ivan Stresec, Joana P. Gonçalves arxiv

Unsupervised black-box models are drivers of scientific discovery, yet are difficult to interpret, as their output is often a multidimensional embedding rather than a well-defined target. While explainability for supervi…

SIFM: A Foundation Model for Multi-granularity Arctic Sea Ice Forecasting

2024-10-16 · Jingyi Xu, Yeqi Luo, Weidong Yang, Keyi Liu 외

Arctic sea ice performs a vital role in global climate and has paramount impacts on both polar ecosystems and coastal communities. In the last few years, multiple deep learning based pan-Arctic sea ice concentration (SIC…