Q-Boost: On Visual Quality Assessment Ability of Low-level Multi-Modality Foundation Models
Recent advancements in Multi-modality Large Language Models (MLLMs) have demonstrated remarkable capabilities in complex high-level vision tasks. However, the exploration of MLLM potential in visual quality assessment, a vital aspect of low-level vision, remains limited. To address this gap, we introduce Q-Boost, a novel strategy designed to enhance low-level MLLMs in image quality assessment (IQA) and video quality assessment (VQA) tasks, which is structured around two pivotal components: 1) Triadic-Tone Integration: Ordinary prompt design simply oscillates between the binary extremes of $positive$ and $negative$. Q-Boost innovates by incorporating a `middle ground' approach through $neutral$ prompts, allowing for a more balanced and detailed assessment. 2) Multi-Prompt Ensemble: Multiple quality-centric prompts are used to mitigate bias and acquire more accurate evaluation. The experimental results show that the low-level MLLMs exhibit outstanding zeros-shot performance on the IQA/VQA tasks equipped with the Q-Boost strategy.
Code (0)
등록된 구현이 없습니다.
Tasks
Image Quality AssessmentVideo Quality AssessmentVisual Question Answering (VQA)Similar Papers 제목 키워드 기반
Fine-grained subjective visual quality assessment for high-fidelity compressed images
Advances in image compression, storage, and display technologies have made high-quality images and videos widely accessible. At this level of quality, distinguishing between compressed and original content becomes diffic…
Image CompressionImage Quality AssessmentEnhancing Image Quality Assessment Ability of LMMs via Retrieval-Augmented Generation
Large Multimodal Models (LMMs) have recently shown remarkable promise in low-level visual perception tasks, particularly in Image Quality Assessment (IQA), demonstrating strong zero-shot capability. However, achieving st…
Image Quality AssessmentImage RetrievalBoosting in Image Quality Assessment
In this paper, we analyze the effect of boosting in image quality assessment through multi-method fusion. Existing multi-method studies focus on proposing a single quality estimator. On the contrary, we investigate the g…
Image Quality AssessmentTextural-Perceptual Joint Learning for No-Reference Super-Resolution Image Quality Assessment
Image super-resolution (SR) has been widely investigated in recent years. However, it is challenging to fairly estimate the performance of various SR methods, as the lack of reliable and accurate criteria for the percept…
Image Quality AssessmentImage Super-ResolutionSuper-ResolutionA ParaBoost Stereoscopic Image Quality Assessment (PBSIQA) System
The problem of stereoscopic image quality assessment, which finds applications in 3D visual content delivery such as 3DTV, is investigated in this work. Specifically, we propose a new ParaBoost (parallel-boosting) stereo…
Image Quality AssessmentStereoscopic image quality assessment