paper-with-me

홈 › Papers

RankDVQA: Deep VQA based on Ranking-inspired Hybrid Training

2022-02-17 · Chen Feng, Duolikun Danier, Fan Zhang, David Bull

In recent years, deep learning techniques have shown significant potential for improving video quality assessment (VQA), achieving higher correlation with subjective opinions compared to conventional approaches. However, the development of deep VQA methods has been constrained by the limited availability of large-scale training databases and ineffective training methodologies. As a result, it is difficult for deep VQA approaches to achieve consistently superior performance and model generalization. In this context, this paper proposes new VQA methods based on a two-stage training methodology which motivates us to develop a large-scale VQA training database without employing human subjects to provide ground truth labels. This method was used to train a new transformer-based network architecture, exploiting quality ranking of different distorted sequences rather than minimizing the difference from the ground-truth quality labels. The resulting deep VQA methods (for both full reference and no reference scenarios), FR- and NR-RankDVQA, exhibit consistently higher correlation with perceptual quality compared to the state-of-the-art conventional and deep VQA methods, with average SROCC values of 0.8972 (FR) and 0.7791 (NR) over eight test sets without performing cross-validation. The source code of the proposed quality metrics and the large training database are available at https://chenfeng-bristol.github.io/RankDVQA.

📄 PDF Abstract BibTeX arXiv:2202.08595

Code (0)

등록된 구현이 없습니다.

Tasks

Video Quality AssessmentVisual Question Answering (VQA)

Similar Papers 제목 키워드 기반

RankDVQA-mini: Knowledge Distillation-Driven Deep Video Quality Assessment

2023-12-14 · Chen Feng, Duolikun Danier, Haoran Wang, Fan Zhang 외

Deep learning-based video quality assessment (deep VQA) has demonstrated significant potential in surpassing conventional metrics, with promising improvements in terms of correlation with human perception. However, the p…

Knowledge DistillationModel CompressionVideo Quality AssessmentVisual Question Answering (VQA)

Enhancing Visual Question Answering through Ranking-Based Hybrid Training and Multimodal Fusion

2024-08-14 · Peiyuan Chen, Zecheng Zhang, Yiping Dong, Li Zhou 외

Visual Question Answering (VQA) is a challenging task that requires systems to provide accurate answers to questions based on image content. Current VQA models struggle with complex questions due to limitations in captur…

Question AnsweringVisual Question AnsweringVisual Question Answering (VQA)

On the Representational Limits of Quantum-Inspired 1024-D Document Embeddings: An Experimental Evaluation Framework

2026-04-10 · Dario Maio arxiv

Text embeddings are central to modern information retrieval and Retrieval-Augmented Generation (RAG). While dense models derived from Large Language Models (LLMs) dominate current practice, recent work has explored quant…

Information Retrieval

HYRR: Hybrid Infused Reranking for Passage Retrieval

2022-12-20 · Jing Lu, Keith Hall, Ji Ma, Jianmo Ni

We present Hybrid Infused Reranking for Passages Retrieval (HYRR), a framework for training rerankers based on a hybrid of BM25 and neural retrieval models. Retrievers based on hybrid models have been shown to outperform…

Passage RetrievalRerankingRetrieval

HARRIS: Hybrid Ranking and Regression Forests for Algorithm Selection

2022-10-31 · Lukas Fehring, Jonas Hanselle, Alexander Tornede

It is well known that different algorithms perform differently well on an instance of an algorithmic problem, motivating algorithm selection (AS): Given an instance of an algorithmic problem, which is the most suitable a…

regression