Modular Blind Video Quality Assessment
Blind video quality assessment (BVQA) plays a pivotal role in evaluating and improving the viewing experience of end-users across a wide range of video-based platforms and services. Contemporary deep learning-based models primarily analyze video content in its aggressively subsampled format, while being blind to the impact of the actual spatial resolution and frame rate on video quality. In this paper, we propose a modular BVQA model and a method of training it to improve its modularity. Our model comprises a base quality predictor, a spatial rectifier, and a temporal rectifier, responding to the visual content and distortion, spatial resolution, and frame rate changes on video quality, respectively. During training, spatial and temporal rectifiers are dropped out with some probabilities to render the base quality predictor a standalone BVQA model, which should work better with the rectifiers. Extensive experiments on both professionally-generated content and user-generated content video databases show that our quality model achieves superior or comparable performance to current methods. Additionally, the modularity of our model offers an opportunity to analyze existing video quality databases in terms of their spatial and temporal complexity.
Code (1)
Tasks
Video Quality AssessmentMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Learned Scanpaths Aid Blind Panoramic Video Quality Assessment
Panoramic videos have the advantage of providing an immersive and interactive viewing experience. Nevertheless, their spherical nature gives rise to various and uncertain user viewing behaviors, which poses significant c…
Video Quality AssessmentMultiview Contrastive Learning for Completely Blind Video Quality Assessment of User Generated Content
Completely blind video quality assessment (VQA) refers to a class of quality assessment methods that do not use any reference videos, human opinion scores or training videos from the target database to learn a quality mo…
Contrastive LearningOptical Flow EstimationVideo Quality AssessmentVisual Question Answering (VQA)Blind Prediction of Natural Video Quality
We propose a blind (no reference or NR) video quality evaluation model that is nondistortion specific. The approach relies on a spatio-temporal model of video scenes in the discrete cosine transform domain, and on a mode…
PredictionVideo Quality AssessmentVisual Question Answering (VQA)Enhancing Blind Video Quality Assessment with Rich Quality-aware Features
In this paper, we present a simple but effective method to enhance blind video quality assessment (BVQA) models for social media videos. Motivated by previous researches that leverage pre-trained features extracted from …
Video Quality AssessmentRMT-BVQA: Recurrent Memory Transformer-based Blind Video Quality Assessment for Enhanced Video Content
With recent advances in deep learning, numerous algorithms have been developed to enhance video quality, reduce visual artifacts, and improve perceptual quality. However, little research has been reported on the quality …
Contrastive LearningVideo EnhancementVideo Quality AssessmentVisual Question Answering (VQA)