StableVQA: A Deep No-Reference Quality Assessment Model for Video Stability
Video shakiness is an unpleasant distortion of User Generated Content (UGC) videos, which is usually caused by the unstable hold of cameras. In recent years, many video stabilization algorithms have been proposed, yet no specific and accurate metric enables comprehensively evaluating the stability of videos. Indeed, most existing quality assessment models evaluate video quality as a whole without specifically taking the subjective experience of video stability into consideration. Therefore, these models cannot measure the video stability explicitly and precisely when severe shakes are present. In addition, there is no large-scale video database in public that includes various degrees of shaky videos with the corresponding subjective scores available, which hinders the development of Video Quality Assessment for Stability (VQA-S). To this end, we build a new database named StableDB that contains 1,952 diversely-shaky UGC videos, where each video has a Mean Opinion Score (MOS) on the degree of video stability rated by 34 subjects. Moreover, we elaborately design a novel VQA-S model named StableVQA, which consists of three feature extractors to acquire the optical flow, semantic, and blur features respectively, and a regression layer to predict the final stability score. Extensive experiments demonstrate that the StableVQA achieves a higher correlation with subjective opinions than the existing VQA-S models and generic VQA models. The database and codes are available at https://github.com/QMME/StableVQA.
Code (1)
Tasks
Optical Flow EstimationVideo Quality AssessmentVideo StabilizationVisual Question Answering (VQA)Similar Papers 제목 키워드 기반
No-Reference Rendered Video Quality Assessment: Dataset and Metrics
Quality assessment of videos is crucial for many computer graphics applications, including video games, virtual reality, and augmented reality, where visual performance has a significant impact on user experience. When t…
Video Quality AssessmentDeep Tiny Network for Recognition-Oriented Face Image Quality Assessment
Face recognition has made significant progress in recent years due to deep convolutional neural networks (CNN). In many face recognition (FR) scenarios, face images are acquired from a sequence with huge intra-variations…
Face Image QualityFace Image Quality AssessmentFace RecognitionImage Quality AssessmentComparison Drives Preference: Reference-Aware Modeling for AI-Generated Video Quality Assessment
The rapid advancement of generative models has led to a growing volume of AI-generated videos, making the automatic quality assessment of such videos increasingly important. Existing AI-generated content video quality as…
Video Quality AssessmentVideo Quality Assessment Based on Swin TransformerV2 and Coarse to Fine Strategy
The objective of non-reference video quality assessment is to evaluate the quality of distorted video without access to reference high-definition references. In this study, we introduce an enhanced spatial perception mod…
Image Quality AssessmentVideo Quality AssessmentVisual Question Answering (VQA)Perceptual Quality Assessment for Video Frame Interpolation
The quality of frames is significant for both research and application of video frame interpolation (VFI). In recent VFI studies, the methods of full-reference image quality assessment have generally been used to evaluat…
Full reference image quality assessmentFull-Reference Image Quality AssessmentImage Quality AssessmentTriplet+1