C3DVQA: Full-Reference Video Quality Assessment with 3D Convolutional Neural Network
Traditional video quality assessment (VQA) methods evaluate localized picture quality and video score is predicted by temporally aggregating frame scores. However, video quality exhibits different characteristics from static image quality due to the existence of temporal masking effects. In this paper, we present a novel architecture, namely C3DVQA, that uses Convolutional Neural Network with 3D kernels (C3D) for full-reference VQA task. C3DVQA combines feature learning and score pooling into one spatiotemporal feature learning process. We use 2D convolutional layers to extract spatial features and 3D convolutional layers to learn spatiotemporal features. We empirically found that 3D convolutional layers are capable to capture temporal masking effects of videos. We evaluated the proposed method on the LIVE and CSIQ datasets. The experimental results demonstrate that the proposed method achieves the state-of-the-art performance.
Code (0)
등록된 구현이 없습니다.
Tasks
Video Quality AssessmentVisual Question Answering (VQA)Similar Papers 제목 키워드 기반
CompressedVQA-AEV: Full-Reference and No-Reference Quality Assessment Models for Asymmetric Encoded Videos
This report presents our solutions to the QoMEX 2026 Grand Challenge on Video Quality Assessment for Asymmetric Encoded Videos, comprising a full-reference (FR) model, CompressedVQA-AEV-FR, and a no-reference (NR) model,…
Video Quality AssessmentRankDVQA-mini: Knowledge Distillation-Driven Deep Video Quality Assessment
Deep learning-based video quality assessment (deep VQA) has demonstrated significant potential in surpassing conventional metrics, with promising improvements in terms of correlation with human perception. However, the p…
Knowledge DistillationModel CompressionVideo Quality AssessmentVisual Question Answering (VQA)CompressedVQA-HDR: Generalized Full-reference and No-reference Quality Assessment Models for Compressed High Dynamic Range Videos
Video compression is a standard procedure applied to all videos to minimize storage and transmission demands while preserving visual quality as much as possible. Therefore, evaluating the visual quality of compressed vid…
Video Quality AssessmentRankDVQA: Deep VQA based on Ranking-inspired Hybrid Training
In recent years, deep learning techniques have shown significant potential for improving video quality assessment (VQA), achieving higher correlation with subjective opinions compared to conventional approaches. However,…
Video Quality AssessmentVisual Question Answering (VQA)Perceptual Quality Assessment for Video Frame Interpolation
The quality of frames is significant for both research and application of video frame interpolation (VFI). In recent VFI studies, the methods of full-reference image quality assessment have generally been used to evaluat…
Full reference image quality assessmentFull-Reference Image Quality AssessmentImage Quality AssessmentTriplet+1