Encoder-Quantization-Motion-based Video Quality Metrics
In an adaptive bitrate streaming application, the efficiency of video compression and the encoded video quality depend on both the video codec and the quality metric used to perform encoding optimization. The development of such a quality metric need large scale subjective datasets. In this work we merge several datasets into one to support the creation of a metric tailored for video compression and scaling. We proposed a set of HEVC lightweight features to boost performance of the metrics. Our metrics can be computed from tightly coupled encoding process with 4% compute overhead or from the decoding process in real-time. The proposed method can achieve better correlation than VMAF and P.1204.3. It can extrapolate to different dynamic ranges, and is suitable for real-time video quality metrics delivery in the bitstream. The performance is verified by in-distribution and cross-dataset tests. This work paves the way for adaptive client-side heuristics, real-time segment optimization, dynamic bitrate capping, and quality-dependent post-processing neural network switching, etc.
Code (0)
등록된 구현이 없습니다.
Tasks
QuantizationVideo CompressionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Deep Perceptual Preprocessing for Video Coding
We introduce the concept of rate-aware deep perceptual preprocessing (DPP) for video encoding. DPP makes a single pass over each input frame in order to enhance its visual quality when the video is to be compressed w…
Image Quality AssessmentNo-Reference Image Quality AssessmentQuantizationExploring the Distributed Video Coding in a Quality Assessment Context
In the popular video coding trend, the encoder has the task to exploit both spatial and temporal redundancies present in the video sequence, which is a complex procedure. As a result almost all video encoders have five t…
DecoderMotion CompensationMotion EstimationVideo CompressionA Perceptual Based Motion Compensation Technique for Video Coding
Motion estimation is one of the important procedures in the all video encoders. Most of the complexity of the video coder depends on the complexity of the motion estimation step. The original motion estimation algorithm …
Motion CompensationMotion EstimationSSIMMotionAura: Generating High-Quality and Motion Consistent Videos using Discrete Diffusion
The spatio-temporal complexity of video data presents significant challenges in tasks such as compression, generation, and inpainting. We present four key contributions to address the challenges of spatiotemporal video p…
Denoisingparameter-efficient fine-tuningQuantizationText-to-Video Generation+3Object Detection-Based Variable Quantization Processing
In this paper, we propose a preprocessing method for conventional image and video encoders that can make these existing encoders content-aware. By going through our process, a higher quality parameter could be set on a t…
MS-SSIMObjectobject-detectionObject Detection+2