ST-GREED: Space-Time Generalized Entropic Differences for Frame Rate Dependent Video Quality Prediction
We consider the problem of conducting frame rate dependent video quality assessment (VQA) on videos of diverse frame rates, including high frame rate (HFR) videos. More generally, we study how perceptual quality is affected by frame rate, and how frame rate and compression combine to affect perceived quality. We devise an objective VQA model called Space-Time GeneRalized Entropic Difference (GREED) which analyzes the statistics of spatial and temporal band-pass video coefficients. A generalized Gaussian distribution (GGD) is used to model band-pass responses, while entropy variations between reference and distorted videos under the GGD model are used to capture video quality variations arising from frame rate changes. The entropic differences are calculated across multiple temporal and spatial subbands, and merged using a learned regressor. We show through extensive experiments that GREED achieves state-of-the-art performance on the LIVE-YT-HFR Database when compared with existing VQA models. The features used in GREED are highly generalizable and obtain competitive performance even on standard, non-HFR VQA databases. The implementation of GREED has been made available online: https://github.com/pavancm/GREED
Code (1)
Tasks
Video Quality AssessmentVisual Question Answering (VQA)Similar Papers 제목 키워드 기반
High Frame Rate Video Quality Assessment using VMAF and Entropic Differences
The popularity of streaming videos with live, high-action content has led to an increased interest in High Frame Rate (HFR) videos. In this work we address the problem of frame rate dependent Video Quality Assessment (VQ…
Video Quality AssessmentVisual Question Answering (VQA)Vocal Bursts Intensity PredictionMaking Video Quality Assessment Models Sensitive to Frame Rate Distortions
We consider the problem of capturing distortions arising from changes in frame rate as part of Video Quality Assessment (VQA). Variable frame rate (VFR) videos have become much more common, and streamed videos commonly r…
Video Quality AssessmentVisual Question Answering (VQA)Recursive Entropic Variational Inference for Nonlinear State-Space Models
We present a class of algorithms for state estimation in nonlinear, non-Gaussian state-space models. Our approach is based on a variational Lagrangian formulation that casts Bayesian inference as a sequence of entropic t…
Bayesian InferenceQuality Modeling Under A Relaxed Natural Scene Statistics Model
Information-theoretic image quality assessment (IQA) models such as Visual Information Fidelity (VIF) and Spatio-temporal Reduced Reference Entropic Differences (ST-RRED) have enjoyed great success by seamlessly integrat…
Image Quality AssessmentEntropic Causality and Greedy Minimum Entropy Coupling
We study the problem of identifying the causal relationship between two discrete random variables from observational data. We recently proposed a novel framework called entropic causality that works in a very general fun…