Leveraging Bitstream Metadata for Fast, Accurate, Generalized Compressed Video Quality Enhancement
Video compression is a central feature of the modern internet powering technologies from social media to video conferencing. While video compression continues to mature, for many compression settings, quality loss is still noticeable. These settings nevertheless have important applications to the efficient transmission of videos over bandwidth constrained or otherwise unstable connections. In this work, we develop a deep learning architecture capable of restoring detail to compressed videos which leverages the underlying structure and motion information embedded in the video bitstream. We show that this improves restoration accuracy compared to prior compression correction methods and is competitive when compared with recent deep-learning-based video compression methods on rate-distortion while achieving higher throughput. Furthermore, we condition our model on quantization data which is readily available in the bitstream. This allows our single model to handle a variety of different compression quality settings which required an ensemble of models in prior work.
Code (0)
등록된 구현이 없습니다.
Tasks
QuantizationVideo CompressionSimilar Papers 제목 키워드 기반
Blind Bitstream-corrupted Video Recovery via Metadata-guided Diffusion Model
Bitstream-corrupted video recovery aims to fill in realistic video content due to bitstream corruption during video storage or transmission. Most existing methods typically assume that the predefined masks of the cor…
Blind Bitstream-corrupted Video Recovery via Metadata-guided Diffusion Model
Bitstream-corrupted video recovery aims to restore realistic content degraded during video storage or transmission. Existing methods typically assume that predefined masks of corrupted regions are available, but manually…
Leveraging Compressed Frame Sizes For Ultra-Fast Video Classification
Classifying videos into distinct categories, such as Sport and Music Video, is crucial for multimedia understanding and retrieval, especially when an immense volume of video content is being constantly generated. Traditi…
Dynamic Time WarpingRetrievalVideo ClassificationUnified Coding for Both Human Perception and Generalized Machine Analytics with CLIP Supervision
The image compression model has long struggled with adaptability and generalization, as the decoded bitstream typically serves only human or machine needs and fails to preserve information for unseen visual tasks. Theref…
Image CompressionHTTP Adaptive Streaming QoE Estimation with ITU-T Rec. P.1203 – Open Databases and Software
This paper describes an open dataset and software for ITU-T Rec. P.1203. As the first standardized Quality of Experience model for audiovisual HTTP Adaptive Streaming (HAS), it has been extensively trained and validated …