Hierarchical Frequency-based Upsampling and Refining for Compressed Video Quality Enhancement
Video compression artifacts arise due to the quantization operation in the frequency domain. The goal of video quality enhancement is to reduce compression artifacts and reconstruct a visually-pleasant result. In this work, we propose a hierarchical frequency-based upsampling and refining neural network (HFUR) for compressed video quality enhancement. HFUR consists of two modules: implicit frequency upsampling module (ImpFreqUp) and hierarchical and iterative refinement module (HIR). ImpFreqUp exploits DCT-domain prior derived through implicit DCT transform, and accurately reconstructs the DCT-domain loss via a coarse-to-fine transfer. Consequently, HIR is introduced to facilitate cross-collaboration and information compensation between the scales, thus further refine the feature maps and promote the visual quality of the final output. We demonstrate the effectiveness of the proposed modules via ablation experiments and visualized results. Extensive experiments on public benchmarks show that HFUR achieves state-of-the-art performance for both constant bit rate and constant QP modes.
Code (0)
등록된 구현이 없습니다.
Tasks
QuantizationVideo CompressionSimilar Papers 제목 키워드 기반
PUFA-GAN: A Frequency-Aware Generative Adversarial Network for 3D Point Cloud Upsampling
We propose a generative adversarial network for point cloud upsampling, which can not only make the upsampled points evenly distributed on the underlying surface but also efficiently generate clean high frequency regions…
DescriptiveGenerative Adversarial Networkpoint cloud upsamplingLearning Spatiotemporal Frequency-Transformer for Compressed Video Super-Resolution
Compressed video super-resolution (VSR) aims to restore high-resolution frames from compressed low-resolution counterparts. Most recent VSR approaches often enhance an input frame by borrowing relevant textures from neig…
Super-ResolutionVideo EnhancementVideo Super-ResolutionLUVE : Latent-Cascaded Ultra-High-Resolution Video Generation with Dual Frequency Experts
Recent advances in video diffusion models have significantly improved visual quality, yet ultra-high-resolution (UHR) video generation remains a formidable challenge due to the compounded difficulties of motion modeling,…
Video GenerationMulti-level Wavelet-based Generative Adversarial Network for Perceptual Quality Enhancement of Compressed Video
The past few years have witnessed fast development in video quality enhancement via deep learning. Existing methods mainly focus on enhancing the objective quality of compressed video while ignoring its perceptual qualit…
Generative Adversarial NetworkMotion CompensationCRVOS: Clue Refining Network for Video Object Segmentation
The encoder-decoder based methods for semi-supervised video object segmentation (Semi-VOS) have received extensive attention due to their superior performances. However, most of them have complex intermediate networks wh…
DecoderObjectSegmentationSemantic Segmentation+4