Video Compression with CNN-based Post Processing
In recent years, video compression techniques have been significantly challenged by the rapidly increased demands associated with high quality and immersive video content. Among various compression tools, post-processing can be applied on reconstructed video content to mitigate visible compression artefacts and to enhance overall perceptual quality. Inspired by advances in deep learning, we propose a new CNN-based post-processing approach, which has been integrated with two state-of-the-art coding standards, VVC and AV1. The results show consistent coding gains on all tested sequences at various spatial resolutions, with average bit rate savings of 4.0% and 5.8% against original VVC and AV1 respectively (based on the assessment of PSNR). This network has also been trained with perceptually inspired loss functions, which have further improved reconstruction quality based on perceptual quality assessment (VMAF), with average coding gains of 13.9% over VVC and 10.5% against AV1.
Code (0)
등록된 구현이 없습니다.
Tasks
Video CompressionSimilar Papers 제목 키워드 기반
Attention Based Image Compression Post-Processing Convolutional Neural Network
The traditional image compressors, e.g., BPG and H.266, have achieved great image and video compression quality. Recently, Convolutional Neural Network has been used widely in image compression. We proposed an attention-…
DecoderImage CompressionMS-SSIMSSIM+1Video Compression With Entropy-Constrained Neural Representations
Encoding videos as neural networks is a recently proposed approach that allows new forms of video processing. However, traditional techniques still outperform such neural video representation (NVR) methods for the ta…
QuantizationVideo CompressionSandwiched Video Compression: Efficiently Extending the Reach of Standard Codecs with Neural Wrappers
We propose sandwiched video compression -- a video compression system that wraps neural networks around a standard video codec. The sandwich framework consists of a neural pre- and post-processor with a standard video co…
Motion CompensationVideo CompressionEnhancing VVC with Deep Learning based Multi-Frame Post-Processing
This paper describes a CNN-based multi-frame post-processing approach based on a perceptually-inspired Generative Adversarial Network architecture, CVEGAN. This method has been integrated with the Versatile Video Coding …
Deep LearningGenerative Adversarial NetworkImage CompressionEnhanced Standard Compatible Image Compression Framework based on Auxiliary Codec Networks
To enhance image compression performance, recent deep neural network-based research can be divided into three categories: a learnable codec, a postprocessing network, and a compact representation network. The learnable c…
Image Compression