Optimized learned entropy coding parameters for practical neural-based image and video compression
Neural-based image and video codecs are significantly more power-efficient when weights and activations are quantized to low-precision integers. While there are general-purpose techniques for reducing quantization effects, large losses can occur when specific entropy coding properties are not considered. This work analyzes how entropy coding is affected by parameter quantizations, and provides a method to minimize losses. It is shown that, by using a certain type of coding parameters to be learned, uniform quantization becomes practically optimal, also simplifying the minimization of code memory requirements. The mathematical properties of the new representation are presented, and its effectiveness is demonstrated by coding experiments, showing that good results can be obtained with precision as low as 4~bits per network output, and practically no loss with 8~bits.
Code (0)
등록된 구현이 없습니다.
Tasks
QuantizationVideo CompressionSimilar Papers 제목 키워드 기반
Image Compression With Learned Lifting-Based DWT and Learned Tree-Based Entropy Models
This paper explores learned image compression based on traditional and learned discrete wavelet transform (DWT) architectures and learned entropy models for coding DWT subband coefficients. A learned DWT is obtained thro…
Image CompressionEnd-to-End Rate-Distortion Optimization for Bi-Directional Learned Video Compression
Conventional video compression methods employ a linear transform and block motion model, and the steps of motion estimation, mode and quantization parameter selection, and entropy coding are optimized individually due to…
Motion EstimationQuantizationVideo CompressionEnd-to-End Rate-Distortion Optimized Learned Hierarchical Bi-Directional Video Compression
Conventional video compression (VC) methods are based on motion compensated transform coding, and the steps of motion estimation, mode and quantization parameter selection, and entropy coding are optimized individually d…
Motion EstimationMS-SSIMQuantizationSSIM+1Video Coding Using Learned Latent GAN Compression
We propose in this paper a new paradigm for facial video compression. We leverage the generative capacity of GANs such as StyleGAN to represent and compress a video, including intra and inter compression. Each frame is i…
Video CompressionPractical Full Resolution Learned Lossless Image Compression
We propose the first practical learned lossless image compression system, L3C, and show that it outperforms the popular engineered codecs, PNG, WebP and JPEG 2000. At the core of our method is a fully parallelizable hier…
Image Compression