Learning True Rate-Distortion-Optimization for End-To-End Image Compression
Even though rate-distortion optimization is a crucial part of traditional image and video compression, not many approaches exist which transfer this concept to end-to-end-trained image compression. Most frameworks contain static compression and decompression models which are fixed after training, so efficient rate-distortion optimization is not possible. In a previous work, we proposed RDONet, which enables an RDO approach comparable to adaptive block partitioning in HEVC. In this paper, we enhance the training by introducing low-complexity estimations of the RDO result into the training. Additionally, we propose fast and very fast RDO inference modes. With our novel training method, we achieve average rate savings of 19.6% in MS-SSIM over the previous RDONet model, which equals rate savings of 27.3% over a comparable conventional deep image coder.
Code (0)
등록된 구현이 없습니다.
Tasks
Image CompressionMS-SSIMSSIMVideo CompressionSimilar Papers 제목 키워드 기반
A Practical Approach for Rate-Distortion-Perception Analysis in Learned Image Compression
Rate-distortion optimization (RDO) of codecs, where distortion is quantified by the mean-square error, has been a standard practice in image/video compression over the years. RDO serves well for optimization of codec per…
Image CompressionVideo CompressionSANR: Scene-Aware Neural Representation for Light Field Image Compression with Rate-Distortion Optimization
Light field images capture multi-view scene information and play a crucial role in 3D scene reconstruction. However, their high-dimensional nature results in enormous data volumes, posing a significant challenge for effi…
Image CompressionComputationally Efficient Neural Image Compression
Image compression using neural networks have reached or exceeded non-neural methods (such as JPEG, WebP, BPG). While these networks are state of the art in ratedistortion performance, computational feasibility of these m…
DecoderImage CompressionLossy Compression with Distortion Constrained Optimization
When training end-to-end learned models for lossy compression, one has to balance the rate and distortion losses. This is typically done by manually setting a tradeoff parameter $\beta$, an approach called $\beta$-VAE. U…
Image CompressionModel SelectionBalanced Rate-Distortion Optimization in Learned Image Compression
Learned image compression (LIC) using deep learning architectures has seen significant advancements, yet standard rate-distortion (R-D) optimization often encounters imbalanced updates due to diverse gradients of the rat…
Image Compression