paper-with-me

홈 › Papers

Efficient and Effective Context-Based Convolutional Entropy Modeling for Image Compression

2019-06-24 · Mu Li, Kede Ma, Jane You, David Zhang, WangMeng Zuo

Precise estimation of the probabilistic structure of natural images plays an essential role in image compression. Despite the recent remarkable success of end-to-end optimized image compression, the latent codes are usually assumed to be fully statistically factorized in order to simplify entropy modeling. However, this assumption generally does not hold true and may hinder compression performance. Here we present context-based convolutional networks (CCNs) for efficient and effective entropy modeling. In particular, a 3D zigzag scanning order and a 3D code dividing technique are introduced to define proper coding contexts for parallel entropy decoding, both of which boil down to place translation-invariant binary masks on convolution filters of CCNs. We demonstrate the promise of CCNs for entropy modeling in both lossless and lossy image compression. For the former, we directly apply a CCN to the binarized representation of an image to compute the Bernoulli distribution of each code for entropy estimation. For the latter, the categorical distribution of each code is represented by a discretized mixture of Gaussian distributions, whose parameters are estimated by three CCNs. We then jointly optimize the CCN-based entropy model along with analysis and synthesis transforms for rate-distortion performance. Experiments on the Kodak and Tecnick datasets show that our methods powered by the proposed CCNs generally achieve comparable compression performance to the state-of-the-art while being much faster.

📄 PDF Abstract BibTeX arXiv:1906.10057

Code (2)

limuhit/CCN 공식 구현
limuhit/SCAE 공식 구현

Tasks

Image Compression

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

Learning Context-Based Non-local Entropy Modeling for Image Compression

2020-05-10 · Mu Li, Kai Zhang, WangMeng Zuo, Radu Timofte 외

The entropy of the codes usually serves as the rate loss in the recent learned lossy image compression methods. Precise estimation of the probabilistic distribution of the codes plays a vital role in the performance. How…

Image Compression

Diversify, Contextualize, and Adapt: Efficient Entropy Modeling for Neural Image Codec

2024-11-06 · Jun-Hyuk Kim, Seungeon Kim, Won-Hee Lee, Dokwan Oh

Designing a fast and effective entropy model is challenging but essential for practical application of neural codecs. Beyond spatial autoregressive entropy models, more efficient backward adaptation-based entropy models …

HiDE: Hierarchical Dictionary-Based Entropy Modeling for Learned Image Compression

2026-03-06 · Haoxuan Xiong, Yuanyuan Xu, Kun Zhu, Yiming Wang 외 arxiv

Learned image compression (LIC) has achieved remarkable coding efficiency, where entropy modeling plays a pivotal role in minimizing bitrate through informative priors. Existing methods predominantly exploit internal con…

Image Compression

Entroformer: A Transformer-based Entropy Model for Learned Image Compression

2022-02-11 · ICLR 2022 4 · Yichen Qian, Ming Lin, Xiuyu Sun, Zhiyu Tan 외

One critical component in lossy deep image compression is the entropy model, which predicts the probability distribution of the quantized latent representation in the encoding and decoding modules. Previous works build e…

image-classificationImage ClassificationImage CompressionPosition

Context Guided Transformer Entropy Modeling for Video Compression

2025-08-03 · Junlong Tong, Wei Zhang, Yaohui Jin, Xiaoyu Shen arxiv

Conditional entropy models effectively leverage spatio-temporal contexts to reduce video redundancy. However, incorporating temporal context often introduces additional model complexity and increases computational cost. …