paper-with-me

Papers

iFlow: Numerically Invertible Flows for Efficient Lossless Compression via a Uniform Coder

2021-11-01 · NeurIPS 2021 12 · Shifeng Zhang, Ning Kang, Tom Ryder, Zhenguo Li

It was estimated that the world produced $59 ZB$ ($5.9 \times 10^{13} GB$) of data in 2020, resulting in the enormous costs of both data storage and transmission. Fortunately, recent advances in deep generative models have spearheaded a new class of so-called "neural compression" algorithms, which significantly outperform traditional codecs in terms of compression ratio. Unfortunately, the application of neural compression garners little commercial interest due to its limited bandwidth; therefore, developing highly efficient frameworks is of critical practical importance. In this paper, we discuss lossless compression using normalizing flows which have demonstrated a great capacity for achieving high compression ratios. As such, we introduce iFlow, a new method for achieving efficient lossless compression. We first propose Modular Scale Transform (MST) and a novel family of numerically invertible flow transformations based on MST. Then we introduce the Uniform Base Conversion System (UBCS), a fast uniform-distribution codec incorporated into iFlow, enabling efficient compression. iFlow achieves state-of-the-art compression ratios and is $5\times$ quicker than other high-performance schemes. Furthermore, the techniques presented in this paper can be used to accelerate coding time for a broad class of flow-based algorithms.

📄 PDF Abstract BibTeX arXiv:2111.00965

Code (0)

등록된 구현이 없습니다.

Tasks

Image Compression

Methods 이 논문이 사용한 방법론

Normalizing Flows Normalizing Flows are a method for constructing complex distributions by transforming a probability density through a series of invertible mappings. By repeatedly applying…

Similar Papers 제목 키워드 기반

IDF++: Analyzing and Improving Integer Discrete Flows for Lossless Compression

2020-06-22 · ICLR 2021 1 · Rianne van den Berg, Alexey A. Gritsenko, Mostafa Dehghani, Casper Kaae Sønderby 외

In this paper we analyse and improve integer discrete flows for lossless compression. Integer discrete flows are a recently proposed class of models that learn invertible transformations for integer-valued random variabl…

Quantization

iVPF: Numerical Invertible Volume Preserving Flow for Efficient Lossless Compression

2021-03-30 · CVPR 2021 1 · Shifeng Zhang, Chen Zhang, Ning Kang, Zhenguo Li

It is nontrivial to store rapidly growing big data nowadays, which demands high-performance lossless compression techniques. Likelihood-based generative models have witnessed their success on lossless compression, where …

iVPF: Numerical Invertible Volume Preserving Flow for Efficient Lossless Compression

2021-09-05 · CVPR 2021 9 · Changsu Cao, Jiaqi Hu, Wengang Zhang, Xusheng Xu 외

It is nontrivial to store rapidly growing big data nowadays, which demands high-performance lossless compression techniques. Likelihood-based generative models have witnessed their success on lossless compression, where …

Integer Discrete Flows and Lossless Compression

2019-05-17 · NeurIPS 2019 12 · Emiel Hoogeboom, Jorn W. T. Peters, Rianne van den Berg, Max Welling

Lossless compression methods shorten the expected representation size of data without loss of information, using a statistical model. Flow-based models are attractive in this setting because they admit exact likelihood o…

Fast Lossless Neural Compression with Integer-Only Discrete Flows

2022-06-17 · Siyu Wang, Jianfei Chen, Chongxuan Li, Jun Zhu 외

By applying entropy codecs with learned data distributions, neural compressors have significantly outperformed traditional codecs in terms of compression ratio. However, the high inference latency of neural networks hind…

Quantization