paper-with-me

Papers

Bidirectional Stereo Image Compression with Cross-Dimensional Entropy Model

2024-07-15 · Zhening Liu, Xinjie Zhang, Jiawei Shao, Zehong Lin, Jun Zhang

With the rapid advancement of stereo vision technologies, stereo image compression has emerged as a crucial field that continues to draw significant attention. Previous approaches have primarily employed a unidirectional paradigm, where the compression of one view is dependent on the other, resulting in imbalanced compression. To address this issue, we introduce a symmetric bidirectional stereo image compression architecture, named BiSIC. Specifically, we propose a 3D convolution based codec backbone to capture local features and incorporate bidirectional attention blocks to exploit global features. Moreover, we design a novel cross-dimensional entropy model that integrates various conditioning factors, including the spatial context, channel context, and stereo dependency, to effectively estimate the distribution of latent representations for entropy coding. Extensive experiments demonstrate that our proposed BiSIC outperforms conventional image/video compression standards, as well as state-of-the-art learning-based methods, in terms of both PSNR and MS-SSIM.

📄 PDF Abstract BibTeX arXiv:2407.10632

Code (1)

liuzhening111/bisic 공식 구현 pytorch

Tasks

Image CompressionMS-SSIMSSIMVideo Compression

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음
3D Convolution A 3D Convolution is a type of convolution where the kernel slides in 3 dimensions as opposed to 2 dimensions with 2D…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

CAMSIC: Content-aware Masked Image Modeling Transformer for Stereo Image Compression

2024-03-13 · Xinjie Zhang, Shenyuan Gao, Zhening Liu, Jiawei Shao 외

Existing learning-based stereo image codec adopt sophisticated transformation with simple entropy models derived from single image codecs to encode latent representations. However, those entropy models struggle to effect…

DecoderImage Compression

Low-Latency Neural Stereo Streaming

2024-03-26 · CVPR 2024 1 · Qiqi Hou, Farzad Farhadzadeh, Amir Said, Guillaume Sautiere 외

The rise of new video modalities like virtual reality or autonomous driving has increased the demand for efficient multi-view video compression methods, both in terms of rate-distortion (R-D) performance and in terms of …

Autonomous DrivingMotion CompensationVideo Compression

ECSIC: Epipolar Cross Attention for Stereo Image Compression

2023-07-18 · Matthias Wödlinger, Jan Kotera, Manuel Keglevic, Jan Xu 외

In this paper, we present ECSIC, a novel learned method for stereo image compression. Our proposed method compresses the left and right images in a joint manner by exploiting the mutual information between the images of …

Image Compression

Stereo Image Coding for Machines with Joint Visual Feature Compression

2025-02-20 · Dengchao Jin, Jianjun Lei, Bo Peng, Zhaoqing Pan 외

2D image coding for machines (ICM) has achieved great success in coding efficiency, while less effort has been devoted to stereo image fields. To promote the efficiency of stereo image compression (SIC) and intelligent a…

Feature CompressionImage Compression

SASIC: Stereo Image Compression With Latent Shifts and Stereo Attention

2022-01-01 · CVPR 2022 1 · Matthias Wödlinger, Jan Kotera, Jan Xu, Robert Sablatnig

We propose a learned method for stereo image compression that leverages the similarity of the left and right images in a stereo pair due to overlapping fields of view. The left image is compressed by a learned compre…

Image Compression