paper-with-me

홈 › Papers

LLIC: Large Receptive Field Transform Coding with Adaptive Weights for Learned Image Compression

2023-04-19 · Wei Jiang, Peirong Ning, Jiayu Yang, Yongqi Zhai, Feng Gao, Ronggang Wang

The effective receptive field (ERF) plays an important role in transform coding, which determines how much redundancy can be removed during transform and how many spatial priors can be utilized to synthesize textures during inverse transform. Existing methods rely on stacks of small kernels, whose ERFs remain insufficiently large, or heavy non-local attention mechanisms, which limit the potential of high-resolution image coding. To tackle this issue, we propose Large Receptive Field Transform Coding with Adaptive Weights for Learned Image Compression (LLIC). Specifically, for the first time in the learned image compression community, we introduce a few large kernelbased depth-wise convolutions to reduce more redundancy while maintaining modest complexity. Due to the wide range of image diversity, we further propose a mechanism to augment convolution adaptability through the self-conditioned generation of weights. The large kernels cooperate with non-linear embedding and gate mechanisms for better expressiveness and lighter pointwise interactions. Our investigation extends to refined training methods that unlock the full potential of these large kernels. Moreover, to promote more dynamic inter-channel interactions, we introduce an adaptive channel-wise bit allocation strategy that autonomously generates channel importance factors in a self-conditioned manner. To demonstrate the effectiveness of the proposed transform coding, we align the entropy model to compare with existing transform methods and obtain models LLIC-STF, LLIC-ELIC, and LLIC-TCM. Extensive experiments demonstrate that our proposed LLIC models have significant improvements over the corresponding baselines and reduce the BD-Rate by 9.49%, 9.47%, 10.94% on Kodak over VTM-17.0 Intra, respectively. Our LLIC models achieve state-of-the-art performances and better trade-offs between performance and complexity.

📄 PDF Abstract BibTeX arXiv:2304.09571

Code (0)

등록된 구현이 없습니다.

Tasks

Image Compression

Methods 이 논문이 사용한 방법론

ALIGN In the ALIGN method, visual and language representations are jointly trained from noisy image alt-text data. The image and text encoders are learned via contrastive loss…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

Neural encoding with affine feature response transforms

2025-01-07 · Lynn Le, Nils Kimman, Thirza Dado, Katja Seeliger 외

Current linearizing encoding models that predict neural responses to sensory input typically neglect neuroscience-inspired constraints that could enhance model efficiency and interpretability. To address this, we propose…

FMRT: Learning Accurate Feature Matching with Reconciliatory Transformer

2023-10-20 · Xinyu Zhang, Li Wang, Zhiqiang Jiang, Kun Dai 외

Local Feature Matching, an essential component of several computer vision tasks (e.g., structure from motion and visual localization), has been effectively settled by Transformer-based methods. However, these methods onl…

Homography EstimationPose EstimationVisual Localization

Rewiring with Positional Encodings for Graph Neural Networks

2022-01-29 · Rickard Brüel-Gabrielsson, Mikhail Yurochkin, Justin Solomon

Several recent works use positional encodings to extend the receptive fields of graph neural network (GNN) layers equipped with attention mechanisms. These techniques, however, extend receptive fields to the complete gra…

Graph Neural Network

Efficient Coding Approach Towards Non-Linear Spectro-Temporal Receptive Fields

2021-10-21 · Pranav Sankhe, Prasanna Chaporkar

Linear Non-Linear(LN) models are widely used to characterize the receptive fields of early-stage auditory processing. We apply the principle of efficient coding to the LN model of Spectro-Temporal Receptive Fields(STRFs)…

Learning Receptive Fields for Pooling from Tensors of Feature Response

2014-06-01 · CVPR 2014 6 · Can Xu, Nuno Vasconcelos

A new method for learning pooling receptive fields for recognition is presented. The method exploits the statistics of the 3D tensor of SIFT responses to an image. It is argued that the eigentensors of this tensor contai…

ClassificationGeneral Classificationimage-classificationImage Classification+3