Multi-Reference and Adaptive Nonlinear Transform Source-Channel Coding for Wireless Image Semantic Transmission
We propose a multi-reference and adaptive nonlinear transform source-channel coding (MA-NTSCC) system for wireless image semantic transmission to improve rate-distortion (RD) performance by introducing multi-dimensional contexts into the entropy model of the state-of-the-art (SOTA) NTSCC system. Improvements in RD performance of the proposed MA-NTSCC system are particularly significant in high-resolution image transmission under low bandwidth constraints. The proposed multi-reference entropy model leverages correlations within the latent representation in both spatial and channel dimensions. In the spatial dimension, the latent representation is divided into anchors and non-anchors in a checkerboard pattern, where anchors serve as reference to estimate the mutual information between anchors and non-anchors. In the channel dimension, the latent representation is partitioned into multiple groups, and features in previous groups are analyzed to estimate the mutual information between features in previous and current groups. Taking mutual information into account, the entropy model provides an accurate estimation on the entropy, which enables efficient bandwidth allocation and enhances RD performance. Additionally, the proposed lightweight adaptation modules enable the proposed MA-NTSCC model to achieve transmission quality comparable to separately trained models across various channel conditions and bandwidth requirements. In contrast, traditional NTSCC models provide signal-to-noise ratio (SNR)-distortion performance degrading with channel quality deviating from the fixed training SNR, and consume inflexible bandwidth to transmit an image. Comprehensive experiments are conducted to verify the peak signal-to-noise ratio (PSNR) performance and adaptability of the proposed MA-NTSCC model superior to SOTA methods over both additive white Gaussian noise channel and Rayleigh fading channel.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Semi-Blind Source Separation for Nonlinear Acoustic Echo Cancellation
The mismatch between the numerical and actual nonlinear models is a challenge to nonlinear acoustic echo cancellation (NAEC) when the nonlinear adaptive filter is utilized. To alleviate this problem, we combine a basis-g…
Acoustic echo cancellationblind source separationNonlinear Transform Source-Channel Coding for Semantic Communications
In this paper, we propose a class of high-efficiency deep joint source-channel coding methods that can closely adapt to the source distribution under the nonlinear transform, it can be collected under the name nonlinear …
Deep Model Reference Adaptive Control
We present a new neuroadaptive architecture: Deep Neural Network based Model Reference Adaptive Control (DMRAC). Our architecture utilizes the power of deep neural network representations for modeling significant nonline…
modelNVTC: Nonlinear Vector Transform Coding
In theory, vector quantization (VQ) is always better than scalar quantization (SQ) in terms of rate-distortion (R-D) performance. Recent state-of-the-art methods for neural image compression are mainly based on nonlinear…
Image CompressionQuantizationGraph-Adaptive Activation Functions for Graph Neural Networks
Activation functions are crucial in graph neural networks (GNNs) as they allow defining a nonlinear family of functions to capture the relationship between the input graph data and their representations. This paper propo…
Recommendation Systems