paper-with-me

Papers

Learning Linear Block Error Correction Codes

2024-05-07 · Yoni Choukroun, Lior Wolf

Error correction codes are a crucial part of the physical communication layer, ensuring the reliable transfer of data over noisy channels. The design of optimal linear block codes capable of being efficiently decoded is of major concern, especially for short block lengths. While neural decoders have recently demonstrated their advantage over classical decoding techniques, the neural design of the codes remains a challenge. In this work, we propose for the first time a unified encoder-decoder training of binary linear block codes. To this end, we adapt the coding setting to support efficient and differentiable training of the code for end-to-end optimization over the order two Galois field. We also propose a novel Transformer model in which the self-attention masking is performed in a differentiable fashion for the efficient backpropagation of the code gradient. Our results show that (i) the proposed decoder outperforms existing neural decoding on conventional codes, (ii) the suggested framework generates codes that outperform the {analogous} conventional codes, and (iii) the codes we developed not only excel with our decoder but also show enhanced performance with traditional decoding techniques.

📄 PDF Abstract BibTeX arXiv:2405.04050

Code (1)

yonilc/e2e_dc_ecct 공식 구현 pytorch

Tasks

Decoder

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Residual Connection 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Position-Wise Feed-Forward Layer 설명 없음
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Similar Papers 제목 키워드 기반

Designing communication systems via iterative improvement: error correction coding with Bayes decoder and codebook optimized for source symbol error

2018-05-18 · Chai Wah Wu

In most error correction coding (ECC) frameworks, the typical error metric is the bit error rate (BER) which measures the number of bit errors. For this metric, the positions of the bits are not relevant to the decoding,…

Decoder

GNN-based Auto-Encoder for Short Linear Block Codes: A DRL Approach

2024-12-03 · Kou Tian, Chentao Yue, Changyang She, Yonghui Li 외

This paper presents a novel auto-encoder based end-to-end channel encoding and decoding. It integrates deep reinforcement learning (DRL) and graph neural networks (GNN) in code design by modeling the generation of code p…

DecoderDeep Reinforcement Learning

Short Wins Long: Short Codes with Language Model Semantic Correction Outperform Long Codes

2025-05-13 · Jiafu Hao, Chentao Yue, Hao Chang, Branka Vucetic 외

This paper presents a novel semantic-enhanced decoding scheme for transmitting natural language sentences with multiple short block codes over noisy wireless channels. After ASCII source coding, the natural language sent…

Language ModelingLanguage ModellingSentence

Robust Non-Linear Feedback Coding via Power-Constrained Deep Learning

2023-04-25 · JungHoon Kim, Taejoon Kim, David Love, Christopher Brinton

The design of codes for feedback-enabled communications has been a long-standing open problem. Recent research on non-linear, deep learning-based coding schemes have demonstrated significant improvements in communication…

DecoderDeep Learning

DeepPolar: Inventing Nonlinear Large-Kernel Polar Codes via Deep Learning

2024-02-14 · S Ashwin Hebbar, Sravan Kumar Ankireddy, Hyeji Kim, Sewoong Oh 외

Progress in designing channel codes has been driven by human ingenuity and, fittingly, has been sporadic. Polar codes, developed on the foundation of Arikan's polarization kernel, represent the latest breakthrough in cod…

Deep LearningIngenuity