perm2vec: Graph Permutation Selection for Decoding of Error Correction Codes using Self-Attention

2020-02-06 · Nir Raviv, Avi Caciularu, Tomer Raviv, Jacob Goldberger, Yair Be'ery

Error correction codes are an integral part of communication applications, boosting the reliability of transmission. The optimal decoding of transmitted codewords is the maximum likelihood rule, which is NP-hard due to the curse of dimensionality. For practical realizations, sub-optimal decoding algorithms are employed; yet limited theoretical insights prevent one from exploiting the full potential of these algorithms. One such insight is the choice of permutation in permutation decoding. We present a data-driven framework for permutation selection, combining domain knowledge with machine learning concepts such as node embedding and self-attention. Significant and consistent improvements in the bit error rate are introduced for all simulated codes, over the baseline decoders. To the best of the authors' knowledge, this work is the first to leverage the benefits of the neural Transformer networks in physical layer communication systems.

📄 PDF Abstract BibTeX arXiv:2002.02315

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…

Position-Wise Feed-Forward Layer 설명 없음

Residual Connection 설명 없음

BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…

Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…

ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…

Decoding Polar Codes with Reinforcement Learning

2020-09-15 · Nghia Doan, Seyyed Ali Hashemi, Warren Gross

In this paper we address the problem of selecting factor-graph permutations of polar codes under belief propagation (BP) decoding to significantly improve the error-correction performance of the code. In particular, we f…

Decoder reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Decoder Denoising Grammatical Error Correction Synthetic Data Generation

perm2vec: Graph Permutation Selection for Decoding of Error Correction Codes using Self-Attention

Code (0)

Methods 이 논문이 사용한 방법론

Similar Papers 제목 키워드 기반

Decoding Polar Codes with Reinforcement Learning

Graph Permutation Selection for Decoding of Error Correction Codes using Self-Attention

Neural Network Decoders for Permutation Codes Correcting Different Errors

Permutation-Invariant Set Autoencoders with Fixed-Size Embeddings for Multi-Agent Learning

GEC-DePenD: Non-Autoregressive Grammatical Error Correction with Decoupled Permutation and Decoding