Graph Permutation Selection for Decoding of Error Correction Codes using Self-Attention
Error correction codes are an integral part of communication applications and boost the reliability of transmission. The optimal decoding of transmitted codewords is the maximum likelihood rule, which is NP-hard. For practical realizations, suboptimal decoding algorithms are employed; however, the lack of theoretical insights currently impedes the exploitation of the full potential of these algorithms. One key insight is the choice of permutation in \textit{permutation decoding}. We present a data-driven framework for permutation selection combining domain knowledge with machine learning concepts such as node embedding and self-attention. Significant and consistent improvements in the bit error rate are shown for all simulated codes as compared to the baseline decoders. To the best of our knowledge, this work is the first to leverage the benefits of self-attention networks in physical layer communication systems.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Decoding Polar Codes with Reinforcement Learning
In this paper we address the problem of selecting factor-graph permutations of polar codes under belief propagation (BP) decoding to significantly improve the error-correction performance of the code. In particular, we f…
Decoderreinforcement-learningReinforcement LearningReinforcement Learning (RL)perm2vec: Graph Permutation Selection for Decoding of Error Correction Codes using Self-Attention
Error correction codes are an integral part of communication applications, boosting the reliability of transmission. The optimal decoding of transmitted codewords is the maximum likelihood rule, which is NP-hard due to t…
GEC-DePenD: Non-Autoregressive Grammatical Error Correction with Decoupled Permutation and Decoding
Grammatical error correction (GEC) is an important NLP task that is currently usually solved with autoregressive sequence-to-sequence models. However, approaches of this class are inherently slow due to one-by-one token …
DecoderDenoisingGrammatical Error CorrectionSynthetic Data GenerationOptimization Algorithms for Improving the Performance of Permutation Trellis Codes
In this paper, soft-decision (SD) decoders of permutation trellis code (PTC) with $M$-ary frequency shift keying are designed using three optimization algorithms and presented in four decoding schemes. In a concatenated …
DecoderNeural Network Decoders for Permutation Codes Correcting Different Errors
Permutation codes were extensively studied in order to correct different types of errors for the applications on power line communication and rank modulation for flash memory. In this paper, we introduce the neural netwo…