paper-with-me

홈 › Papers

Deep Source-Channel Coding for Sentence Semantic Transmission with HARQ

2021-06-06 · Peiwen Jiang, Chao-Kai Wen, Shi Jin, Geoffrey Ye Li

Recently, semantic communication has been brought to the forefront because of its great success in deep learning (DL), especially Transformer. Even if semantic communication has been successfully applied in the sentence transmission to reduce semantic errors, existing architecture is usually fixed in the codeword length and is inefficient and inflexible for the varying sentence length. In this paper, we exploit hybrid automatic repeat request (HARQ) to reduce semantic transmission error further. We first combine semantic coding (SC) with Reed Solomon (RS) channel coding and HARQ, called SC-RS-HARQ, which exploits the superiority of the SC and the reliability of the conventional methods successfully. Although the SC-RS-HARQ is easily applied in the existing HARQ systems, we also develop an end-to-end architecture, called SCHARQ, to pursue the performance further. Numerical results demonstrate that SCHARQ significantly reduces the required number of bits for sentence semantic transmission and sentence error rate. Finally, we attempt to replace error detection from cyclic redundancy check to a similarity detection network called Sim32 to allow the receiver to reserve the wrong sentences with similar semantic information and to save transmission resources.

📄 PDF Abstract BibTeX arXiv:2106.03009

Code (0)

등록된 구현이 없습니다.

Tasks

Semantic CommunicationSentence

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Adam 설명 없음
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…

Similar Papers 제목 키워드 기반

Deep Learning for Joint Source-Channel Coding of Text

2018-02-19 · Nariman Farsad, Milind Rao, Andrea Goldsmith

We consider the problem of joint source and channel coding of structured data such as natural language over a noisy channel. The typical approach to this problem in both theory and practice involves performing source cod…

DecoderDeep Learning

Short Wins Long: Short Codes with Language Model Semantic Correction Outperform Long Codes

2025-05-13 · Jiafu Hao, Chentao Yue, Hao Chang, Branka Vucetic 외

This paper presents a novel semantic-enhanced decoding scheme for transmitting natural language sentences with multiple short block codes over noisy wireless channels. After ASCII source coding, the natural language sent…

Language ModelingLanguage ModellingSentence

Transformer-based Joint Source Channel Coding for Textual Semantic Communication

2023-07-23 · Shicong Liu, Zhen Gao, Gaojie Chen, Yu Su 외

The Space-Air-Ground-Sea integrated network calls for more robust and secure transmission techniques against jamming. In this paper, we propose a textual semantic transmission framework for robust transmission, which uti…

Semantic CommunicationSemantic SimilaritySemantic Textual SimilaritySentence

Nonlinear Transform Source-Channel Coding for Semantic Communications

2021-12-21 · Jincheng Dai, Sixian Wang, Kailin Tan, Zhongwei Si 외

In this paper, we propose a class of high-efficiency deep joint source-channel coding methods that can closely adapt to the source distribution under the nonlinear transform, it can be collected under the name nonlinear …

Wireless Deep Video Semantic Transmission

2022-05-26 · Sixian Wang, Jincheng Dai, Zijian Liang, Kai Niu 외

In this paper, we design a new class of high-efficiency deep joint source-channel coding methods to achieve end-to-end video transmission over wireless channels. The proposed methods exploit nonlinear transform and condi…