paper-with-me

Papers

Deep Learning Enabled Semantic Communication Systems

2020-06-18 · Huiqiang Xie, Zhijin Qin, Geoffrey Ye Li, Biing-Hwang Juang

Recently, deep learned enabled end-to-end (E2E) communication systems have been developed to merge all physical layer blocks in the traditional communication systems, which make joint transceiver optimization possible. Powered by deep learning, natural language processing (NLP) has achieved great success in analyzing and understanding large amounts of language texts. Inspired by research results in both areas, we aim to providing a new view on communication systems from the semantic level. Particularly, we propose a deep learning based semantic communication system, named DeepSC, for text transmission. Based on the Transformer, the DeepSC aims at maximizing the system capacity and minimizing the semantic errors by recovering the meaning of sentences, rather than bit- or symbol-errors in traditional communications. Moreover, transfer learning is used to ensure the DeepSC applicable to different communication environments and to accelerate the model training process. To justify the performance of semantic communications accurately, we also initialize a new metric, named sentence similarity. Compared with the traditional communication system without considering semantic information exchange, the proposed DeepSC is more robust to channel variation and is able to achieve better performance, especially in the low signal-to-noise (SNR) regime, as demonstrated by the extensive simulation results.

📄 PDF Abstract BibTeX arXiv:2006.10685

Code (1)

13274086/DeepSC 공식 구현 pytorch

Tasks

Deep LearningSemantic CommunicationSentenceSentence SimilarityTransfer Learning

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Adam 설명 없음

Similar Papers 제목 키워드 기반

A Robust Deep Learning Enabled Semantic Communication System for Text

2022-06-06 · Xiang Peng, Zhijin Qin, Danlan Huang, Xiaoming Tao 외

With the advent of the 6G era, the concept of semantic communication has attracted increasing attention. Compared with conventional communication systems, semantic communication systems are not only affected by physical …

Deep LearningSemantic Communication

One-to-Many Semantic Communication Systems: Design, Implementation, Performance Evaluation

2022-09-20 · Han Hu, Xingwu Zhu, Fuhui Zhou, Wei Wu 외

Semantic communication in the 6G era has been deemed a promising communication paradigm to break through the bottleneck of traditional communications. However, its applications for the multi-user scenario, especially the…

Semantic CommunicationTransfer Learning

Vector Quantized Semantic Communication System

2022-09-23 · Qifan Fu, Huiqiang Xie, Zhijin Qin, Gregory Slabaugh 외

Although analog semantic communication systems have received considerable attention in the literature, there is less work on digital semantic communication systems. In this paper, we develop a deep learning (DL)-enabled …

MS-SSIMQuantizationSemantic CommunicationSSIM

Deep Learning Enabled Semantic Communications with Speech Recognition and Synthesis

2022-05-09 · Zhenzi Weng, Zhijin Qin, Xiaoming Tao, Chengkang Pan 외

In this paper, we develop a deep learning based semantic communication system for speech transmission, named DeepSC-ST. We take the speech recognition and speech synthesis as the transmission tasks of the communication s…

Deep LearningSemantic Communicationspeech-recognitionSpeech Recognition+1

Semantic Communications: Principles and Challenges

2021-12-30 · Zhijin Qin, Xiaoming Tao, Jianhua Lu, Wen Tong 외

Semantic communication, regarded as the breakthrough beyond the Shannon paradigm, aims at the successful transmission of semantic information conveyed by the source rather than the accurate reception of each single symbo…

Semantic Communication