paper-with-me

Papers

Codebook-enabled Generative End-to-end Semantic Communication Powered by Transformer

2024-01-22 · PeiGen Ye, Yaping Sun, Shumin Yao, Hao Chen, Xiaodong Xu, Shuguang Cui

Codebook-based generative semantic communication attracts increasing attention, since only indices are required to be transmitted when the codebook is shared between transmitter and receiver. However, due to the fact that the semantic relations among code vectors are not necessarily related to the distance of the corresponding code indices, the performance of the codebook-enabled semantic communication system is susceptible to the channel noise. Thus, how to improve the system robustness against the noise requires careful design. This paper proposes a robust codebook-assisted image semantic communication system, where semantic codec and codebook are first jointly constructed, and then vector-to-index transformer is designed guided by the codebook to eliminate the effects of channel noise, and achieve image generation. Thanks to the assistance of the high-quality codebook to the Transformer, the generated images at the receiver outperform those of the compared methods in terms of visual perception. In the end, numerical results and generated images demonstrate the advantages of the generative semantic communication method over JPEG+LDPC and traditional joint source channel coding (JSCC) methods.

📄 PDF Abstract BibTeX arXiv:2402.16868

Code (0)

등록된 구현이 없습니다.

Tasks

Image GenerationSemantic Communication

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Multi-Head Attention 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…

Similar Papers 제목 키워드 기반

Low-Rate Semantic Communication with Codebook-based Conditional Generative Models

2025-04-07 · Kailang Ye, Mingze Gong, Shuoyao Wang, Daquan Feng

Generative semantic communication models are reshaping semantic communication frameworks by moving beyond pixel-wise optimization to align with human perception. However, many existing approaches prioritize image-level p…

Saliency DetectionSemantic Communication

MOC-RVQ: Multilevel Codebook-Assisted Digital Generative Semantic Communication

2024-01-02 · Yingbin Zhou, Yaping Sun, GuanYing Chen, Xiaodong Xu 외

Vector quantization-based image semantic communication systems have successfully boosted transmission efficiency, but face challenges with conflicting requirements between codebook design and digital constellation modula…

2kQuantizationSemantic Communication

Towards Intelligent Communications: Large Model Empowered Semantic Communications

2024-02-20 · Huiqiang Xie, Zhijin Qin, Xiaoming Tao, Zhu Han

Deep learning enabled semantic communications have shown great potential to significantly improve transmission efficiency and alleviate spectrum scarcity, by effectively exchanging the semantics behind the data. Recently…

modelSemantic Communication

Robust Semantic Communications with Masked VQ-VAE Enabled Codebook

2022-06-08 · Qiyu Hu, Guangyi Zhang, Zhijin Qin, Yunlong Cai 외

Although semantic communications have exhibited satisfactory performance for a large number of tasks, the impact of semantic noise and the robustness of the systems have not been well investigated. Semantic noise refers …

Feature ImportanceSemantic Communication

VQ-DeepISC: Vector Quantized-Enabled Digital Semantic Communication with Channel Adaptive Image Transmission

2025-08-01 · Jianqiao Chen, Tingting Zhu, Huishi Song, Nan Ma 외 arxiv

Discretization of semantic features enables interoperability between semantic and digital communication systems, showing significant potential for practical applications. The fundamental difficulty in digitizing semantic…

Semantic Communication