MOC-RVQ: Multilevel Codebook-Assisted Digital Generative Semantic Communication
Vector quantization-based image semantic communication systems have successfully boosted transmission efficiency, but face challenges with conflicting requirements between codebook design and digital constellation modulation. Traditional codebooks need wide index ranges, while modulation favors few discrete states. To address this, we propose a multilevel generative semantic communication system with a two-stage training framework. In the first stage, we train a high-quality codebook, using a multi-head octonary codebook (MOC) to compress the index range. In addition, a residual vector quantization (RVQ) mechanism is also integrated for effective multilevel communication. In the second stage, a noise reduction block (NRB) based on Swin Transformer is introduced, coupled with the multilevel codebook from the first stage, serving as a high-quality semantic knowledge base (SKB) for generative feature restoration. Finally, to simulate modern image transmission scenarios, we employ a diverse collection of high-resolution 2K images as the test set. The experimental results consistently demonstrate the superior performance of MOC-RVQ over conventional methods such as BPG or JPEG. Additionally, MOC-RVQ achieves comparable performance to an analog JSCC scheme, while needing only one-sixth of the channel bandwidth ratio (CBR) and being directly compatible with digital transmission systems.
Code (1)
Tasks
2kQuantizationSemantic CommunicationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Codebook-enabled Generative End-to-end Semantic Communication Powered by Transformer
Codebook-based generative semantic communication attracts increasing attention, since only indices are required to be transmitted when the codebook is shared between transmitter and receiver. However, due to the fact tha…
Image GenerationSemantic CommunicationLow-Rate Semantic Communication with Codebook-based Conditional Generative Models
Generative semantic communication models are reshaping semantic communication frameworks by moving beyond pixel-wise optimization to align with human perception. However, many existing approaches prioritize image-level p…
Saliency DetectionSemantic CommunicationESC-MVQ: End-to-End Semantic Communication With Multi-Codebook Vector Quantization
This paper proposes a novel end-to-end digital semantic communication framework based on multi-codebook vector quantization (VQ), referred to as ESC-MVQ. Unlike prior approaches that rely on end-to-end training with a sp…
DecoderQuantizationSemantic CommunicationOptimal Spatial Signal Design for mmWave Positioning under Imperfect Synchronization
We consider the problem of spatial signal design for multipath-assisted mmWave positioning under limited prior knowledge on the user's location and clock bias. We propose an optimal robust design and, based on the low-di…
PositionRobust DesignChannel-Aware Vector Quantization for Robust Semantic Communication on Discrete Channels
Deep learning-based semantic communication has largely relied on analog or semi-digital transmission, which limits compatibility with modern digital communication infrastructures. Recent studies have employed vector quan…
Semantic Communication