paper-with-me

홈 › Papers

Rate-Adaptive Generative Semantic Communication Using Conditional Diffusion Models

2024-09-04 · Pujing Yang, Guangyi Zhang, Yunlong Cai

Recent advances in deep learning-based joint source-channel coding (DJSCC) have shown promise for end-to-end semantic image transmission. However, most existing schemes primarily focus on optimizing pixel-wise metrics, which often fail to align with human perception, leading to lower perceptual quality. In this letter, we propose a novel generative DJSCC approach using conditional diffusion models to enhance the perceptual quality of transmitted images. Specifically, by utilizing entropy models, we effectively manage transmission bandwidth based on the estimated entropy of transmitted sym-bols. These symbols are then used at the receiver as conditional information to guide a conditional diffusion decoder in image reconstruction. Our model is built upon the emerging advanced mamba-like linear attention (MLLA) skeleton, which excels in image processing tasks while also offering fast inference speed. Besides, we introduce a multi-stage training strategy to ensure the stability and improve the overall performance of the model. Simulation results demonstrate that our proposed method significantly outperforms existing approaches in terms of perceptual quality.

📄 PDF Abstract BibTeX arXiv:2409.02597

Code (0)

등록된 구현이 없습니다.

Tasks

DecoderImage ReconstructionMambaSemantic Communication

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음
Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…
Focus 설명 없음
ALIGN In the ALIGN method, visual and language representations are jointly trained from noisy image alt-text data. The image and text encoders are learned via contrastive loss…

Similar Papers 제목 키워드 기반

FAST-GSC: Fast and Adaptive Semantic Transmission for Generative Semantic Communication

2024-07-22 · Yiru Wang, Wanting Yang, Zehui Xiong, Yuping Zhao 외

The rapidly evolving field of generative artificial intelligence technology has introduced innovative approaches for developing semantic communication (SemCom) frameworks, leading to the emergence of a new paradigm-gener…

DenoisingSemantic Communication

Large Generative Model Assisted 3D Semantic Communication

2024-03-09 · Feibo Jiang, Yubo Peng, Li Dong, Kezhi Wang 외

Semantic Communication (SC) is a novel paradigm for data transmission in 6G. However, there are several challenges posed when performing SC in 3D scenarios: 1) 3D semantic extraction; 2) Latent semantic redundancy; and 3…

Generative Adversarial NetworkmodelNeRFSemantic Communication+1

Low-Rate Semantic Communication with Codebook-based Conditional Generative Models

2025-04-07 · Kailang Ye, Mingze Gong, Shuoyao Wang, Daquan Feng

Generative semantic communication models are reshaping semantic communication frameworks by moving beyond pixel-wise optimization to align with human perception. However, many existing approaches prioritize image-level p…

Saliency DetectionSemantic Communication

Generative AI Meets 6G and Beyond: Diffusion Models for Semantic Communications

2025-11-11 · Hai-Long Qin, Jincheng Dai, Guo Lu, Shuo Shao 외 arxiv

Semantic communications mark a paradigm shift from bit-accurate transmission toward meaning-centric communication, essential as wireless systems approach theoretical capacity limits. The emergence of generative AI has ca…

Domain Adaptation

Generative AI Driven Task-Oriented Adaptive Semantic Communications

2024-07-16 · Yuzhou Fu, Wenchi Cheng, Jingqing Wang, Liuguo Yin 외

Task-Oriented Semantic Communication (TOSC) has been regarded as a promising communication framework, serving for various Artificial Intelligence (AI) task driven applications. The existing TOSC frameworks focus on extra…

Instance Segmentationobject-detectionObject DetectionSemantic Communication+1