paper-with-me

홈 › Papers

Position-Aided Semantic Communication for Efficient Image Transmission: Design, Implementation, and Experimental Results

2024-10-24 · Peiwen Jiang, Chao-Kai Wen, Shi Jin, Jun Zhang

Semantic communication, augmented by knowledge bases (KBs), offers substantial reductions in transmission overhead and resilience to errors. However, existing methods predominantly rely on end-to-end training to construct KBs, often failing to fully capitalize on the rich information available at communication devices. Motivated by the growing convergence of sensing and communication, we introduce a novel Position-Aided Semantic Communication (PASC) framework, which integrates localization into semantic transmission. This framework is particularly designed for position-based image communication, such as real-time uploading of outdoor camera-view images. By utilizing the position, the framework retrieves corresponding maps, and then an advanced foundation model (FM)-driven view generator is employed to synthesize images closely resembling the target images. The PASC framework further leverages the FM to fuse the synthesized image with deviations from the real one, enhancing semantic reconstruction. Notably, the framework is highly flexible, capable of adapting to dynamic content and fluctuating channel conditions through a novel FM-based parameter optimization strategy. Additionally, the challenges of real-time deployment are addressed, with the development of a hardware testbed to validate the framework. Simulations and real-world tests demonstrate that the proposed PASC approach not only significantly boosts transmission efficiency, but also remains robust in diverse and evolving transmission scenarios.

📄 PDF Abstract BibTeX arXiv:2410.18364

Code (0)

등록된 구현이 없습니다.

Tasks

PositionSemantic Communication

Similar Papers 제목 키워드 기반

Environment Semantics Aided Wireless Communications: A Case Study of mmWave Beam Prediction and Blockage Prediction

2023-01-14 · Yuwen Yang, Feifei Gao, Xiaoming Tao, Guangyi Liu 외

In this paper, we propose an environment semantics aided wireless communication framework to reduce the transmission latency and improve the transmission reliability, where semantic information is extracted from environm…

Beam Predictionfeature selectionPrediction

Generative AI-aided Joint Training-free Secure Semantic Communications via Multi-modal Prompts

2023-09-05 · Hongyang Du, Guangyuan Liu, Dusit Niyato, Jiayi Zhang 외

Semantic communication (SemCom) holds promise for reducing network resource consumption while achieving the communications goal. However, the computational overheads in jointly training semantic encoders and decoders-and…

Semantic Communication

Image Generation with Supervised Selection Based on Multimodal Features for Semantic Communications

2024-11-26 · Chengyang Liang, Dong Li

Semantic communication (SemCom) has emerged as a promising technique for the next-generation communication systems, in which the generation at the receiver side is allowed with semantic features' recovery. However, the m…

Image GenerationImage ReconstructionSemantic Communication

Semantic Feature Decomposition based Semantic Communication System of Images with Large-scale Visual Generation Models

2024-10-26 · Senran Fan, Zhicheng Bao, Chen Dong, Haotai Liang 외

The end-to-end image communication system has been widely studied in the academic community. The escalating demands on image communication systems in terms of data volume, environmental complexity, and task precision req…

Semantic Communication

Robust Semantic Communications for Speech Transmission

2024-03-08 · Zhenzi Weng, Zhijin Qin

In this paper, we propose a robust semantic communication system for speech transmission, named Ross-S2T, by delivering the essential semantic information. Particularly, we consider the speech-to-text translation (S2TT) …

Generative Adversarial NetworkSemantic CommunicationSpeech-to-TextSpeech-to-Text Translation+1