Position-Aided Semantic Communication for Efficient Image Transmission: Design, Implementation, and Experimental Results
Semantic communication, augmented by knowledge bases (KBs), offers substantial reductions in transmission overhead and resilience to errors. However, existing methods predominantly rely on end-to-end training to construct KBs, often failing to fully capitalize on the rich information available at communication devices. Motivated by the growing convergence of sensing and communication, we introduce a novel Position-Aided Semantic Communication (PASC) framework, which integrates localization into semantic transmission. This framework is particularly designed for position-based image communication, such as real-time uploading of outdoor camera-view images. By utilizing the position, the framework retrieves corresponding maps, and then an advanced foundation model (FM)-driven view generator is employed to synthesize images closely resembling the target images. The PASC framework further leverages the FM to fuse the synthesized image with deviations from the real one, enhancing semantic reconstruction. Notably, the framework is highly flexible, capable of adapting to dynamic content and fluctuating channel conditions through a novel FM-based parameter optimization strategy. Additionally, the challenges of real-time deployment are addressed, with the development of a hardware testbed to validate the framework. Simulations and real-world tests demonstrate that the proposed PASC approach not only significantly boosts transmission efficiency, but also remains robust in diverse and evolving transmission scenarios.
Code (0)
등록된 구현이 없습니다.
Tasks
PositionSemantic CommunicationSimilar Papers 제목 키워드 기반
Environment Semantics Aided Wireless Communications: A Case Study of mmWave Beam Prediction and Blockage Prediction
In this paper, we propose an environment semantics aided wireless communication framework to reduce the transmission latency and improve the transmission reliability, where semantic information is extracted from environm…
Beam Predictionfeature selectionPredictionGenerative AI-aided Joint Training-free Secure Semantic Communications via Multi-modal Prompts
Semantic communication (SemCom) holds promise for reducing network resource consumption while achieving the communications goal. However, the computational overheads in jointly training semantic encoders and decoders-and…
Semantic CommunicationImage Generation with Supervised Selection Based on Multimodal Features for Semantic Communications
Semantic communication (SemCom) has emerged as a promising technique for the next-generation communication systems, in which the generation at the receiver side is allowed with semantic features' recovery. However, the m…
Image GenerationImage ReconstructionSemantic CommunicationSemantic Feature Decomposition based Semantic Communication System of Images with Large-scale Visual Generation Models
The end-to-end image communication system has been widely studied in the academic community. The escalating demands on image communication systems in terms of data volume, environmental complexity, and task precision req…
Semantic CommunicationRobust Semantic Communications for Speech Transmission
In this paper, we propose a robust semantic communication system for speech transmission, named Ross-S2T, by delivering the essential semantic information. Particularly, we consider the speech-to-text translation (S2TT) …
Generative Adversarial NetworkSemantic CommunicationSpeech-to-TextSpeech-to-Text Translation+1