Large Language Model-Based Semantic Communication System for Image Transmission
The remarkable success of Large Language Models (LLMs) in understanding and generating various data types, such as images and text, has demonstrated their ability to process and extract semantic information across diverse domains. This transformative capability lays the foundation for semantic communications, enabling highly efficient and intelligent communication systems. In this work, we present a novel OFDM-based semantic communication framework for image transmission. We propose an innovative semantic encoder design that leverages the ability of LLMs to extract the meaning of transmitted data rather than focusing on its raw representation. On the receiver side, we design an LLM-based semantic decoder capable of comprehending context and generating the most appropriate representation to fit the given context. We evaluate our proposed system under different scenarios, including Urban Macro-cell environments with varying speed ranges. The evaluation metrics demonstrate that our proposed system reduces the data size 4250 times, while achieving a higher data rate compared to conventional communication methods. This approach offers a robust and scalable solution to unlock the full potential of 6G connectivity.
Code (0)
등록된 구현이 없습니다.
Tasks
DecoderIntelligent CommunicationLanguage ModelingLanguage ModellingLarge Language ModelSemantic CommunicationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Semantic Feature Decomposition based Semantic Communication System of Images with Large-scale Visual Generation Models
The end-to-end image communication system has been widely studied in the academic community. The escalating demands on image communication systems in terms of data volume, environmental complexity, and task precision req…
Semantic CommunicationExploring Textual Semantics Diversity for Image Transmission in Semantic Communication Systems using Visual Language Model
In recent years, the rapid development of machine learning has brought reforms and challenges to traditional communication systems. Semantic communication has appeared as an effective strategy to effectively extract rele…
DiversityLanguage ModelingLanguage ModellingSemantic Communication+1Semantic Communication based on Large Language Model for Underwater Image Transmission
Underwater communication is essential for environmental monitoring, marine biology research, and underwater exploration. Traditional underwater communication faces limitations like low bandwidth, high latency, and suscep…
Image ReconstructionLanguage ModelingLanguage ModellingLarge Language Model+2VLF-MSC: Vision-Language Feature-Based Multimodal Semantic Communication System
We propose Vision-Language Feature-based Multimodal Semantic Communication (VLF-MSC), a unified system that transmits a single compact vision-language representation to support both image and text generation at the recei…
Semantic CommunicationText GenerationAddressing Out-of-Distribution Challenges in Image Semantic Communication Systems with Multi-modal Large Language Models
Semantic communication is a promising technology for next-generation wireless networks. However, the out-of-distribution (OOD) problem, where a pre-trained machine learning (ML) model is applied to unseen tasks that are …
Bayesian OptimizationImage ReconstructionSemantic CommunicationSemantic Compression