paper-with-me

홈 › Papers

Large AI Model-Based Semantic Communications

2023-07-07 · Feibo Jiang, Yubo Peng, Li Dong, Kezhi Wang, Kun Yang, Cunhua Pan, Xiaohu You

Semantic communication (SC) is an emerging intelligent paradigm, offering solutions for various future applications like metaverse, mixed reality, and the Internet of Everything. However, in current SC systems, the construction of the knowledge base (KB) faces several issues, including limited knowledge representation, frequent knowledge updates, and insecure knowledge sharing. Fortunately, the development of the large AI model (LAM) provides new solutions to overcome the above issues. Here, we propose a LAM-based SC framework (LAM-SC) specifically designed for image data, where we first apply the segment anything model (SAM)-based KB (SKB) that can split the original image into different semantic segments by universal semantic knowledge. Then, we present an attention-based semantic integration (ASI) to weigh the semantic segments generated by SKB without human participation and integrate them as the semantic aware image. Additionally, we propose an adaptive semantic compression (ASC) encoding to remove redundant information in semantic features, thereby reducing communication overhead. Finally, through simulations, we demonstrate the effectiveness of the LAM-SC framework and the possibility of applying the LAM-based KB in future SC paradigms.

📄 PDF Abstract BibTeX arXiv:2307.03492

Code (0)

등록된 구현이 없습니다.

Tasks

Mixed RealitymodelSemantic CommunicationSemantic Compression

Methods 이 논문이 사용한 방법론

BASE 설명 없음

Similar Papers 제목 키워드 기반

Towards Intelligent Communications: Large Model Empowered Semantic Communications

2024-02-20 · Huiqiang Xie, Zhijin Qin, Xiaoming Tao, Zhu Han

Deep learning enabled semantic communications have shown great potential to significantly improve transmission efficiency and alleviate spectrum scarcity, by effectively exchanging the semantics behind the data. Recently…

modelSemantic Communication

Semantic Importance-Aware Communications with Semantic Correction Using Large Language Models

2024-05-25 · Shuaishuai Guo, Yanhu Wang, Jia Ye, Anbang Zhang 외

Semantic communications, a promising approach for agent-human and agent-agent interactions, typically operate at a feature level, lacking true semantic understanding. This paper explores understanding-level semantic comm…

Language ModelingLanguage ModellingLarge Language Model

Semantic Communications with Discrete-time Analog Transmission: A PAPR Perspective

2022-08-17 · Yulin Shao, Deniz Gunduz

Recent progress in deep learning (DL)-based joint source-channel coding (DeepJSCC) has led to a new paradigm of semantic communications. Two salient features of DeepJSCC-based semantic communications are the exploitation…

Image ReconstructionOpen-Ended Question AnsweringSemantic Communication

Semantic Communications: Principles and Challenges

2021-12-30 · Zhijin Qin, Xiaoming Tao, Jianhua Lu, Wen Tong 외

Semantic communication, regarded as the breakthrough beyond the Shannon paradigm, aims at the successful transmission of semantic information conveyed by the source rather than the accurate reception of each single symbo…

Semantic Communication

Token Communications: A Unified Framework for Cross-modal Context-aware Semantic Communications

2025-02-17 · Li Qiao, Mahdi Boloursaz Mashhadi, Zhen Gao, Rahim Tafazolli 외

In this paper, we introduce token communications (TokCom), a large model-driven framework to leverage cross-modal context information in generative semantic communications (GenSC). TokCom is a new paradigm, motivated by …

Semantic Communication