paper-with-me

홈 › Papers

Multi-Task Semantic Communications via Large Models

2025-03-28 · Wanli Ni, Zhijin Qin, Haofeng Sun, Xiaoming Tao, Zhu Han

Artificial intelligence (AI) promises to revolutionize the design, optimization and management of next-generation communication systems. In this article, we explore the integration of large AI models (LAMs) into semantic communications (SemCom) by leveraging their multi-modal data processing and generation capabilities. Although LAMs bring unprecedented abilities to extract semantics from raw data, this integration entails multifaceted challenges including high resource demands, model complexity, and the need for adaptability across diverse modalities and tasks. To overcome these challenges, we propose a LAM-based multi-task SemCom (MTSC) architecture, which includes an adaptive model compression strategy and a federated split fine-tuning approach to facilitate the efficient deployment of LAM-based semantic models in resource-limited networks. Furthermore, a retrieval-augmented generation scheme is implemented to synthesize the most recent local and global knowledge bases to enhance the accuracy of semantic extraction and content generation, thereby improving the inference performance. Finally, simulation results demonstrate the efficacy of the proposed LAM-based MTSC architecture, highlighting the performance enhancements across various downstream tasks under varying channel conditions.

📄 PDF Abstract BibTeX arXiv:2503.22064

Code (0)

등록된 구현이 없습니다.

Tasks

Model CompressionRetrieval-augmented Generation

Similar Papers 제목 키워드 기반

Will 6G be Semantic Communications? Opportunities and Challenges from Task Oriented and Secure Communications to Integrated Sensing

2024-01-03 · Yalin E. Sagduyu, Tugba Erpek, Aylin Yener, Sennur Ulukus

This paper explores opportunities and challenges of task (goal)-oriented and semantic communications for next-generation (NextG) communication networks through the integration of multi-task learning. This approach employ…

Federated LearningMulti-Task LearningRobust Design

Is Semantic Communications Secure? A Tale of Multi-Domain Adversarial Attacks

2022-12-20 · Yalin E. Sagduyu, Tugba Erpek, Sennur Ulukus, Aylin Yener

Semantic communications seeks to transfer information from a source while conveying a desired meaning to its destination. We model the transmitter-receiver functionalities as an autoencoder followed by a task classifier …

Decoder

Semantic Importance-Aware Communications with Semantic Correction Using Large Language Models

2024-05-25 · Shuaishuai Guo, Yanhu Wang, Jia Ye, Anbang Zhang 외

Semantic communications, a promising approach for agent-human and agent-agent interactions, typically operate at a feature level, lacking true semantic understanding. This paper explores understanding-level semantic comm…

Language ModelingLanguage ModellingLarge Language Model

Multimodal LLM Integrated Semantic Communications for 6G Immersive Experiences

2025-07-07 · Yusong Zhang, Yuxuan Sun, Lei Guo, Wei Chen 외 arxiv

6G networks promise revolutionary immersive communication experiences including augmented reality (AR), virtual reality (VR), and holographic communications. These applications demand high-dimensional multimodal data tra…

Visual Question AnsweringImage Generation

Towards Intelligent Communications: Large Model Empowered Semantic Communications

2024-02-20 · Huiqiang Xie, Zhijin Qin, Xiaoming Tao, Zhu Han

Deep learning enabled semantic communications have shown great potential to significantly improve transmission efficiency and alleviate spectrum scarcity, by effectively exchanging the semantics behind the data. Recently…

modelSemantic Communication