Semantic Importance-Aware Communications Using Pre-trained Language Models

2023-02-12 · Shuaishuai Guo, Yanhu Wang, Shujing Li, Nasir Saeed

This letter proposes a semantic importance-aware communication (SIAC) scheme using pre-trained language models (e.g., ChatGPT, BERT, etc.). Specifically, we propose a cross-layer design with a pre-trained language model embedded in/connected by the cross-layer manager. The pre-trained language model is utilized to quantify the semantic importance of data frames. Based on the quantified semantic importance, we investigate semantic importance-aware power allocation. Unlike existing deep joint source-channel coding (Deep-JSCC)-based semantic communication schemes, SIAC can be directly embedded into current communication systems by only introducing a cross-layer manager. Our experimental results show that the proposed SIAC scheme can achieve lower semantic loss than existing equal-priority communications.

📄 PDF Abstract BibTeX arXiv:2302.07142

Code (0)

등록된 구현이 없습니다.

Tasks

Language ModelingLanguage Modelling Semantic Communication

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음

Attention 설명 없음

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…

Weight Decay 설명 없음

Adam 설명 없음

Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Semantic Importance-Aware Communications with Semantic Correction Using Large Language Models

2024-05-25 · Shuaishuai Guo, Yanhu Wang, Jia Ye, Anbang Zhang 외

Semantic communications, a promising approach for agent-human and agent-agent interactions, typically operate at a feature level, lacking true semantic understanding. This paper explores understanding-level semantic comm…

Language Modeling Language Modelling Large Language Model

Multimodal LLM Integrated Semantic Communications for 6G Immersive Experiences

2025-07-07 · Yusong Zhang, Yuxuan Sun, Lei Guo, Wei Chen 외 arxiv

6G networks promise revolutionary immersive communication experiences including augmented reality (AR), virtual reality (VR), and holographic communications. These applications demand high-dimensional multimodal data tra…

Visual Question Answering Image Generation

Vision Transformer-based Semantic Communications With Importance-Aware Quantization

2024-12-08 · Joohyuk Park, Yongjeong Oh, Yongjune Kim, Yo-Seb Jeon

Semantic communications provide significant performance gains over traditional communications by transmitting task-relevant semantic features through wireless channels. However, most existing studies rely on end-to-end (…

image-classification Image Classification Image Compression Quantization+1

Will 6G be Semantic Communications? Opportunities and Challenges from Task Oriented and Secure Communications to Integrated Sensing

2024-01-03 · Yalin E. Sagduyu, Tugba Erpek, Aylin Yener, Sennur Ulukus

This paper explores opportunities and challenges of task (goal)-oriented and semantic communications for next-generation (NextG) communication networks through the integration of multi-task learning. This approach employ…

Federated Learning Multi-Task Learning Robust Design

Data-Importance-Aware Power Allocation for Adaptive Real-Time Communication in Computer Vision Applications

2025-04-11 · Chunmei Xu, Yi Ma, Rahim Tafazolli, Jiangzhou Wang

Life-transformative applications such as immersive extended reality are revolutionizing wireless communications and computer vision (CV). This paper presents a novel framework for importance-aware adaptive data transmiss…