paper-with-me

Papers

LLM4CP: Adapting Large Language Models for Channel Prediction

2024-06-20 · Boxun Liu, Xuanyu Liu, Shijian Gao, Xiang Cheng, Liuqing Yang

Channel prediction is an effective approach for reducing the feedback or estimation overhead in massive multi-input multi-output (m-MIMO) systems. However, existing channel prediction methods lack precision due to model mismatch errors or network generalization issues. Large language models (LLMs) have demonstrated powerful modeling and generalization abilities, and have been successfully applied to cross-modal tasks, including the time series analysis. Leveraging the expressive power of LLMs, we propose a pre-trained LLM-empowered channel prediction method (LLM4CP) to predict the future downlink channel state information (CSI) sequence based on the historical uplink CSI sequence. We fine-tune the network while freezing most of the parameters of the pre-trained LLM for better cross-modality knowledge transfer. To bridge the gap between the channel data and the feature space of the LLM, preprocessor, embedding, and output modules are specifically tailored by taking into account unique channel characteristics. Simulations validate that the proposed method achieves SOTA prediction performance on full-sample, few-shot, and generalization tests with low training and inference costs.

📄 PDF Abstract BibTeX arXiv:2406.14440

Code (1)

liuboxun/LLM4CP 공식 구현 pytorch

Tasks

PredictionTime Series AnalysisTransfer Learning

Similar Papers 제목 키워드 기반

Prompt-Guided Turn-Taking Prediction

2025-06-26 · Koji Inoue, Mikey Elmers, Yahui Fu, Zi Haur Pang 외

Turn-taking prediction models are essential components in spoken dialogue systems and conversational robots. Recent approaches leverage transformer-based architectures to predict speech activity continuously and in real-…

Language ModelingLanguage ModellingLarge Language ModelPrediction+1

IMTS is Worth Time $\times$ Channel Patches: Visual Masked Autoencoders for Irregular Multivariate Time Series Prediction

2025-05-28 · Zhangyi Hu, Jiemin Wu, Hua Xu, Mingqian Liao 외

Irregular Multivariate Time Series (IMTS) forecasting is challenging due to the unaligned nature of multi-channel signals and the prevalence of extensive missing data. Existing methods struggle to capture reliable tempor…

Missing ValuesSelf-Supervised LearningTime SeriesTime Series Prediction

LLM4WM: Adapting LLM for Wireless Multi-Tasking

2025-01-22 · Xuanyu Liu, Shijian Gao, Boxun Liu, Xiang Cheng 외

The wireless channel is fundamental to communication, encompassing numerous tasks collectively referred to as channel-associated tasks. These tasks can leverage joint learning based on channel characteristics to share re…

General KnowledgeLanguage ModelingLanguage ModellingLarge Language Model+2

PAVE: Patching and Adapting Video Large Language Models

2025-03-25 · CVPR 2025 1 · Zhuoming Liu, Yiquan Li, Khoi Duc Nguyen, Yiwu Zhong 외

Pre-trained video large language models (Video LLMs) exhibit remarkable reasoning capabilities, yet adapting these models to new tasks involving additional modalities or data types (e.g., audio or 3D information) remains…

Audio-visual Question AnsweringMulti-Task LearningQuestion AnsweringVideo Recognition+2

Fast and Sample-Efficient Domain Adaptation for Autoencoder-Based End-to-End Communication

2021-09-29 · Jayaram Raghuram, Yijing Zeng, Dolores Garcia, Somesh Jha 외

The problem of domain adaptation conventionally considers the setting where a source domain has plenty of labeled data, and a target domain (with a different data distribution) has plenty of unlabeled data but none or ve…

DecoderDomain Adaptation