paper-with-me

Papers

LLM4WM: Adapting LLM for Wireless Multi-Tasking

2025-01-22 · Xuanyu Liu, Shijian Gao, Boxun Liu, Xiang Cheng, Liuqing Yang

The wireless channel is fundamental to communication, encompassing numerous tasks collectively referred to as channel-associated tasks. These tasks can leverage joint learning based on channel characteristics to share representations and enhance system design. To capitalize on this advantage, LLM4WM is proposed--a large language model (LLM) multi-task fine-tuning framework specifically tailored for channel-associated tasks. This framework utilizes a Mixture of Experts with Low-Rank Adaptation (MoE-LoRA) approach for multi-task fine-tuning, enabling the transfer of the pre-trained LLM's general knowledge to these tasks. Given the unique characteristics of wireless channel data, preprocessing modules, adapter modules, and multi-task output layers are designed to align the channel data with the LLM's semantic feature space. Experiments on a channel-associated multi-task dataset demonstrate that LLM4WM outperforms existing methodologies in both full-sample and few-shot evaluations, owing to its robust multi-task joint modeling and transfer learning capabilities.

📄 PDF Abstract BibTeX arXiv:2501.12983

Code (0)

등록된 구현이 없습니다.

Tasks

General KnowledgeLanguage ModelingLanguage ModellingLarge Language ModelMixture-of-ExpertsTransfer Learning

Methods 이 논문이 사용한 방법론

ALIGN In the ALIGN method, visual and language representations are jointly trained from noisy image alt-text data. The image and text encoders are learned via contrastive loss…
Adapter 설명 없음

Similar Papers 제목 키워드 기반

SCoTT: Strategic Chain-of-Thought Tasking for Wireless-Aware Robot Navigation in Digital Twins

2024-11-27 · Aladin Djuhera, Amin Seffo, Vlad C. Andrei, Holger Boche 외

Path planning under wireless performance constraints is a complex challenge in robot navigation. However, naively incorporating such constraints into classical planning algorithms often incurs prohibitive search costs. I…

Robot Navigation

Semantic Communication for Cooperative Multi-Tasking over Rate-Limited Wireless Channels with Implicit Optimal Prior

2025-06-10 · Ahmad Halimi Razlighi, Carsten Bockelmann, Armin Dekorsy

In this work, we expand the cooperative multi-task semantic communication framework (CMT-SemCom) introduced in [1], which divides the semantic encoder on the transmitter side into a common unit (CU) and multiple specific…

Semantic Communication

AI for CSI Prediction in 5G-Advanced and Beyond

2025-04-17 · Chengyong Jiang, Jiajia Guo, Xiangyi Li, Shi Jin 외

Artificial intelligence (AI) is pivotal in advancing fifth-generation (5G)-Advanced and sixth-generation systems, capturing substantial research interest. Both the 3rd Generation Partnership Project (3GPP) and leading co…

ManagementPrediction

CompositeTasking: Understanding Images by Spatial Composition of Tasks

2020-12-16 · CVPR 2021 1 · Nikola Popovic, Danda Pani Paudel, Thomas Probst, Guolei Sun 외

We define the concept of CompositeTasking as the fusion of multiple, spatially distributed tasks, for various aspects of image understanding. Learning to perform spatially distributed tasks is motivated by the frequent a…

Decoder

Business Process Simulation: Probabilistic Modeling of Intermittent Resource Availability and Multitasking Behavior

2024-10-22 · Orlenys López-Pintado, Marlon Dumas

In business process simulation, resource availability is typically modeled by assigning a calendar to each resource, e.g., Monday-Friday, 9:00-18:00. Resources are assumed to be always available during each time slot in …