paper-with-me

홈 › Papers

A Wireless Foundation Model for Multi-Task Prediction

2025-07-08 · Yucheng Sheng, Jiacheng Wang, Xingyu Zhou, Le Liang, Hao Ye, Shi Jin, Geoffrey Ye Li

With the growing complexity and dynamics of the mobile communication networks, accurately predicting key system parameters, such as channel state information (CSI), user location, and network traffic, has become essential for a wide range of physical (PHY)-layer and medium access control (MAC)-layer tasks. Although traditional deep learning (DL)-based methods have been widely applied to such prediction tasks, they often struggle to generalize across different scenarios and tasks. In response, we propose a unified foundation model for multi-task prediction in wireless networks that supports diverse prediction intervals. The proposed model enforces univariate decomposition to unify heterogeneous tasks, encodes granularity for interval awareness, and uses a causal Transformer backbone for accurate predictions. Additionally, we introduce a patch masking strategy during training to support arbitrary input lengths. After trained on large-scale datasets, the proposed foundation model demonstrates strong generalization to unseen scenarios and achieves zero-shot performance on new tasks that surpass traditional full-shot baselines.

📄 PDF Abstract BibTeX arXiv:2507.05938

Code (0)

등록된 구현이 없습니다.

Tasks

modelPredictionPrediction Intervals

Methods 이 논문이 사용한 방법론

Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Transformer A Transformer is a model architecture that eschews recurrence and instead relies entirely on an [attention…

Similar Papers 제목 키워드 기반

Multi-Modal Data-Enhanced Foundation Models for Prediction and Control in Wireless Networks: A Survey

2026-01-06 · Han Zhang, Mohammad Farzanullah, Mohammad Ghassemi, Akram Bin Sediq 외 arxiv

Foundation models (FMs) are recognized as a transformative breakthrough that has started to reshape the future of artificial intelligence (AI) across both academia and industry. The integration of FMs into wireless netwo…

WALoMA: A Multitask Wireless Foundation Model via Adaptive Low-Rank Masked Autoencoders

2026-07-28 · Madi Makin, Asmaa Abdallah, Abdulkadir Celik, Ahmed M. Eltawil arxiv

This paper proposes a multitask wireless foundation model via adaptive low-rank masked autoencoders (WALoMA), a unified multi-task foundation model for sixth-generation (6G) wireless physical layer architectures, to addr…

parameter-efficient fine-tuningBeam Prediction

LatentWave: JEPA Pretraining for Wireless Foundation Models

2026-06-04 · Ahmed Mohamed, Ahmed Aboulfotouh, Hatem Abou-Zeid arxiv

Wireless foundation models have emerged as a promising alternative to building separate models for each wireless task. However, existing approaches rely on masked input reconstruction, which can bias representations towa…

Beam Prediction

WiFo: Wireless Foundation Model for Channel Prediction

2024-12-12 · Boxun Liu, Shijian Gao, Xuanyu Liu, Xiang Cheng 외

Channel prediction permits to acquire channel state information (CSI) without signaling overhead. However, almost all existing channel prediction methods necessitate the deployment of a dedicated model to accommodate a s…

modelMulti-Task LearningPredictionZero-shot Generalization

IQFM A Wireless Foundational Model for I/Q Streams in AI-Native 6G

2025-06-07 · Omar Mashaal, Hatem Abou-zeid

Foundational models have shown remarkable potential in natural language processing and computer vision, yet remain in their infancy in wireless communications. While a few efforts have explored image-based modalities suc…

Beam PredictionMulti-Task LearningSelf-Supervised Learning