An Offline Multi-Agent Reinforcement Learning Framework for Radio Resource Management

2025-01-22 · Eslam Eldeeb, Hirley Alves

Offline multi-agent reinforcement learning (MARL) addresses key limitations of online MARL, such as safety concerns, expensive data collection, extended training intervals, and high signaling overhead caused by online interactions with the environment. In this work, we propose an offline MARL algorithm for radio resource management (RRM), focusing on optimizing scheduling policies for multiple access points (APs) to jointly maximize the sum and tail rates of user equipment (UEs). We evaluate three training paradigms: centralized, independent, and centralized training with decentralized execution (CTDE). Our simulation results demonstrate that the proposed offline MARL framework outperforms conventional baseline approaches, achieving over a 15\% improvement in a weighted combination of sum and tail rates. Additionally, the CTDE framework strikes an effective balance, reducing the computational complexity of centralized methods while addressing the inefficiencies of independent training. These results underscore the potential of offline MARL to deliver scalable, robust, and efficient solutions for resource management in dynamic wireless networks.

📄 PDF Abstract BibTeX arXiv:2501.12991

Code (0)

등록된 구현이 없습니다.

Tasks

Management Multi-agent Reinforcement LearningScheduling

FORLORN: A Framework for Comparing Offline Methods and Reinforcement Learning for Optimization of RAN Parameters

2022-09-08 · Vegard Edvardsen, Gard Spreemann, Jeriek Van den Abeele

The growing complexity and capacity demands for mobile networks necessitate innovative techniques for optimizing resource usage. Meanwhile, recent breakthroughs have brought Reinforcement Learning (RL) into the domain of…

Benchmarking continuous-control Continuous Control Reinforcement Learning (RL)

Smart Scheduling based on Deep Reinforcement Learning for Cellular Networks

2021-03-22 · Jian Wang, Chen Xu, Rong Li, Yiqun Ge 외

To improve the system performance towards the Shannon limit, advanced radio resource management mechanisms play a fundamental role. In particular, scheduling should receive much attention, because it allocates radio reso…

Deep Reinforcement Learning Fairness Management reinforcement-learning+3

Offline Multi-Agent Reinforcement Learning with Implicit Global-to-Local Value Regularization

2023-07-21 · NeurIPS 2023 11 · Xiangsen Wang, Haoran Xu, Yinan Zheng, Xianyuan Zhan

Offline reinforcement learning (RL) has received considerable attention in recent years due to its attractive capability of learning policies from offline datasets without environmental interactions. Despite some success…

Management MuJoCo Multi-agent Reinforcement Learning Reinforcement Learning (RL)+2

Offline Decentralized Multi-Agent Reinforcement Learning

2021-08-04 · Jiechuan Jiang, Zongqing Lu

In many real-world multi-agent cooperative tasks, due to high cost and risk, agents cannot continuously interact with the environment and collect experiences during learning, but have to learn from offline datasets. Howe…

Multi-agent Reinforcement Learning Q-Learning reinforcement-learning Reinforcement Learning+1

Offline-to-Online Multi-Agent Reinforcement Learning with Offline Value Function Memory and Sequential Exploration

2024-10-25 · Hai Zhong, Xun Wang, Zhuoran Li, Longbo Huang

Offline-to-Online Reinforcement Learning has emerged as a powerful paradigm, leveraging offline data for initialization and online fine-tuning to enhance both sample efficiency and performance. However, most existing res…

Efficient Exploration Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning+3