Multi-agent Attention Actor-Critic Algorithm for Load Balancing in Cellular Networks

2023-03-14 · Jikun Kang, Di wu, Ju Wang, Ekram Hossain, Xue Liu, Gregory Dudek

In cellular networks, User Equipment (UE) handoff from one Base Station (BS) to another, giving rise to the load balancing problem among the BSs. To address this problem, BSs can work collaboratively to deliver a smooth migration (or handoff) and satisfy the UEs' service requirements. This paper formulates the load balancing problem as a Markov game and proposes a Robust Multi-agent Attention Actor-Critic (Robust-MA3C) algorithm that can facilitate collaboration among the BSs (i.e., agents). In particular, to solve the Markov game and find a Nash equilibrium policy, we embrace the idea of adopting a nature agent to model the system uncertainty. Moreover, we utilize the self-attention mechanism, which encourages high-performance BSs to assist low-performance BSs. In addition, we consider two types of schemes, which can facilitate load balancing for both active UEs and idle UEs. We carry out extensive evaluations by simulations, and simulation results illustrate that, compared to the state-of-the-art MARL methods, Robust-\ours~scheme can improve the overall performance by up to 45%.

📄 PDF Abstract BibTeX arXiv:2303.08003

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Golden Queue Managers 설명 없음

BASE 설명 없음

Enhancing Multi-Agent Collaboration with Attention-Based Actor-Critic Policies

2025-07-30 · Hugo Garrido-Lestache Belinchon, Jeremy Kedziora arxiv

This paper introduces Team-Attention-Actor-Critic (TAAC), a reinforcement learning algorithm designed to enhance multi-agent collaboration in cooperative environments. TAAC employs a Centralized Training/Centralized Exec…

Reinforcement Learning

Actor-Attention-Critic for Multi-Agent Reinforcement Learning

2018-10-05 · ICLR 2019 5 · Shariq Iqbal, Fei Sha

Reinforcement learning in multi-agent scenarios is important for real-world applications but presents challenges beyond those seen in single-agent settings. We present an actor-critic algorithm that trains decentralized …

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Attention Actor-Critic algorithm for Multi-Agent Constrained Co-operative Reinforcement Learning

2021-01-07 · P. Parnika, Raghuram Bharadwaj Diddigi, Sai Koti Reddy Danda, Shalabh Bhatnagar

In this work, we consider the problem of computing optimal actions for Reinforcement Learning (RL) agents in a co-operative setting, where the objective is to optimize a common goal. However, in many real-life applicatio…

reinforcement-learning Reinforcement Learning (RL)

SACHA: Soft Actor-Critic with Heuristic-Based Attention for Partially Observable Multi-Agent Path Finding

2023-07-05 · Qiushi Lin, Hang Ma

Multi-Agent Path Finding (MAPF) is a crucial component for many large-scale robotic systems, where agents must plan their collision-free paths to their given goal positions. Recently, multi-agent reinforcement learning h…

Multi-Agent Path Finding Multi-agent Reinforcement Learning

Efficient Policy Generation in Multi-Agent Systems via Hypergraph Neural Network

2022-03-07 · Bin Zhang, Yunpeng Bai, Zhiwei Xu, Dapeng Li 외

The application of deep reinforcement learning in multi-agent systems introduces extra challenges. In a scenario with numerous agents, one of the most important concerns currently being addressed is how to develop suffic…

Decision Making Deep Reinforcement Learning Multi-agent Reinforcement Learning reinforcement-learning+3