Multi-Agent Reinforcement Learning for Network Load Balancing in Data Center

2022-01-27 · Zhiyuan Yao, Zihan Ding, Thomas Clausen

This paper presents the network load balancing problem, a challenging real-world task for multi-agent reinforcement learning (MARL) methods. Traditional heuristic solutions like Weighted-Cost Multi-Path (WCMP) and Local Shortest Queue (LSQ) are less flexible to the changing workload distributions and arrival rates, with a poor balance among multiple load balancers. The cooperative network load balancing task is formulated as a Dec-POMDP problem, which naturally induces the MARL methods. To bridge the reality gap for applying learning-based methods, all methods are directly trained and evaluated on an emulation system from moderate-to large-scale. Experiments on realistic testbeds show that the independent and "selfish" load balancing strategies are not necessarily the globally optimal ones, while the proposed MARL solution has a superior performance over different realistic settings. Additionally, the potential difficulties of MARL methods for network load balancing are analysed, which helps to draw the attention of the learning and network communities to such challenges.

📄 PDF Abstract BibTeX arXiv:2201.11727

Code (0)

등록된 구현이 없습니다.

Tasks

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning (RL)

Sparse Mean Field Load Balancing in Large Localized Queueing Systems

2023-12-20 · Anam Tahir, Kai Cui, Heinz Koeppl

Scalable load balancing algorithms are of great interest in cloud networks and data centers, necessitating the use of tractable techniques to compute optimal load balancing policies for good performance. However, most ex…

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning

Learning Distributed and Fair Policies for Network Load Balancing as Markov Potential Game

2022-06-03 · Zhiyuan Yao, Zihan Ding

This paper investigates the network load balancing problem in data centers (DCs) where multiple load balancers (LBs) are deployed, using the multi-agent reinforcement learning (MARL) framework. The challenges of this pro…

Fairness Management Multi-agent Reinforcement Learning

Fully Distributed Fog Load Balancing with Multi-Agent Reinforcement Learning

2024-05-15 · Maad Ebrahim, Abdelhakim Hafid

Real-time Internet of Things (IoT) applications require real-time support to handle the ever-growing demand for computing resources to process IoT workloads. Fog Computing provides high availability of such resources in …

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning Transfer Learning

Interpretable Reinforcement Learning for Load Balancing using Kolmogorov-Arnold Networks

2025-05-20 · Kamal Singh, Sami Marouani, Ahmad Al Sheikh, Pham Tran Anh Quang 외

Reinforcement learning (RL) has been increasingly applied to network control problems, such as load balancing. However, existing RL approaches often suffer from lack of interpretability and difficulty in extracting contr…

Decision Making Kolmogorov-Arnold Networks reinforcement-learning Reinforcement Learning+1

Dynamic Load Balancing for EV Charging Stations Using Reinforcement Learning and Demand Prediction

2025-03-09 · Hesam Mosalli, Saba Sanami, Yu Yang, Hen-Geul Yeh 외

This paper presents a method for load balancing and dynamic pricing in electric vehicle (EV) charging networks, utilizing reinforcement learning (RL) to enhance network performance. The proposed framework integrates a pr…

Graph Neural Network Reinforcement Learning (RL)