MACC: Cross-Layer Multi-Agent Congestion Control with Deep Reinforcement Learning

2022-06-04 · Jianing Bai, Tianhao Zhang, Guangming Xie

Congestion Control (CC), as the core networking task to efficiently utilize network capacity, received great attention and widely used in various Internet communication applications such as 5G, Internet-of-Things, UAN, and more. Various CC algorithms have been proposed both on network and transport layers such as Active Queue Management (AQM) algorithm and Transmission Control Protocol (TCP) congestion control mechanism. But it is hard to model dynamic AQM/TCP system and cooperate two algorithms to obtain excellent performance under different communication scenarios. In this paper, we explore the performance of multi-agent reinforcement learning-based cross-layer congestion control algorithms and present cooperation performance of two agents, known as MACC (Multi-agent Congestion Control). We implement MACC in NS3. The simulation results show that our scheme outperforms other congestion control combination in terms of throughput and delay, etc. Not only does it proves that networking protocols based on multi-agent deep reinforcement learning is efficient for communication managing, but also verifies that networking area can be used as new playground for machine learning algorithms.

📄 PDF Abstract BibTeX arXiv:2206.01972

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement LearningManagement Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Multi-Agent Congestion Cost Minimization With Linear Function Approximations

2023-01-26 · Prashant Trivedi, Nandyala Hemachandra

This work considers multiple agents traversing a network from a source node to the goal node. The cost to an agent for traveling a link has a private as well as a congestion component. The agent's objective is to find a …

Multi-agent Reinforcement Learning

MACCA: Offline Multi-agent Reinforcement Learning with Causal Credit Assignment

2023-12-06 · Ziyan Wang, Yali Du, Yudi Zhang, Meng Fang 외

Offline Multi-agent Reinforcement Learning (MARL) is valuable in scenarios where online interaction is impractical or risky. While independent learning in MARL offers flexibility and scalability, accurately assigning cre…

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning

A collaboration of multi-agent model using an interactive interface

2022-09-01 · journal 2022 9 · Jingchen Li, Fan Wu, Haobin Shi, Kao-Shing Hwang

Multi-agent reinforcement learning algorithms scarcely attend to noisy environments, in which agents are inhibited from achieving optimal policy training and making correct decisions. This work investigates the effect of…

Multi-agent Reinforcement Learning

MACC: Multi-Agent Collaborative Competition for Scientific Exploration

2026-03-04 · Satoshi Oyama, Yuko Sakurai, Hisashi Kashima arxiv

Scientific discovery still relies heavily on the manual efforts of individual researchers, leading to limited exploration, redundant trials, and reduced reproducibility. Human-participant data analysis competitions gener…

Learning to Communicate Using Counterfactual Reasoning

2020-06-12 · Simon Vanneste, Astrid Vanneste, Kevin Mets, Tom De Schepper 외

Learning to communicate in order to share state information is an active problem in the area of multi-agent reinforcement learning (MARL). The credit assignment problem, the non-stationarity of the communication environm…

counterfactual Counterfactual Reasoning Multi-agent Reinforcement Learning valid