Mean Field MARL Based Bandwidth Negotiation Method for Massive Devices Spectrum Sharing

2021-04-30 · TianHao Li, Yu Tian, Shuai Yuan, Naijin Liu

In this paper, a novel bandwidth negotiation mechanism is proposed for massive devices wireless spectrum sharing, in which individual device locally negotiates bandwidth usage with neighbor devices and globally optimal spectrum utilization is achieved through distributed decision-making. Since only sparse feedback is needed, the proposed mechanism can greatly reduce the signaling overhead. In order to solve the distributed optimization problem when massive devices coexist, mean field multi-agent reinforcement learning (MF-MARL) based bandwidth decision algorithm is proposed, which allow device make globally optimal decision leveraging only neighborhood observation. In simulation, distributed bandwidth negotiation between 1000 devices is demonstrated and the spectrum utilization rate is above 95%. The proposed method is beneficial to reduce spectrum conflicts, increase spectrum utilization for massive devices spectrum sharing.

📄 PDF Abstract BibTeX arXiv:2104.15085

Code (0)

등록된 구현이 없습니다.

Tasks

Decision Making Distributed Optimization Multi-agent Reinforcement Learning Reinforcement Learning (RL)

Breaking the Curse of Many Agents: Provable Mean Embedding Q-Iteration for Mean-Field Reinforcement Learning

2020-06-21 · Lingxiao Wang, Zhuoran Yang, Zhaoran Wang

Multi-agent reinforcement learning (MARL) achieves significant empirical successes. However, MARL suffers from the curse of many agents. In this paper, we exploit the symmetry of agents in MARL. In the most generic form,…

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning (RL)

Breaking the Curse of Many Agents: Provable Mean Embedding $Q$-Iteration for Mean-Field Reinforcement Learning

2020-01-01 · ICML 2020 1 · Lingxiao Wang, Zhuoran Yang, Zhaoran Wang

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning (RL)

A Benchmark for Multi-Party Negotiation Games from Real Negotiation Data

2026-03-14 · Leo Benac, Jonas Raedler, Zilin Ma, Finale Doshi-Velez arxiv

Many real-world multi-party negotiations unfold as sequences of binding, action-level commitments rather than a single final outcome, yet this regime remains under-studied in existing benchmarks. We introduce a benchmark…

Major-Minor Mean Field Multi-Agent Reinforcement Learning

2023-03-19 · Kai Cui, Christian Fabian, Anam Tahir, Heinz Koeppl

Multi-agent reinforcement learning (MARL) remains difficult to scale to many agents. Recent MARL using Mean Field Control (MFC) provides a tractable and rigorous approach to otherwise difficult cooperative MARL. However,…

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning

Multi-agent Reinforcement Learning with Sparse Interactions by Negotiation and Knowledge Transfer

2015-08-21 · Luowei Zhou, Pei Yang, Chunlin Chen, Yang Gao

Reinforcement learning has significant applications for multi-agent systems, especially in unknown dynamic environments. However, most multi-agent reinforcement learning (MARL) algorithms suffer from such problems as exp…

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+1