Towards Multi-agent Reinforcement Learning for Wireless Network Protocol Synthesis

2021-02-02 · Hrishikesh Dutta, Subir Biswas

This paper proposes a multi-agent reinforcement learning based medium access framework for wireless networks. The access problem is formulated as a Markov Decision Process (MDP), and solved using reinforcement learning with every network node acting as a distributed learning agent. The solution components are developed step by step, starting from a single-node access scenario in which a node agent incrementally learns to control MAC layer packet loads for reining in self-collisions. The strategy is then scaled up for multi-node fully-connected scenarios by using more elaborate reward structures. It also demonstrates preliminary feasibility for more general partially connected topologies. It is shown that by learning to adjust MAC layer transmission probabilities, the protocol is not only able to attain theoretical maximum throughput at an optimal load, but unlike classical approaches, it can also retain that maximum throughput at higher loading conditions. Additionally, the mechanism is agnostic to heterogeneous loading while preserving that feature. It is also shown that access priorities of the protocol across nodes can be parametrically adjusted. Finally, it is also shown that the online learning feature of reinforcement learning is able to make the protocol adapt to time-varying loading conditions.

📄 PDF Abstract BibTeX arXiv:2102.01611

Code (0)

등록된 구현이 없습니다.

Tasks

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Wireless MAC Protocol Synthesis and Optimization with Multi-Agent Distributed Reinforcement Learning

2024-08-12 · Navid Keshtiarast, Oliver Renaldi, Marina Petrova

In this letter, we propose a novel Multi-Agent Deep Reinforcement Learning (MADRL) framework for Medium Access Control (MAC) protocol design. Unlike centralized approaches, which rely on a single entity for decision-maki…

Decision Making Deep Reinforcement Learning rllib

Medium Access using Distributed Reinforcement Learning for IoTs with Low-Complexity Wireless Transceivers

2021-04-29 · Hrishikesh Dutta, Subir Biswas

This paper proposes a distributed Reinforcement Learning (RL) based framework that can be used for synthesizing MAC layer wireless protocols in IoT networks with low-complexity wireless transceivers. The proposed framewo…

reinforcement-learning Reinforcement Learning (RL)

Reinforcement Learning for Protocol Synthesis in Resource-Constrained Wireless Sensor and IoT Networks

2023-01-14 · Hrishikesh Dutta, Amit Kumar Bhuyan, Subir Biswas

This article explores the concepts of online protocol synthesis using Reinforcement Learning (RL). The study is performed in the context of sensor and IoT networks with ultra low complexity wireless transceivers. The pap…

Fairness reinforcement-learning Reinforcement Learning (RL)

The Emergence of Wireless MAC Protocols with Multi-Agent Reinforcement Learning

2021-08-16 · Mateus P. Mota, Alvaro Valcarce, Jean-Marie Gorce, Jakob Hoydis

In this paper, we propose a new framework, exploiting the multi-agent deep deterministic policy gradient (MADDPG) algorithm, to enable a base station (BS) and user equipment (UE) to come up with a medium access control (…

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning (RL)

Emergent Communication in Multi-Agent Reinforcement Learning for Future Wireless Networks

2023-09-12 · Marwa Chafii, Salmane Naoumi, REDA ALAMI, Ebtesam Almazrouei 외

In different wireless network scenarios, multiple network entities need to cooperate in order to achieve a common task with minimum delay and energy consumption. Future wireless networks mandate exchanging high dimension…

Autonomous Driving continuous-control Continuous Control Decision Making+3