Reinforcement Learning for Protocol Synthesis in Resource-Constrained Wireless Sensor and IoT Networks

2023-01-14 · Hrishikesh Dutta, Amit Kumar Bhuyan, Subir Biswas

This article explores the concepts of online protocol synthesis using Reinforcement Learning (RL). The study is performed in the context of sensor and IoT networks with ultra low complexity wireless transceivers. The paper introduces the use of RL and Multi Armed Bandit (MAB), a specific type of RL, for Medium Access Control (MAC) under different network and traffic conditions. It then introduces a novel learning based protocol synthesis framework that addresses specific difficulties and limitations in medium access for both random access and time slotted networks. The mechanism does not rely on carrier sensing, network time-synchronization, collision detection, and other low level complex operations, thus making it ideal for ultra simple transceiver hardware used in resource constrained sensor and IoT networks. Additionally, the ability of independent protocol learning by the nodes makes the system robust and adaptive to the changes in network and traffic conditions. It is shown that the nodes can be trained to learn to avoid collisions, and to achieve network throughputs that are comparable to ALOHA based access protocols in sensor and IoT networks with simplest transceiver hardware. It is also shown that using RL, it is feasible to synthesize access protocols that can sustain network throughput at high traffic loads, which is not feasible in the ALOHA-based systems. The ability of the system to provide throughput fairness under network and traffic heterogeneities are also experimentally demonstrated.

📄 PDF Abstract BibTeX arXiv:2302.05300

Code (0)

등록된 구현이 없습니다.

Tasks

Fairness reinforcement-learning Reinforcement Learning (RL)

Secure Deep Reinforcement Learning for Dynamic Resource Allocation in Wireless MEC Networks

2023-12-13 · Xin Hao, Phee Lep Yeoh, Changyang She, Branka Vucetic 외

This paper proposes a blockchain-secured deep reinforcement learning (BC-DRL) optimization framework for {data management and} resource allocation in decentralized {wireless mobile edge computing (MEC)} networks. In our …

Deep Reinforcement Learning Edge-computing Management

Wireless MAC Protocol Synthesis and Optimization with Multi-Agent Distributed Reinforcement Learning

2024-08-12 · Navid Keshtiarast, Oliver Renaldi, Marina Petrova

In this letter, we propose a novel Multi-Agent Deep Reinforcement Learning (MADRL) framework for Medium Access Control (MAC) protocol design. Unlike centralized approaches, which rely on a single entity for decision-maki…

Decision Making Deep Reinforcement Learning rllib

Towards Multi-agent Reinforcement Learning for Wireless Network Protocol Synthesis

2021-02-02 · Hrishikesh Dutta, Subir Biswas

This paper proposes a multi-agent reinforcement learning based medium access framework for wireless networks. The access problem is formulated as a Markov Decision Process (MDP), and solved using reinforcement learning w…

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Medium Access using Distributed Reinforcement Learning for IoTs with Low-Complexity Wireless Transceivers

2021-04-29 · Hrishikesh Dutta, Subir Biswas

This paper proposes a distributed Reinforcement Learning (RL) based framework that can be used for synthesizing MAC layer wireless protocols in IoT networks with low-complexity wireless transceivers. The proposed framewo…

reinforcement-learning Reinforcement Learning (RL)

Deep Reinforcement Learning for Resource Constrained Multiclass Scheduling in Wireless Networks

2020-11-27 · Apostolos Avranas, Marios Kountouris, Philippe Ciblat

The problem of resource constrained scheduling in a dynamic and heterogeneous wireless setting is considered here. In our setup, the available limited bandwidth resources are allocated in order to serve randomly arriving…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning (RL)Scheduling