Dynamic Multichannel Access via Multi-agent Reinforcement Learning: Throughput and Fairness Guarantees

2021-05-10 · Muhammad Sohaib, Jongjin Jeong, Sang-Woon Jeon

We consider a multichannel random access system in which each user accesses a single channel at each time slot to communicate with an access point (AP). Users arrive to the system at random and be activated for a certain period of time slots and then disappear from the system. Under such dynamic network environment, we propose a distributed multichannel access protocol based on multi-agent reinforcement learning (RL) to improve both throughput and fairness between active users. Unlike the previous approaches adjusting channel access probabilities at each time slot, the proposed RL algorithm deterministically selects a set of channel access policies for several consecutive time slots. To effectively reduce the complexity of the proposed RL algorithm, we adopt a branching dueling Q-network architecture and propose an efficient training methodology for producing proper Q-values over time-varying user sets. We perform extensive simulations on realistic traffic environments and demonstrate that the proposed online learning improves both throughput and fairness compared to the conventional RL approaches and centralized scheduling policies.

📄 PDF Abstract BibTeX arXiv:2105.04077

Code (0)

등록된 구현이 없습니다.

Tasks

Fairness Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning (RL)Scheduling

A Deep Actor-Critic Reinforcement Learning Framework for Dynamic Multichannel Access

2019-08-20 · Chen Zhong, Ziyang Lu, M. Cenk Gursoy, Senem Velipasalar

To make efficient use of limited spectral resources, we in this work propose a deep actor-critic reinforcement learning based framework for dynamic multichannel access. We consider both a single-user case and a scenario …

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Actor-Critic Deep Reinforcement Learning for Dynamic Multichannel Access

2018-10-08 · Chen Zhong, Ziyang Lu, M. Cenk Gursoy, Senem Velipasalar

We consider the dynamic multichannel access problem, which can be formulated as a partially observable Markov decision process (POMDP). We first propose a model-free actor-critic deep reinforcement learning based framewo…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Emergent Communication Protocol Learning for Task Offloading in Industrial Internet of Things

2024-01-23 · Salwa Mostafa, Mateus P. Mota, Alvaro Valcarce, Mehdi Bennis

In this paper, we leverage a multi-agent reinforcement learning (MARL) framework to jointly learn a computation offloading decision and multichannel access policy with corresponding signaling. Specifically, the base stat…

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning

A Reinforcement Learning Approach for the Multichannel Rendezvous Problem

2019-07-02 · Jen-Hung Wang, Ping-En Lu, Cheng-Shang Chang, Duan-Shin Lee

In this paper, we consider the multichannel rendezvous problem in cognitive radio networks (CRNs) where the probability that two users hopping on the same channel have a successful rendezvous is a function of channel sta…

channel selection reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

TinyQMIX: Distributed Access Control for mMTC via Multi-agent Reinforcement Learning

2022-11-21 · Tien Thanh Le, Yusheng Ji, John C. S Lui

Distributed access control is a crucial component for massive machine type communication (mMTC). In this communication scenario, centralized resource allocation is not scalable because resource configurations have to be …

Deep Reinforcement Learning Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning+1