Distributed Resource Allocation with Multi-Agent Deep Reinforcement Learning for 5G-V2V Communication

2020-10-11 · Alperen Gündogan, H. Murat Gürsu, Volker Pauli, Wolfgang Kellerer

We consider the distributed resource selection problem in Vehicle-to-vehicle (V2V) communication in the absence of a base station. Each vehicle autonomously selects transmission resources from a pool of shared resources to disseminate Cooperative Awareness Messages (CAMs). This is a consensus problem where each vehicle has to select a unique resource. The problem becomes more challenging when---due to mobility---the number of vehicles in vicinity of each other is changing dynamically. In a congested scenario, allocation of unique resources for each vehicle becomes infeasible and a congested resource allocation strategy has to be developed. The standardized approach in 5G, namely semi-persistent scheduling (SPS) suffers from effects caused by spatial distribution of the vehicles. In our approach, we turn this into an advantage. We propose a novel DIstributed Resource Allocation mechanism using multi-agent reinforcement Learning (DIRAL) which builds on a unique state representation. One challenging issue is to cope with the non-stationarity introduced by concurrently learning agents which causes convergence problems in multi-agent learning systems. We aimed to tackle non-stationarity with unique state representation. Specifically, we deploy view-based positional distribution as a state representation to tackle non-stationarity and perform complex joint behavior in a distributed fashion. Our results showed that DIRAL improves PRR by 20% compared to SPS in challenging congested scenarios.

📄 PDF Abstract BibTeX arXiv:2010.05290

Code (1)

gundoganalperen/DIRAL 공식 구현 tf

Tasks

Deep Reinforcement LearningDistributed Optimization Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning (RL)Scheduling

Deep Reinforcement Learning for Distributed Uncoordinated Cognitive Radios Resource Allocation

2019-10-29 · Ankita Tondwalkar, Dr Andres Kwasinski

This paper presents a novel deep reinforcement learning-based resource allocation technique for the multi-agent environment presented by a cognitive radio network that coexists through underlay dynamic spectrum access (D…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Multi-Agent Deep Reinforcement Learning enabled Computation Resource Allocation in a Vehicular Cloud Network

2020-08-14 · Shilin Xu, Caili Guo, Rose Qingyang Hu, Yi Qian

In this paper, we investigate the computational resource allocation problem in a distributed Ad-Hoc vehicular network with no centralized infrastructure support. To support the ever increasing computational needs in such…

Combinatorial Optimization Deep Reinforcement Learning Reinforcement Learning (RL)

Deep Reinforcement Learning for Distributed and Uncoordinated Cognitive Radios Resource Allocation

2022-05-27 · Ankita Tondwalkar, Andres Kwasinski

This paper presents a novel deep reinforcement learning-based resource allocation technique for the multi-agent environment presented by a cognitive radio network where the interactions of the agents during learning may …

Deep Reinforcement Learning Q-Learning reinforcement-learning Reinforcement Learning+1

TinyQMIX: Distributed Access Control for mMTC via Multi-agent Reinforcement Learning

2022-11-21 · Tien Thanh Le, Yusheng Ji, John C. S Lui

Distributed access control is a crucial component for massive machine type communication (mMTC). In this communication scenario, centralized resource allocation is not scalable because resource configurations have to be …

Deep Reinforcement Learning Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning+1

Federated Learning for Distributed Energy-Efficient Resource Allocation

2022-04-20 · Zelin Ji, Zhijin Qin

In cellular networks, resource allocation is performed in a centralized way, which brings huge computation complexity to the base station (BS) and high transmission overhead. This paper investigates the distributed resou…

Federated Learning Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning+1