Multi-Agent Reinforcement Learning for Channel Assignment and Power Allocation in Platoon-Based C-V2X Systems

2020-11-09 · Hung V. Vu, Mohammad Farzanullah, ZheYu Liu, Duy H. N. Nguyen, Robert Morawski, Tho Le-Ngoc

We consider the problem of joint channel assignment and power allocation in underlaid cellular vehicular-to-everything (C-V2X) systems where multiple vehicle-to-network (V2N) uplinks share the time-frequency resources with multiple vehicle-to-vehicle (V2V) platoons that enable groups of connected and autonomous vehicles to travel closely together. Due to the nature of high user mobility in vehicular environment, traditional centralized optimization approach relying on global channel information might not be viable in C-V2X systems with large number of users. Utilizing a multi-agent reinforcement learning (RL) approach, we propose a distributed resource allocation (RA) algorithm to overcome this challenge. Specifically, we model the RA problem as a multi-agent system. Based solely on the local channel information, each platoon leader, acting as an agent, collectively interacts with each other and accordingly selects the optimal combination of sub-band and power level to transmit its signals. Toward this end, we utilize the double deep Q-learning algorithm to jointly train the agents under the objectives of simultaneously maximizing the sum-rate of V2N links and satisfying the packet delivery probability of each V2V link in a desired latency limitation. Simulation results show that our proposed RL-based algorithm provides a close performance compared to that of the well-known exhaustive search algorithm.

📄 PDF Abstract BibTeX arXiv:2011.04555

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous Vehicles Multi-agent Reinforcement LearningQ-LearningReinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

Travel 설명 없음

Q-Learning Q-Learning is an off-policy temporal difference control algorithm: $$Q\left(S\_{t}, A\_{t}\right) \leftarrow Q\left(S\_{t}, A\_{t}\right) + \alpha\left[R_{t+1} +…

Multi Agent Reinforcement Learning for Sequential Satellite Assignment Problems

2024-12-20 · Joshua Holder, Natasha Jaques, Mehran Mesbahi

Assignment problems are a classic combinatorial optimization problem in which a group of agents must be assigned to a group of tasks such that maximum utility is achieved while satisfying assignment constraints. Given th…

Combinatorial Optimization Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning+1

Federated Learning for Distributed Energy-Efficient Resource Allocation

2022-04-20 · Zelin Ji, Zhijin Qin

In cellular networks, resource allocation is performed in a centralized way, which brings huge computation complexity to the base station (BS) and high transmission overhead. This paper investigates the distributed resou…

Federated Learning Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning+1

Optimal Power Allocation and Sub-Optimal Channel Assignment for Downlink NOMA Systems Using Deep Reinforcement Learning

2026-01-18 · WooSeok Kim, Jeonghoon Lee, Sangho Kim, Taesun An 외 arxiv

In recent years, Non-Orthogonal Multiple Access (NOMA) system has emerged as a promising candidate for multiple access frameworks due to the evolution of deep machine learning, trying to incorporate deep machine learning…

Reinforcement Learning

Reinforcement Learning based Multi-connectivity Resource Allocation in Factory Automation Systems

2022-08-26 · Mohammad Farzanullah, Hung V. Vu, Tho Le-Ngoc

We propose joint user association, channel assignment and power allocation for mobile robot Ultra-Reliable and Low Latency Communications (URLLC) based on multi-connectivity and reinforcement learning. The mobile robots …

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning (RL)

Learning to Transfer Role Assignment Across Team Sizes

2022-04-17 · Dung Nguyen, Phuoc Nguyen, Svetha Venkatesh, Truyen Tran

Multi-agent reinforcement learning holds the key for solving complex tasks that demand the coordination of learning agents. However, strong coordination often leads to expensive exploration over the exponentially large s…

Management Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning+3