Multi-Agent Reinforcement Learning for Long-Term Network Resource Allocation through Auction: a V2X Application

2022-07-29 · Jing Tan, Ramin Khalili, Holger Karl, Artur Hecker

We formulate offloading of computational tasks from a dynamic group of mobile agents (e.g., cars) as decentralized decision making among autonomous agents. We design an interaction mechanism that incentivizes such agents to align private and system goals by balancing between competition and cooperation. In the static case, the mechanism provably has Nash equilibria with optimal resource allocation. In a dynamic environment, this mechanism's requirement of complete information is impossible to achieve. For such environments, we propose a novel multi-agent online learning algorithm that learns with partial, delayed and noisy state information, thus greatly reducing information need. Our algorithm is also capable of learning from long-term and sparse reward signals with varying delay. Empirical results from the simulation of a V2X application confirm that through learning, agents with the learning algorithm significantly improve both system and individual performance, reducing up to 30% of offloading failure rate, communication overhead and load variation, increasing computation resource utilization and fairness. Results also confirm the algorithm's good convergence and generalization property in different environments.

📄 PDF Abstract BibTeX arXiv:2208.04237

Code (0)

등록된 구현이 없습니다.

Tasks

Decision Making Fairness Multi-agent Reinforcement Learning

Methods 이 논문이 사용한 방법론

ALIGN In the ALIGN method, visual and language representations are jointly trained from noisy image alt-text data. The image and text encoders are learned via contrastive loss…

Multi-Agent Reinforcement Learning Based Resource Allocation for UAV Networks

2018-10-24

Unmanned aerial vehicles (UAVs) are capable of serving as aerial base stations (BSs) for providing both cost-effective and on-demand wireless communications. This article investigates dynamic resource allocation of multi…

Multi-agent Reinforcement Learning Q-Learning reinforcement-learning Reinforcement Learning+1

Long-Term Fairness in Sequential Multi-Agent Selection with Positive Reinforcement

2024-07-10 · Bhagyashree Puranik, Ozgur Guldogan, Upamanyu Madhow, Ramtin Pedarsani

While much of the rapidly growing literature on fair decision-making focuses on metrics for one-shot decisions, recent work has raised the intriguing possibility of designing sequential decision-making to positively impa…

Decision Making Fairness Sequential Decision Making

Cache-Aided NOMA Mobile Edge Computing: A Reinforcement Learning Approach

2019-06-20

A novel non-orthogonal multiple access (NOMA) based cache-aided mobile edge computing (MEC) framework is proposed. For the purpose of efficiently allocating communication and computation resources to users' computation t…

Edge-computing Q-Learning reinforcement-learning Reinforcement Learning+1

Adaptive Resource Management for Edge Network Slicing using Incremental Multi-Agent Deep Reinforcement Learning

2023-10-26 · Haiyuan Li, Yuelin Liu, Xueqing Zhou, Xenofon Vasilakos 외

Multi-access edge computing provides local resources in mobile networks as the essential means for meeting the demands of emerging ultra-reliable low-latency communications. At the edge, dynamic computing requests requir…

Deep Reinforcement Learning Edge-computing Incremental Learning Management+1

Deep Reinforcement Learning for Distributed and Uncoordinated Cognitive Radios Resource Allocation

2022-05-27 · Ankita Tondwalkar, Andres Kwasinski

This paper presents a novel deep reinforcement learning-based resource allocation technique for the multi-agent environment presented by a cognitive radio network where the interactions of the agents during learning may …

Deep Reinforcement Learning Q-Learning reinforcement-learning Reinforcement Learning+1