Multi-Agent Distributed Reinforcement Learning for Making Decentralized Offloading Decisions

2022-04-05 · Jing Tan, Ramin Khalili, Holger Karl, Artur Hecker

We formulate computation offloading as a decentralized decision-making problem with autonomous agents. We design an interaction mechanism that incentivizes agents to align private and system goals by balancing between competition and cooperation. The mechanism provably has Nash equilibria with optimal resource allocation in the static case. For a dynamic environment, we propose a novel multi-agent online learning algorithm that learns with partial, delayed and noisy state information, and a reward signal that reduces information need to a great extent. Empirical results confirm that through learning, agents significantly improve both system and individual performance, e.g., 40% offloading failure rate reduction, 32% communication overhead reduction, up to 38% computation resource savings in low contention, 18% utilization increase with reduced load variation in high contention, and improvement in fairness. Results also confirm the algorithm's good convergence and generalization property in significantly different environments.

📄 PDF Abstract BibTeX arXiv:2204.02267

Code (1)

dracosource/draco 공식 구현 pytorch

Tasks

Decision Making Fairness reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

ALIGN In the ALIGN method, visual and language representations are jointly trained from noisy image alt-text data. The image and text encoders are learned via contrastive loss…

Distributed Policy Iteration for Scalable Approximation of Cooperative Multi-Agent Policies

2019-01-25 · Thomy Phan, Kyrill Schmid, Lenz Belzner, Thomas Gabor 외

Decision making in multi-agent systems (MAS) is a great challenge due to enormous state and joint action spaces as well as uncertainty, making centralized control generally infeasible. Decentralized control offers better…

Decision Making Multi-agent Reinforcement Learning Reinforcement Learning

Multi-Agent Trust Region Policy Optimization

2020-10-15 · Hepeng Li, Haibo He

We extend trust region policy optimization (TRPO) to multi-agent reinforcement learning (MARL) problems. We show that the policy update of TRPO can be transformed into a distributed consensus optimization problem for mul…

Multi-agent Reinforcement Learning Privacy Preserving reinforcement-learning Reinforcement Learning (RL)

iPLAN: Intent-Aware Planning in Heterogeneous Traffic via Distributed Multi-Agent Reinforcement Learning

2023-06-09 · Xiyang Wu, Rohan Chandra, Tianrui Guan, Amrit Singh Bedi 외

Navigating safely and efficiently in dense and heterogeneous traffic scenarios is challenging for autonomous vehicles (AVs) due to their inability to infer the behaviors or intentions of nearby drivers. In this work, we …

Autonomous Vehicles Collision Avoidance Decision Making Motion Planning+1

Optimization for Reinforcement Learning: From Single Agent to Cooperative Agents

2019-12-01 · Donghwan Lee, Niao He, Parameswaran Kamalaruban, Volkan Cevher

This article reviews recent advances in multi-agent reinforcement learning algorithms for large-scale control systems and communication networks, which learn to communicate and cooperate. We provide an overview of this e…

Distributed Optimization Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning+1

Distributed Multi-Agent Deep Reinforcement Learning for Robust Coordination against Noise

2022-05-19 · Yoshinari Motokawa, Toshiharu Sugawara

In multi-agent systems, noise reduction techniques are important for improving the overall system reliability as agents are required to rely on limited environmental information to develop cooperative and coordinated beh…

Decision Making Deep Reinforcement Learning reinforcement-learning Reinforcement Learning (RL)