Asynchronous Multi-Agent Actor-Critic with Macro-Actions

2021-09-29 · Yuchen Xiao, Weihao Tan, Christopher Amato

Many realistic multi-agent problems naturally require agents to be capable of performing asynchronously without waiting for other agents to terminate (e.g., multi-robot domains). Such problems can be modeled as Macro-Action Decentralized Partially Observable Markov Decision Processes (MacDec-POMDPs). Current policy gradient methods are not applicable to the asynchronous actions in MacDec-POMDPs, as these methods assume that agents synchronously reason about action selection at every time-step. To allow asynchronous learning and decision-making, we formulate a set of asynchronous multi-agent actor-critic methods that allow agents to directly optimize asynchronous (macro-action-based) policies in three standard training paradigms: decentralized learning, centralized learning, and centralized training for decentralized execution. Empirical results in various domains show high-quality solutions can be learned for large domains when using our methods.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Decision MakingPolicy Gradient Methods

Macro-Action-Based Multi-Agent/Robot Deep Reinforcement Learning under Partial Observability

2022-09-20 · Yuchen Xiao

The state-of-the-art multi-agent reinforcement learning (MARL) methods have provided promising solutions to a variety of complex problems. Yet, these methods all assume that agents perform synchronized primitive-action e…

Decision Making Decision Making Under Uncertainty Deep Reinforcement Learning Multi-agent Reinforcement Learning+2

Asynchronous Actor-Critic for Multi-Agent Reinforcement Learning

2022-09-20 · Yuchen Xiao, Weihao Tan, Christopher Amato

Synchronizing decisions across multiple agents in realistic settings is problematic since it requires agents to wait for other agents to terminate and communicate about termination reliably. Ideally, agents should learn …

Decision Making Multi-agent Reinforcement Learning Policy Gradient Methods reinforcement-learning+2

Macro-Action-Based Deep Multi-Agent Reinforcement Learning

2020-04-18 · Yuchen Xiao, Joshua Hoffman, Christopher Amato

In real-world multi-robot systems, performing high-quality, collaborative behaviors requires robots to asynchronously reason about high-level action selection at varying time durations. Macro-Action Decentralized Partial…

Decision Making Decision Making Under Uncertainty Deep Reinforcement Learning Multi-agent Reinforcement Learning+3

Viewport Prediction, Bitrate Selection, and Beamforming Design for THz-Enabled 360° Video Streaming

2024-01-23 · Mehdi Setayesh, Vincent W. S. Wong

360{\deg} videos require significant bandwidth to provide an immersive viewing experience. Wireless systems using terahertz (THz) frequency band can meet this high data rate demand. However, self-blockage is a challenge …

Decision Making Deep Reinforcement Learning Federated Learning Personalized Federated Learning

Reducing Bus Bunching with Asynchronous Multi-Agent Reinforcement Learning

2021-05-02 · Jiawei Wang, Lijun Sun

The bus system is a critical component of sustainable urban transportation. However, due to the significant uncertainties in passenger demand and traffic conditions, bus operation is unstable in nature and bus bunching h…

Graph Attention Inductive Learning Multi-agent Reinforcement Learning reinforcement-learning+2