Multi-Agent Soft Actor-Critic with Coordinated Loss for Autonomous Mobility-on-Demand Fleet Control

2024-04-10 · Zeno Woywood, Jasper I. Wiltfang, Julius Luy, Tobias Enders, Maximilian Schiffer

We study a sequential decision-making problem for a profit-maximizing operator of an autonomous mobility-on-demand system. Optimizing a central operator's vehicle-to-request dispatching policy requires efficient and effective fleet control strategies. To this end, we employ a multi-agent Soft Actor-Critic algorithm combined with weighted bipartite matching. We propose a novel vehicle-based algorithm architecture and adapt the critic's loss function to appropriately consider coordinated actions. Furthermore, we extend our algorithm to incorporate rebalancing capabilities. Through numerical experiments, we show that our approach outperforms state-of-the-art benchmarks by up to 12.9% for dispatching and up to 38.9% with integrated rebalancing.

📄 PDF Abstract BibTeX arXiv:2404.06975

Code (1)

tumbais/hybridmadrl-amod-relocation 공식 구현 tf

Tasks

Decision MakingSequential Decision Making

Multi-Agent Coordinated Rename Refactoring

2026-01-01 · Abhiram Bellur, Mohammed Raihan Ullah, Fraol Batole, Mohit Kansara 외 arxiv

The primary value of AI agents in software development lies in their ability to extend the developer's capacity for reasoning and action, not to supplant human involvement. To showcase how to use agents working in tandem…

Coordination in Adversarial Sequential Team Games via Multi-Agent Deep Reinforcement Learning

2019-12-16 · Andrea Celli, Marco Ciccone, Raffaele Bongo, Nicola Gatti

Many real-world applications involve teams of agents that have to coordinate their actions to reach a common goal against potential adversaries. This paper focuses on zero-sum games where a team of players faces an oppon…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Hybrid Multi-agent Deep Reinforcement Learning for Autonomous Mobility on Demand Systems

2022-12-14 · Tobias Enders, James Harrison, Marco Pavone, Maximilian Schiffer

We consider the sequential decision-making problem of making proactive request assignment and rejection decisions for a profit-maximizing operator of an autonomous mobility on demand system. We formalize this problem as …

Decision Making Deep Reinforcement Learning reinforcement-learning Reinforcement Learning (RL)+1

Learning to Coordinate in Multi-Agent Systems: A Coordinated Actor-Critic Algorithm and Finite-Time Guarantees

2021-10-11 · Siliang Zeng, Tianyi Chen, Alfredo Garcia, Mingyi Hong

Multi-agent reinforcement learning (MARL) has attracted much research attention recently. However, unlike its single-agent counterpart, many theoretical and algorithmic aspects of MARL have not been well-understood. In t…

Multi-agent Reinforcement Learning

FACMAC: Factored Multi-Agent Centralised Policy Gradients

2020-03-14 · NeurIPS 2021 12 · Bei Peng, Tabish Rashid, Christian A. Schroeder de Witt, Pierre-Alexandre Kamienny 외

We propose FACtored Multi-Agent Centralised policy gradients (FACMAC), a new method for cooperative multi-agent reinforcement learning in both discrete and continuous action spaces. Like MADDPG, a popular multi-agent act…

MuJoCo Multi-agent Reinforcement Learning Q-Learning Reinforcement Learning+3