A Deep Ensemble Multi-Agent Reinforcement Learning Approach for Air Traffic Control

2020-04-03 · Supriyo Ghosh, Sean Laguna, Shiau Hong Lim, Laura Wynter, Hasan Poonawala

Air traffic control is an example of a highly challenging operational problem that is readily amenable to human expertise augmentation via decision support technologies. In this paper, we propose a new intelligent decision making framework that leverages multi-agent reinforcement learning (MARL) to dynamically suggest adjustments of aircraft speeds in real-time. The goal of the system is to enhance the ability of an air traffic controller to provide effective guidance to aircraft to avoid air traffic congestion, near-miss situations, and to improve arrival timeliness. We develop a novel deep ensemble MARL method that can concisely capture the complexity of the air traffic control problem by learning to efficiently arbitrate between the decisions of a local kernel-based RL model and a wider-reaching deep MARL model. The proposed method is trained and evaluated on an open-source air traffic management simulator developed by Eurocontrol. Extensive empirical results on a real-world dataset including thousands of aircraft demonstrate the feasibility of using multi-agent RL for the problem of en-route air traffic control and show that our proposed deep ensemble MARL method significantly outperforms three state-of-the-art benchmark approaches.

📄 PDF Abstract BibTeX arXiv:2004.01387

Code (0)

등록된 구현이 없습니다.

Tasks

Decision Making Management Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Improving the generalizability and robustness of large-scale traffic signal control

2023-06-02 · Tianyu Shi, Francois-Xavier Devailly, Denis Larocque, Laurent Charlin

A number of deep reinforcement-learning (RL) approaches propose to control traffic signals. In this work, we study the robustness of such methods along two axes. First, sensor failures and GPS occlusions create missing-d…

Deep Reinforcement Learning Distributional Reinforcement Learning Multi-agent Reinforcement Learning quantile regression+4

Random Ensemble Reinforcement Learning for Traffic Signal Control

2022-03-10 · Ruijie Qi, Jianbin Huang, He Li, Qinglin Tan 외

Traffic signal control is a significant part of the construction of intelligent transportation. An efficient traffic signal control strategy can reduce traffic congestion, improve urban road traffic efficiency and facili…

Ensemble Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+1

A Novel Multi-Agent Deep RL Approach for Traffic Signal Control

2023-06-05 · Shijie Wang, Shangbo Wang

As travel demand increases and urban traffic condition becomes more complicated, applying multi-agent deep reinforcement learning (MARL) to traffic signal control becomes one of the hot topics. The rise of Reinforcement …

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+1

Adaptive Tuning of Parameterized Traffic Controllers via Multi-Agent Reinforcement Learning

2025-12-08 · Giray Önür, Azita Dabiri, Bart De Schutter arxiv

Effective traffic control is essential for mitigating congestion in transportation networks. Conventional traffic management strategies, including route guidance and ramp metering, often rely on state feedback controller…

Multi-agent Reinforcement Learning

Network-wide traffic signal control optimization using a multi-agent deep reinforcement learning

2021-04-20 · Zhenning Li, Hao Yu, Guohui Zhang, Shangjia Dong 외

Inefficient traffic control may cause numerous problems such as traffic congestion and energy waste. This paper proposes a novel multi-agent reinforcement learning method, named KS-DDPG (Knowledge Sharing Deep Determinis…

Deep Reinforcement Learning Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning+2