Multi-Agent Reinforcement Learning for Network Routing in Integrated Access Backhaul Networks

2023-05-12 · Shahaf Yamin, Haim Permuter

We investigate the problem of wireless routing in integrated access backhaul (IAB) networks consisting of fiber-connected and wireless base stations and multiple users. The physical constraints of these networks prevent the use of a central controller, and base stations have limited access to real-time network conditions. We aim to maximize packet arrival ratio while minimizing their latency, for this purpose, we formulate the problem as a multi-agent partially observed Markov decision process (POMDP). To solve this problem, we develop a Relational Advantage Actor Critic (Relational A2C) algorithm that uses Multi-Agent Reinforcement Learning (MARL) and information about similar destinations to derive a joint routing policy on a distributed basis. We present three training paradigms for this algorithm and demonstrate its ability to achieve near-centralized performance. Our results show that Relational A2C outperforms other reinforcement learning algorithms, leading to increased network efficiency and reduced selfish agent behavior. To the best of our knowledge, this work is the first to optimize routing strategy for IAB networks.

📄 PDF Abstract BibTeX arXiv:2305.16170

Code (0)

등록된 구현이 없습니다.

Tasks

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning

Methods 이 논문이 사용한 방법론

A2C A2C, or Advantage Actor Critic, is a synchronous version of the A3C policy gradient method. As an alternative to the asynchronous…

BASE 설명 없음

Scalable Deep Reinforcement Learning for Routing and Spectrum Access in Physical Layer

2020-12-22 · Wei Cui, Wei Yu

This paper proposes a novel scalable reinforcement learning approach for simultaneous routing and spectrum access in wireless ad-hoc networks. In most previous works on reinforcement learning for network optimization, th…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Dynamic Routing for Integrated Satellite-Terrestrial Networks: A Constrained Multi-Agent Reinforcement Learning Approach

2023-12-23 · Yifeng Lyu, Han Hu, Rongfei Fan, Zhi Liu 외

The integrated satellite-terrestrial network (ISTN) system has experienced significant growth, offering seamless communication services in remote areas with limited terrestrial infrastructure. However, designing a routin…

Multi-agent Reinforcement Learning

Fair collaborative vehicle routing: A deep multi-agent reinforcement learning approach

2023-10-26 · Stephen Mak, Liming Xu, Tim Pearce, Michael Ostroumov 외

Collaborative vehicle routing occurs when carriers collaborate through sharing their transportation requests and performing transportation requests on behalf of each other. This achieves economies of scale, thus reducing…

Multi-agent Reinforcement Learning reinforcement-learning

DRL-M4MR: An Intelligent Multicast Routing Approach Based on DQN Deep Reinforcement Learning in SDN

2022-07-31 · Chenwei Zhao, Miao Ye, Xingsi Xue, Jianhui Lv 외

Traditional multicast routing methods have some problems in constructing a multicast tree, such as limited access to network state information, poor adaptability to dynamic and complex changes in the network, and inflexi…

Deep Reinforcement Learning

Q-Cogni: An Integrated Causal Reinforcement Learning Framework

2023-02-26 · Cris Cunha, Wei Liu, Tim French, Ajmal Mian

We present Q-Cogni, an algorithmically integrated causal reinforcement learning framework that redesigns Q-Learning with an autonomous causal structure discovery method to improve the learning process with causal inferen…

Causal Inference Decision Making Q-Learning reinforcement-learning+2