paper-with-me

Papers

A Deep Reinforcement Learning Approach for Adaptive Traffic Routing in Next-gen Networks

2024-02-07 · Akshita Abrol, Purnima Murali Mohan, Tram Truong-Huu

Next-gen networks require significant evolution of management to enable automation and adaptively adjust network configuration based on traffic dynamics. The advent of software-defined networking (SDN) and programmable switches enables flexibility and programmability. However, traditional techniques that decide traffic policies are usually based on hand-crafted programming optimization and heuristic algorithms. These techniques make non-realistic assumptions, e.g., considering static network load and topology, to obtain tractable solutions, which are inadequate for next-gen networks. In this paper, we design and develop a deep reinforcement learning (DRL) approach for adaptive traffic routing. We design a deep graph convolutional neural network (DGCNN) integrated into the DRL framework to learn the traffic behavior from not only the network topology but also link and node attributes. We adopt the Deep Q-Learning technique to train the DGCNN model in the DRL framework without the need for a labeled training dataset, enabling the framework to quickly adapt to traffic dynamics. The model leverages q-value estimates to select the routing path for every traffic flow request, balancing exploration and exploitation. We perform extensive experiments with various traffic patterns and compare the performance of the proposed approach with the Open Shortest Path First (OSPF) protocol. The experimental results show the effectiveness and adaptiveness of the proposed framework by increasing the network throughput by up to 7.8% and reducing the traffic delay by up to 16.1% compared to OSPF.

📄 PDF Abstract BibTeX arXiv:2402.04515

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement LearningQ-Learning

Methods 이 논문이 사용한 방법론

DGCNN 설명 없음
Q-Learning Q-Learning is an off-policy temporal difference control algorithm: $$Q\left(S\_{t}, A\_{t}\right) \leftarrow Q\left(S\_{t}, A\_{t}\right) + \alpha\left[R_{t+1} +…

Similar Papers 제목 키워드 기반

Intelligent Routing Algorithm over SDN: Reusable Reinforcement Learning Approach

2024-09-23 · Wang Wumian, Sajal Saha, Anwar Haque, Greg Sidebottom

Traffic routing is vital for the proper functioning of the Internet. As users and network traffic increase, researchers try to develop adaptive and intelligent routing algorithms that can fulfill various QoS requirements…

reinforcement-learningReinforcement LearningReinforcement Learning (RL)

Three Pillars Towards Next-Generation Routing System

2024-09-03 · Lei LI, Mengxuan Zhang, Zizhuo Xu, Yehong Xu 외

The routing results are playing an increasingly important role in transportation efficiency, but they could generate traffic congestion unintentionally. This is because the traffic condition and routing system are discon…

Management

Learning Sub-Second Routing Optimization in Computer Networks requires Packet-Level Dynamics

2024-10-14 · Andreas Boltres, Niklas Freymuth, Patrick Jahnke, Holger Karl 외

Finding efficient routes for data packets is an essential task in computer networking. The optimal routes depend greatly on the current network topology, state and traffic demand, and they can change within milliseconds.…

Reinforcement Learning based Interconnection Routing for Adaptive Traffic Optimization

2019-08-13 · Sheng-Chun Kao, Chao-Han Huck Yang, Pin-Yu Chen, Xiaoli Ma 외

Applying Machine Learning (ML) techniques to design and optimize computer architectures is a promising research direction. Optimizing the runtime performance of a Network-on-Chip (NoC) necessitates a continuous learning …

BIG-bench Machine Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)

Network-Constrained Policy Optimization for Adaptive Multi-agent Vehicle Routing

2025-10-30 · Fazel Arasteh, Arian Haghparast, Manos Papagelis arxiv

Traffic congestion in urban road networks leads to longer trip times and higher emissions, especially during peak periods. While the Shortest Path First (SPF) algorithm is optimal for a single vehicle in a static network…

Multi-agent Reinforcement Learning