Intelligent Active Queue Management Using Explicit Congestion Notification

2019-08-28 · Cesar A. Gomez, Xianbin Wang, Abdallah Shami

As more end devices are getting connected, the Internet will become more congested. Various congestion control techniques have been developed either on transport or network layers. Active Queue Management (AQM) is a paradigm that aims to mitigate the congestion on the network layer through active buffer control to avoid overflow. However, finding the right parameters for an AQM scheme is challenging, due to the complexity and dynamics of the networks. On the other hand, the Explicit Congestion Notification (ECN) mechanism is a solution that makes visible incipient congestion on the network layer to the transport layer. In this work, we propose to exploit the ECN information to improve AQM algorithms by applying Machine Learning techniques. Our intelligent method uses an artificial neural network to predict congestion and an AQM parameter tuner based on reinforcement learning. The evaluation results show that our solution can enhance the performance of deployed AQM, using the existing TCP congestion control mechanisms.

📄 PDF Abstract BibTeX arXiv:1909.08386

Code (1)

cgomezsu/IntelligentAQM 공식 구현 tf

Tasks

Management Reinforcement Learning

Methods 이 논문이 사용한 방법론

Q-Learning Q-Learning is an off-policy temporal difference control algorithm: $$Q\left(S\_{t}, A\_{t}\right) \leftarrow Q\left(S\_{t}, A\_{t}\right) + \alpha\left[R_{t+1} +…

LSTM An LSTM is a type of recurrent neural network that addresses the vanishing gradient problem in vanilla…

Federated Intelligence for Active Queue Management in Inter-Domain Congestion

2021-01-08 · Cesar A. Gomez, Xianbin Wang, Abdallah Shami

Active Queue Management (AQM) has been considered as a paradigm for the complicated network management task of mitigating congestion by controlling buffer of network link queues. However, finding the right parameters for…

Federated Learning Management

Distilling Large Language Models for Network Active Queue Management

2025-01-28 · Deol Satish, Shiva Raj Pokhrel, Jonathan Kua, Anwar Walid

The growing complexity of network traffic and demand for ultra-low latency communication require smarter packet traffic management. Existing Deep Learning-based queuing approaches struggle with dynamic network scenarios …

Few-Shot Learning Management

Active queue management: First steps toward a new control-theoretic viewpoint

2022-11-09 · Céfric Join, Hugues Mounier, Emmanuel Delaleau, Michel Fliess

Active Queue Management (AQM) for mitigating Internet congestion has been addressed via various feedback control syntheses, among which P, PI, and PID regulators are quite popular and often associated to a Smith predicto…

Management Time Series Time Series Analysis

Adaptive active queue management controller for TCP communication networks using PSO-RBF models

2017-11-16 · Mansour Sheikhan, Reza Shahnazi, Ehasn Hemmati

Addressing performance degradations in end-to-end congestion control has been one of the most active research areas in the last decade. Active queue management (AQM) aims to improve the overall network throughput, while …

Management

LFQ: Online Learning of Per-flow Queuing Policies using Deep Reinforcement Learning

2020-07-06 · Maximilian Bachl, Joachim Fabini, Tanja Zseby

The increasing number of different, incompatible congestion control algorithms has led to an increased deployment of fair queuing. Fair queuing isolates each network flow and can thus guarantee fairness for each flow eve…

Deep Reinforcement Learning Fairness Management reinforcement-learning+1