paper-with-me

홈 › Papers

Constrained Reinforcement Learning for Adaptive Controller Synchronization in Distributed SDN

2024-01-21 · Ioannis Panitsas, Akrit Mudvari, Leandros Tassiulas

In software-defined networking (SDN), the implementation of distributed SDN controllers, with each controller responsible for managing a specific sub-network or domain, plays a critical role in achieving a balance between centralized control, scalability, reliability, and network efficiency. These controllers must be synchronized to maintain a logically centralized view of the entire network. While there are various approaches for synchronizing distributed SDN controllers, most tend to prioritize goals such as optimization of communication latency or load balancing, often neglecting to address both the aspects simultaneously. This limitation becomes particularly significant when considering applications like Augmented and Virtual Reality (AR/VR), which demand constrained network latencies and substantial computational resources. Additionally, many existing studies in this field predominantly rely on value-based reinforcement learning (RL) methods, overlooking the potential advantages offered by state-of-the-art policy-based RL algorithms. To bridge this gap, our work focuses on examining deep reinforcement learning (DRL) techniques, encompassing both value-based and policy-based methods, to guarantee an upper latency threshold for AR/VR task offloading within SDN environments, while selecting the most cost-effective servers for AR/VR task offloading. Our evaluation results indicate that while value-based methods excel in optimizing individual network metrics such as latency or load balancing, policy-based approaches exhibit greater robustness in adapting to sudden network changes or reconfiguration.

📄 PDF Abstract BibTeX arXiv:2403.08775

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement Learningreinforcement-learningReinforcement Learning (RL)

Similar Papers 제목 키워드 기반

MACS: Deep Reinforcement Learning based SDN Controller Synchronization Policy Design

2019-09-19 · Ziyao Zhang, Liang Ma, Konstantinos Poularakis, Kin K. Leung 외

In distributed software-defined networks (SDN), multiple physical SDN controllers, each managing a network domain, are implemented to balance centralised control, scalability, and reliability requirements. In such networ…

Deep Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)

An Application of Model Reference Adaptive Control for Multi-Agent Synchronization in Drone Networks

2024-06-30 · Miguel F. Arevalo-Castiblanco, Yejin Wi, Marzia Cescon and, Cesar A. Uribe

This paper presents the application of a Distributed Model Reference Adaptive Control (DMRAC) strategy for robust multi-agent synchronization of a network of drones. The proposed approach enables the development of contr…

Data-driven Polytopic Output Synchronization of Heterogeneous Multi-agent Systems from Noisy Data

2023-07-14 · Yifei Li, Wenjie Liu, Jian Sun, Gang Wang 외

This paper proposes a novel approach to addressing the output synchronization problem in unknown heterogeneous multi-agent systems (MASs) using noisy data. Unlike existing studies that focus on noiseless data, we introdu…

High-Throughput Distributed Reinforcement Learning via Adaptive Policy Synchronization

2025-07-15 · Rodney Lafuente-Mercado

Scaling reinforcement learning (RL) workloads often requires distributing environment simulation across compute clusters. Existing frameworks entangle simulation, learning logic, and orchestration into monolithic systems…

reinforcement-learningReinforcement LearningReinforcement Learning (RL)

Robust synchronization and policy adaptation for networked heterogeneous agents

2024-09-05 · Miguel F. Arevalo-Castiblanco, Eduardo Mojica-Nava and, César A. Uribe

We propose a robust adaptive online synchronization method for leader-follower networks of nonlinear heterogeneous agents with system uncertainties and input magnitude saturation. Synchronization is achieved using a Dist…

reinforcement-learningReinforcement LearningReinforcement Learning (RL)