MACS: Deep Reinforcement Learning based SDN Controller Synchronization Policy Design

2019-09-19 · Ziyao Zhang, Liang Ma, Konstantinos Poularakis, Kin K. Leung, Jeremy Tucker, Ananthram Swami

In distributed software-defined networks (SDN), multiple physical SDN controllers, each managing a network domain, are implemented to balance centralised control, scalability, and reliability requirements. In such networking paradigms, controllers synchronize with each other, in attempts to maintain a logically centralised network view. Despite the presence of various design proposals for distributed SDN controller architectures, most existing works only aim at eliminating anomalies arising from the inconsistencies in different controllers' network views. However, the performance aspect of controller synchronization designs with respect to given SDN applications are generally missing. To fill this gap, we formulate the controller synchronization problem as a Markov decision process (MDP) and apply reinforcement learning techniques combined with deep neural networks (DNNs) to train a smart, scalable, and fine-grained controller synchronization policy, called the Multi-Armed Cooperative Synchronization (MACS), whose goal is to maximise the performance enhancements brought by controller synchronizations. Evaluation results confirm the DNN's exceptional ability in abstracting latent patterns in the distributed SDN environment, rendering significant superiority to MACS-based synchronization policy, which are 56% and 30% performance improvements over ONOS and greedy SDN controller synchronization heuristics.

📄 PDF Abstract BibTeX arXiv:1909.09063

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement Learningreinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Hierarchical Reinforcement Learning with Optimal Level Synchronization based on a Deep Generative Model

2021-07-17 · Jaeyoon Kim, Junyu Xuan, Christy Liang, Farookh Hussain

The high-dimensional or sparse reward task of a reinforcement learning (RL) environment requires a superior potential controller such as hierarchical reinforcement learning (HRL) rather than an atomic RL because it absor…

Hierarchical Reinforcement Learning reinforcement-learning Reinforcement Learning (RL)

Constrained Reinforcement Learning for Adaptive Controller Synchronization in Distributed SDN

2024-01-21 · Ioannis Panitsas, Akrit Mudvari, Leandros Tassiulas

In software-defined networking (SDN), the implementation of distributed SDN controllers, with each controller responsible for managing a specific sub-network or domain, plays a critical role in achieving a balance betwee…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning (RL)

Resilient Autonomous Control of Distributed Multi-agent Systems in Contested Environments

2017-08-31 · Rohollah Moghadam, Hamidreza Modares

An autonomous and resilient controller is proposed for leader-follower multi-agent systems under uncertainties and cyber-physical attacks. The leader is assumed non-autonomous with a nonzero control input, which allows c…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Synchronization of Diverse Agents via Phase Analysis

2022-11-08 · Dan Wang, Wei Chen, Li Qiu

In this paper, the synchronization of heterogeneous agents interacting over a dynamical network is studied. The edge dynamics can model the inter-agent communications which are often heterogeneous by nature. They can als…

Diversity

Event-Triggered Output Synchronization of Heterogeneous Nonlinear Multi-Agents

2019-08-21

This paper addresses the output synchronization problem for heterogeneous nonlinear multi-agent systems with distributed event-based controllers. Employing the two-step synchronization process, we first outline the distr…