On the Robustness of Controlled Deep Reinforcement Learning for Slice Placement

2021-08-05 · Jose Jurandir Alves Esteves, Amina Boubendir, Fabrice Guillemin, Pierre Sens

The evaluation of the impact of using Machine Learning in the management of softwarized networks is considered in multiple research works. Beyond that, we propose to evaluate the robustness of online learning for optimal network slice placement. A major assumption to this study is to consider that slice request arrivals are non-stationary. In this context, we simulate unpredictable network load variations and compare two Deep Reinforcement Learning (DRL) algorithms: a pure DRL-based algorithm and a heuristically controlled DRL as a hybrid DRL-heuristic algorithm, to assess the impact of these unpredictable changes of traffic load on the algorithms performance. We conduct extensive simulations of a large-scale operator infrastructure. The evaluation results show that the proposed hybrid DRL-heuristic approach is more robust and reliable in case of unpredictable network load changes than pure DRL as it reduces the performance degradation. These results are follow-ups for a series of recent research we have performed showing that the proposed hybrid DRL-heuristic approach is efficient and more adapted to real network scenarios than pure DRL.

📄 PDF Abstract BibTeX arXiv:2108.02505

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement LearningManagement reinforcement-learning Reinforcement Learning (RL)

Controlled Deep Reinforcement Learning for Optimized Slice Placement

2021-08-03 · Jose Jurandir Alves Esteves, Amina Boubendir, Fabrice Guillemin, Pierre Sens

We present a hybrid ML-heuristic approach that we name "Heuristically Assisted Deep Reinforcement Learning (HA-DRL)" to solve the problem of Network Slice Placement Optimization. The proposed approach leverages recent wo…

Deep Reinforcement Learning Network Embedding reinforcement-learning Reinforcement Learning+1

DRL-based Slice Placement under Realistic Network Load Conditions

2021-09-27 · José Jurandir Alves Esteves, Amina Boubendir, Fabrice Guillemin, Pierre Sens

We propose to demonstrate a network slice placement optimization solution based on Deep Reinforcement Learning (DRL), referred to as Heuristically-controlled DRL, which uses a heuristic to control the DRL algorithm conve…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning (RL)

DRL-based Slice Placement Under Non-Stationary Conditions

2021-08-05 · Jose Jurandir Alves Esteves, Amina Boubendir, Fabrice Guillemin, Pierre Sens

We consider online learning for optimal network slice placement under the assumption that slice requests arrive according to a non-stationary Poisson process. We propose a framework based on Deep Reinforcement Learning (…

Deep Reinforcement Learning Reinforcement Learning (RL)

A Heuristically Assisted Deep Reinforcement Learning Approach for Network Slice Placement

2021-05-14 · Jose Jurandir Alves Esteves, Amina Boubendir, Fabrice Guillemin, Pierre Sens

Network Slice placement with the problem of allocation of resources from a virtualized substrate network is an optimization problem which can be formulated as a multiobjective Integer Linear Programming (ILP) problem. Ho…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning (RL)

Knowledge Transfer in Deep Reinforcement Learning for Slice-Aware Mobility Robustness Optimization

2022-03-07 · Qi Liao, Tianlun Hu, Dan Wellington

The legacy mobility robustness optimization (MRO) in self-organizing networks aims at improving handover performance by optimizing cell-specific handover parameters. However, such solutions cannot satisfy the needs of ne…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+1