DRL-based Slice Placement Under Non-Stationary Conditions
We consider online learning for optimal network slice placement under the assumption that slice requests arrive according to a non-stationary Poisson process. We propose a framework based on Deep Reinforcement Learning (DRL) combined with a heuristic to design algorithms. We specifically design two pure-DRL algorithms and two families of hybrid DRL-heuristic algorithms. To validate their performance, we perform extensive simulations in the context of a large-scale operator infrastructure. The evaluation results show that the proposed hybrid DRL-heuristic algorithms require three orders of magnitude of learning episodes less than pure-DRL to achieve convergence. This result indicates that the proposed hybrid DRL-heuristic approach is more reliable than pure-DRL in a real non-stationary network scenario.
Code (0)
등록된 구현이 없습니다.
Tasks
Deep Reinforcement LearningReinforcement Learning (RL)Similar Papers 제목 키워드 기반
DRL-based Slice Placement under Realistic Network Load Conditions
We propose to demonstrate a network slice placement optimization solution based on Deep Reinforcement Learning (DRL), referred to as Heuristically-controlled DRL, which uses a heuristic to control the DRL algorithm conve…
Deep Reinforcement Learningreinforcement-learningReinforcement Learning (RL)On the Robustness of Controlled Deep Reinforcement Learning for Slice Placement
The evaluation of the impact of using Machine Learning in the management of softwarized networks is considered in multiple research works. Beyond that, we propose to evaluate the robustness of online learning for optimal…
Deep Reinforcement LearningManagementreinforcement-learningReinforcement Learning (RL)Controlled Deep Reinforcement Learning for Optimized Slice Placement
We present a hybrid ML-heuristic approach that we name "Heuristically Assisted Deep Reinforcement Learning (HA-DRL)" to solve the problem of Network Slice Placement Optimization. The proposed approach leverages recent wo…
Deep Reinforcement LearningNetwork Embeddingreinforcement-learningReinforcement Learning+1Mass Loss and Displacement Modeling for Multi-Axis Milling
During the cutting process, material of the workpiece is continuously being removed by the cutting tool, which results in a reduction of mass as well as a displacement in the center of the workpiece mass. When using work…
Environmental Sensor Placement with Convolutional Gaussian Neural Processes
Environmental sensors are crucial for monitoring weather conditions and the impacts of climate change. However, it is challenging to place sensors in a way that maximises the informativeness of their measurements, partic…
Active LearningGaussian ProcessesInformativenessMeta-Learning