paper-with-me

Papers

Adaptive Resource Management for Edge Network Slicing using Incremental Multi-Agent Deep Reinforcement Learning

2023-10-26 · Haiyuan Li, Yuelin Liu, Xueqing Zhou, Xenofon Vasilakos, Reza Nejabati, Shuangyi Yan, Dimitra Simeonidou

Multi-access edge computing provides local resources in mobile networks as the essential means for meeting the demands of emerging ultra-reliable low-latency communications. At the edge, dynamic computing requests require advanced resource management for adaptive network slicing, including resource allocations, function scaling and load balancing to utilize only the necessary resources in resource-constraint networks. Recent solutions are designed for a static number of slices. Therefore, the painful process of optimization is required again with any update on the number of slices. In addition, these solutions intend to maximize instant rewards, neglecting long-term resource scheduling. Unlike these efforts, we propose an algorithmic approach based on multi-agent deep deterministic policy gradient (MADDPG) for optimizing resource management for edge network slicing. Our objective is two-fold: (i) maximizing long-term network slicing benefits in terms of delay and energy consumption, and (ii) adapting to slice number changes. Through simulations, we demonstrate that MADDPG outperforms benchmark solutions including a static slicing-based one from the literature, achieving stable and high long-term performance. Additionally, we leverage incremental learning to facilitate a dynamic number of edge slices, with enhanced performance compared to pre-trained base models. Remarkably, this approach yields superior reward performance while saving approximately 90% of training time costs.

📄 PDF Abstract BibTeX arXiv:2310.17523

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement LearningEdge-computingIncremental LearningManagementScheduling

Methods 이 논문이 사용한 방법론

Weight Decay 설명 없음
ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Experience Replay Experience Replay is a replay memory technique used in reinforcement learning where we store the agent’s experiences at each time-step, $e\_{t} = \left(s\_{t}, a\_{t}, r\_{t},…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Adam 설명 없음
Batch Normalization 설명 없음
MADDPG MADDPG, or Multi-agent DDPG, extends DDPG into a multi-agent policy gradient algorithm where decentralized agents learn a…

Similar Papers 제목 키워드 기반

Deep Reinforcement Learning-Aided RAN Slicing Enforcement for B5G Latency Sensitive Services

2021-03-18 · Sergio Martiradonna, Andrea Abrardo, Marco Moretti, Giuseppe Piro 외

The combination of cloud computing capabilities at the network edge and artificial intelligence promise to turn future mobile networks into service- and radio-aware entities, able to address the requirements of upcoming …

Autonomous DrivingCloud ComputingDeep Reinforcement LearningManagement+2

Deep Reinforcement Learning for Resource Management in Network Slicing

2018-05-17 · Rongpeng Li, Zhifeng Zhao, Qi Sun, Chi-Lin I 외

Network slicing is born as an emerging business to operators, by allowing them to sell the customized slices to various tenants at different prices. In order to provide better-performing and cost-efficient services, netw…

Deep Reinforcement LearningManagementreinforcement-learningReinforcement Learning+1

Machine Learning for Network Slicing Resource Management: A Comprehensive Survey

2020-01-22 · Bin Han, Hans D. Schotten

The emerging technology of multi-tenancy network slicing is considered as an essential feature of 5G cellular networks. It provides network slices as a new type of public cloud services, and therewith increases the servi…

BIG-bench Machine LearningManagementSurvey

Deep Reinforcement Learning for Adaptive Network Slicing in 5G for Intelligent Vehicular Systems and Smart Cities

2020-10-19 · Almuthanna Nassar, Yasin Yilmaz

Intelligent vehicular systems and smart city applications are the fastest growing Internet of things (IoT) implementations at a compound annual growth rate of 30%. In view of the recent advances in IoT devices and the em…

Deep Reinforcement Learning

CLARA: A Constrained Reinforcement Learning Based Resource Allocation Framework for Network Slicing

2021-11-16 · Yongshuai Liu, Jiaxin Ding, Zhi-Li Zhang, Xin Liu

As mobile networks proliferate, we are experiencing a strong diversification of services, which requires greater flexibility from the existing network. Network slicing is proposed as a promising solution for resource uti…

Managementreinforcement-learningReinforcement Learning (RL)