Using Reinforcement Learning to Allocate and Manage Service Function Chains in Cellular Networks
It is expected that the next generation cellular networks provide a connected society with fully mobility to empower the socio-economic transformation. Several other technologies will benefits of this evolution, such as Internet of Things, smart cities, smart agriculture, vehicular networks, healthcare applications, and so on. Each of these scenarios presents specific requirements and demands different network configurations. To deal with this heterogeneity, virtualization technology is key technology. Indeed, the network function virtualization (NFV) paradigm provides flexibility for the network manager, allocating resources according to the demand, and reduces acquisition and operational costs. In addition, it is possible to specify an ordered set of network virtual functions (VNFs) for a given service, which is called as service function chain (SFC). However, besides the advantages from service virtualization, it is expected that network performance and availability do not be affected by its usage. In this paper, we propose the use of reinforcement learning to deploy a SFC of cellular network service and manage the VNFs operation. We consider that the SFC is deployed by the reinforcement learning agent considering a scenarios with distributed data centers, where the VNFs are deployed in virtual machines in commodity servers. The NFV management is related to create, delete, and restart the VNFs. The main purpose is to reduce the number of lost packets taking into account the energy consumption of the servers. We use the Proximal Policy Optimization (PPO) algorithm to implement the agent and preliminary results show that the agent is able to allocate the SFC and manage the VNFs, reducing the number of lost packets.
Code (0)
등록된 구현이 없습니다.
Tasks
Managementreinforcement-learningReinforcement Learning (RL)Similar Papers 제목 키워드 기반
Optimal service resource management strategy for IoT-based health information system considering value co-creation of users
This paper explores optimal service resource management strategy, a continuous challenge for health information service to enhance service performance, optimise service resource utilisation and deliver interactive health…
Deep Reinforcement LearningManagementA Framework for dynamically meeting performance objectives on a service mesh
We present a framework for achieving end-to-end management objectives for multiple services that concurrently execute on a service mesh. We apply reinforcement learning (RL) techniques to train an agent that periodically…
ManagementReinforcement Learning (RL)Deep Reinforcement Learning with Discrete Normalized Advantage Functions for Resource Management in Network Slicing
Network slicing promises to provision diversified services with distinct requirements in one infrastructure. Deep reinforcement learning (e.g., deep $\mathcal{Q}$-learning, DQL) is assumed to be an appropriate algorithm …
Deep Reinforcement LearningManagementQ-LearningReinforcement Learning+2GAN-powered Deep Distributional Reinforcement Learning for Resource Management in Network Slicing
Network slicing is a key technology in 5G communications system. Its purpose is to dynamically and efficiently allocate resources for diversified services with distinct requirements over a common underlying physical infr…
Deep Reinforcement LearningDistributional Reinforcement LearningGenerative Adversarial NetworkManagement+3Dynamic Resource Allocation for Metaverse Applications with Deep Reinforcement Learning
This work proposes a novel framework to dynamically and effectively manage and allocate different types of resources for Metaverse applications, which are forecasted to demand massive resources of various types that have…
Deep Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)