On Modeling Network Slicing Communication Resources with SARSA Optimization

2023-01-11 · Eduardo S. Xavier, Nazim Agoulmine, Joberto S. B. Martins

Network slicing is a crucial enabler to support the composition and deployment of virtual network infrastructures required by the dynamic behavior of networks like 5G/6G mobile networks, IoT-aware networks, e-health systems, and industry verticals like the internet of vehicles (IoV) and industry 4.0. The communication slices and their allocated communication resources are essential in slicing architectures for resource orchestration and allocation, virtual network function (VNF) deployment, and slice operation functionalities. The communication slices provide the communications capabilities required to support slice operation, SLA guarantees, and QoS/ QoE application requirements. Therefore, this contribution proposes a networking slicing conceptual model to formulate the optimization problem related to the sharing of communication resources among communication slices. First, we present a conceptual model of network slicing, we then formulate analytically some aspects of the model and the optimization problem to address. Next, we proposed to use a SARSA agent to solve the problem and implement a proof of concept prototype. Finally, we present the obtained results and discuss them.

📄 PDF Abstract BibTeX arXiv:2301.04696

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Sarsa Sarsa is an on-policy TD control algorithm: $$Q\left(S\_{t}, A\_{t}\right) \leftarrow Q\left(S\_{t}, A\_{t}\right) + \alpha\left[R_{t+1} + \gamma{Q}\left(S\_{t+1},…

Reinforcement Learning for Dynamic Resource Optimization in 5G Radio Access Network Slicing

2020-09-14 · Yi Shi, Yalin E. Sagduyu, Tugba Erpek

The paper presents a reinforcement learning solution to dynamic resource allocation for 5G radio access network slicing. Available communication resources (frequency-time blocks and transmit powers) and computational res…

Q-Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

DeepSlicing: Deep Reinforcement Learning Assisted Resource Allocation for Network Slicing

2020-08-17 · Qiang Liu, Tao Han, Ning Zhang, Ye Wang

Network slicing enables multiple virtual networks run on the same physical infrastructure to support various use cases in 5G and beyond. These use cases, however, have very diverse network resource demands, e.g., communi…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Network Slicing for eMBB and mMTC with NOMA and Space Diversity Reception

2021-01-13 · Eduardo Noboro Tominaga, Hirley Alves, Onel Luiz Alcaraz López, Richard Demo Souza 외

In this work we study the coexistence in the same Radio Access Network (RAN) of two generic services present in the Fifth Generation (5G) of wireless communication systems: enhanced Mobile BroadBand (eMBB) and massive Ma…

Diversity

Enhanced Pub/Sub Communications for Massive IoT Traffic with SARSA Reinforcement Learning

2021-01-03 · Carlos E. Arruda, Pedro F. Moraes, Nazim Agoulmine, Joberto S. B. Martins

Sensors are being extensively deployed and are expected to expand at significant rates in the coming years. They typically generate a large volume of data on the internet of things (IoT) application areas like smart citi…

reinforcement-learning Reinforcement Learning (RL)

Adaptive Resource Management for Edge Network Slicing using Incremental Multi-Agent Deep Reinforcement Learning

2023-10-26 · Haiyuan Li, Yuelin Liu, Xueqing Zhou, Xenofon Vasilakos 외

Multi-access edge computing provides local resources in mobile networks as the essential means for meeting the demands of emerging ultra-reliable low-latency communications. At the edge, dynamic computing requests requir…

Deep Reinforcement Learning Edge-computing Incremental Learning Management+1