MSDF: A Deep Reinforcement Learning Framework for Service Function Chain Migration

2019-11-12 · Ruoyun Chen, Hancheng Lu, Yujiao Lu, Jinxue Liu

Under dynamic traffic, service function chain (SFC) migration is considered as an effective way to improve resource utilization. However, the lack of future network information leads to non-optimal solutions, which motivates us to study reinforcement learning based SFC migration from a long-term perspective. In this paper, we formulate the SFC migration problem as a minimization problem with the objective of total network operation cost under constraints of users' quality of service. We firstly design a deep Q-network based algorithm to solve single SFC migration problem, which can adjust migration strategy online without knowing future information. Further, a novel multi-agent cooperative framework, called MSDF, is proposed to address the challenge of considering multiple SFC migration on the basis of single SFC migration. MSDF reduces the complexity thus accelerates the convergence speed, especially in large scale networks. Experimental results demonstrate that MSDF outperforms typical heuristic algorithms under various scenarios.

📄 PDF Abstract BibTeX arXiv:1911.04801

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement Learningreinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

MSDF: A General Open-Domain Multi-Skill Dialog Framework

2022-06-17 · Yu Zhao, Xinshuo Hu, Yunxin Li, Baotian Hu 외

Dialog systems have achieved significant progress and have been widely used in various scenarios. The previous researches mainly focused on designing dialog generation models in a single scenario, while comprehensive abi…

Decoder

Reinforcement Learning based QoS/QoE-aware Service Function Chaining in Software-Driven 5G Slices

2018-04-06 · Xi Chen, Zonghang Li, Yupeng Zhang, Ruiming Long 외

With the ever growing diversity of devices and applications that will be connected to 5G networks, flexible and agile service orchestration with acknowledged QoE that satisfies end-user's functional and QoS requirements …

Diversity Reinforcement Learning

SDFit: 3D Object Pose and Shape by Fitting a Morphable SDF to a Single Image

2024-09-24 · Dimitrije Antić, Sai Kumar Dwivedi, Shashank Tripathi, Theo Gevers 외

We focus on recovering 3D object pose and shape from single images. This is highly challenging due to strong (self-)occlusions, depth ambiguities, the enormous shape variance, and lack of 3D ground truth for natural imag…

MSDformer: Multi-scale Discrete Transformer For Time Series Generation

2025-05-20 · Zhicheng Chen, Shibo Feng, Xi Xiao, Zhong Zhang 외

Discrete Token Modeling (DTM), which employs vector quantization techniques, has demonstrated remarkable success in modeling non-natural language modalities, particularly in time series generation. While our prior work S…

Model Optimization Time Series Time Series Generation

Reinforcement Learning of Graph Neural Networks for Service Function Chaining

2020-11-17 · DongNyeong Heo, Doyoung Lee, Hee-Gon Kim, Suhyun Park 외

In the management of computer network systems, the service function chaining (SFC) modules play an important role by generating efficient paths for network traffic through physical servers with virtualized network functi…

Management reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+1