Finding Optimal Policy for Queueing Models: New Parameterization
Queueing systems appear in many important real-life applications including communication networks, transportation and manufacturing systems. Reinforcement learning (RL) framework is a suitable model for the queueing control problem where the underlying dynamics are usually unknown and the agent receives little information from the environment to navigate. In this work, we investigate the optimization aspects of the queueing model as a RL environment and provide insight to learn the optimal policy efficiently. We propose a new parameterization of the policy by using the intrinsic properties of queueing network systems. Experiments show good performance of our methods with various load conditions from light to heavy traffic.
Code (0)
등록된 구현이 없습니다.
Tasks
Navigatereinforcement-learningReinforcement Learning (RL)Similar Papers 제목 키워드 기반
Efficient Reinforcement Learning for Routing Jobs in Heterogeneous Queueing Systems
We consider the problem of efficiently routing jobs that arrive into a central queue to a system of heterogeneous servers. Unlike homogeneous systems, a threshold policy, that routes jobs to the slow server(s) when the q…
reinforcement-learningReinforcement LearningReinforcement Learning (RL)RL-QN: A Reinforcement Learning Framework for Optimal Control of Queueing Systems
With the rapid advance of information technology, network systems have become increasingly complex and hence the underlying system dynamics are often unknown or difficult to characterize. Finding a good network control p…
Model-based Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)Queue Length Regret Bounds for Contextual Queueing Bandits
We introduce contextual queueing bandits, a new context-aware framework for scheduling while simultaneously learning unknown service rates. Individual jobs carry heterogeneous contextual features, based on which the agen…
Learning Optimal Admission Control in Partially Observable Queueing Networks
We present an efficient reinforcement learning algorithm that learns the optimal admission control policy in a partially observable queueing network. Specifically, only the arrival and departure times from the network ar…
reinforcement-learningReinforcement LearningOptimal Control of Multiclass Fluid Queueing Networks: A Machine Learning Approach
We propose a machine learning approach to the optimal control of multiclass fluid queueing networks (MFQNETs) that provides explicit and insightful control policies. We prove that a threshold type optimal policy exists f…