PROMPT: Learning Dynamic Resource Allocation Policies for Network Applications
A growing number of service providers are exploring methods to improve server utilization and reduce power consumption by co-scheduling high-priority latency-critical workloads with best-effort workloads. This practice requires strict resource allocation between workloads to reduce contention and maintain Quality-of-Service (QoS) guarantees. Prior work demonstrated promising opportunities to dynamically allocate resources based on workload demand, but may fail to meet QoS objectives in more stringent operating environments due to the presence of resource allocation cliffs, transient fluctuations in workload performance, and rapidly changing resource demand. We therefore propose PROMPT, a novel resource allocation framework using proactive QoS prediction to guide a reinforcement learning controller. PROMPT enables more precise resource optimization, more consistent handling of transient behaviors, and more robust generalization when co-scheduling new best-effort workloads not encountered during policy training. Evaluation shows that the proposed method incurs 4.2x fewer QoS violations, reduces severity of QoS violations by 12.7x, improves best-effort workload performance, and improves overall power efficiency over prior work.
Code (0)
등록된 구현이 없습니다.
Tasks
Prompt LearningSchedulingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Optimal Resource Allocation in Wireless Control Systems via Deep Policy Gradient
In wireless control systems, remote control of plants is achieved through closing of the control loop over a wireless channel. As wireless communication is noisy and subject to packet dropouts, proper allocation of limit…
Deep Reinforcement LearningPolicy Gradient MethodsStable and Transferable Wireless Resource Allocation Policies via Manifold Neural Networks
We consider the problem of resource allocation in large scale wireless networks. When contextualizing wireless network structures as graphs, we can model the limits of very large wireless systems as manifolds. To solve t…
Deep Reinforcement Learning Based Resource Allocation for Cloud Native Wireless Network
Cloud native technology has revolutionized 5G beyond and 6G communication networks, offering unprecedented levels of operational automation, flexibility, and adaptability. However, the vast array of cloud native services…
Cloud ComputingDeep Reinforcement LearningEdge-computingreinforcement-learningOff-Policy Evaluation and Counterfactual Methods in Dynamic Auction Environments
Counterfactual estimators are critical for learning and refining policies using logged data, a process known as Off-Policy Evaluation (OPE). OPE allows researchers to assess new policies without costly experiments, speed…
counterfactualDecision MakingOff-policy evaluationAllSim: Simulating and Benchmarking Resource Allocation Policies in Multi-User Systems
Numerous real-world systems, ranging from healthcare to energy grids, involve users competing for finite and potentially scarce resources. Designing policies for resource allocation in such real-world systems is challeng…