Data Centers Job Scheduling with Deep Reinforcement Learning

2019-09-16 · Sisheng Liang, Zhou Yang, Fang Jin, Yong Chen

Efficient job scheduling on data centers under heterogeneous complexity is crucial but challenging since it involves the allocation of multi-dimensional resources over time and space. To adapt the complex computing environment in data centers, we proposed an innovative Advantage Actor-Critic (A2C) deep reinforcement learning based approach called A2cScheduler for job scheduling. A2cScheduler consists of two agents, one of which, dubbed the actor, is responsible for learning the scheduling policy automatically and the other one, the critic, reduces the estimation error. Unlike previous policy gradient approaches, A2cScheduler is designed to reduce the gradient estimation variance and to update parameters efficiently. We show that the A2cScheduler can achieve competitive scheduling performance using both simulated workloads and real data collected from an academic data center.

📄 PDF Abstract BibTeX arXiv:1909.07820

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement Learningreinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Scheduling

Sustainable AIGC Workload Scheduling of Geo-Distributed Data Centers: A Multi-Agent Reinforcement Learning Approach

2023-04-17 · Siyue Zhang, Minrui Xu, Wei Yang Bryan Lim, Dusit Niyato

Recent breakthroughs in generative artificial intelligence have triggered a surge in demand for machine learning training, which poses significant cost burdens and environmental challenges due to its substantial energy c…

GPU Multi-agent Reinforcement Learning Scheduling

Job Scheduling in Datacenters using Constraint Controlled RL

2022-11-10 · Vanamala Venkataswamy

This paper studies a model for online job scheduling in green datacenters. In green datacenters, resource availability depends on the power supply from the renewables. Intermittent power supply from renewables leads to i…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning (RL)Scheduling

Inductive-bias-driven Reinforcement Learning For Efficient Schedules in Heterogeneous Clusters

2019-09-04 · Subho S. Banerjee, Saurabh Jha, Zbigniew T. Kalbarczyk, Ravishankar K. Iyer

The problem of scheduling of workloads onto heterogeneous processors (e.g., CPUs, GPUs, FPGAs) is of fundamental importance in modern data centers. Current system schedulers rely on application/system-specific heuristics…

Heuristic Search Inductive Bias reinforcement-learning Reinforcement Learning+2

RARE: Renewable Energy Aware Resource Management in Datacenters

2022-11-10 · Vanamala Venkataswamy, Jake Grigsby, Andrew Grimshaw, Yanjun Qi

The exponential growth in demand for digital services drives massive datacenter energy consumption and negative environmental impacts. Promoting sustainable solutions to pressing energy and digital infrastructure challen…

Deep Reinforcement Learning Management Scheduling

Inductive Bias-driven Reinforcement Learning For Efficient Schedules in Heterogeneous Clusters

2020-01-01 · ICML 2020 1 · Subho Banerjee, Saurabh Jha, Zbigniew Kalbarczyk, Ravishankar Iyer

The problem of scheduling of workloads onto heterogeneous processors (e.g., CPUs, GPUs, FPGAs) is of fundamental importance in modern datacenters. Current system schedulers rely on application/system-specific heuristics …

Heuristic Search Inductive Bias reinforcement-learning Reinforcement Learning (RL)+1