Tailored Learning-Based Scheduling for Kubernetes-Oriented Edge-Cloud System

2021-01-17 · Yiwen Han, Shihao Shen, Xiaofei Wang, Shiqiang Wang, Victor C. M. Leung

Kubernetes (k8s) has the potential to merge the distributed edge and the cloud but lacks a scheduling framework specifically for edge-cloud systems. Besides, the hierarchical distribution of heterogeneous resources and the complex dependencies among requests and resources make the modeling and scheduling of k8s-oriented edge-cloud systems particularly sophisticated. In this paper, we introduce KaiS, a learning-based scheduling framework for such edge-cloud systems to improve the long-term throughput rate of request processing. First, we design a coordinated multi-agent actor-critic algorithm to cater to decentralized request dispatch and dynamic dispatch spaces within the edge cluster. Second, for diverse system scales and structures, we use graph neural networks to embed system state information, and combine the embedding results with multiple policy networks to reduce the orchestration dimensionality by stepwise scheduling. Finally, we adopt a two-time-scale scheduling mechanism to harmonize request dispatch and service orchestration, and present the implementation design of deploying the above algorithms compatible with native k8s components. Experiments using real workload traces show that KaiS can successfully learn appropriate scheduling policies, irrespective of request arrival patterns and system scales. Moreover, KaiS can enhance the average system throughput rate by 14.3% while reducing scheduling cost by 34.7% compared to baselines.

📄 PDF Abstract BibTeX arXiv:2101.06582

Code (0)

등록된 구현이 없습니다.

Tasks

Scheduling

Methods 이 논문이 사용한 방법론

Golden Queue Managers 설명 없음

Design and Implementation of an Automated Disaster-recovery System for a Kubernetes Cluster Using LSTM

2024-02-05 · Ji-Beom Kim, Je-Bum Choi, Eun-Sung Jung

With the increasing importance of data in the modern business environment, effective data man-agement and protection strategies are gaining increasing research attention. Data protection in a cloud environment is crucial…

CPU Management Scheduling

Enhancing Kubernetes Automated Scheduling with Deep Learning and Reinforcement Techniques for Large-Scale Cloud Computing Optimization

2024-02-26 · Zheng Xu, Yulu Gong, Yanlin Zhou, Qiaozhi Bao 외

With the continuous expansion of the scale of cloud computing applications, artificial intelligence technologies such as Deep Learning and Reinforcement Learning have gradually become the key tools to solve the automated…

Cloud Computing Deep Learning reinforcement-learning Reinforcement Learning+1

ELIS: Efficient LLM Iterative Scheduling System with Response Length Predictor

2025-05-14 · Seungbeom Choi, Jeonghoe Goo, Eunjoo Jeon, Mingyu Yang 외

We propose ELIS, a serving system for Large Language Models (LLMs) featuring an Iterative Shortest Remaining Time First (ISRTF) scheduler designed to efficiently manage inference tasks with the shortest remaining tokens.…

Blocking Scheduling

Multi-tenant Kubernetes Use Cases for AI, Secure Computing and Data Services, and More

2026-08-01 · Jake Watson, Sadaf R Alam, Christopher Woods, Abdelwahab Kawafi 외 arxiv

Kubernetes, as a container orchestration engine, has been widely used in cloud-native ecosystems for several years. In supercomputing ecosystems, especially where bare-metal performance for compute and network devices ar…

Agentic-Kube: A Graph-Enhanced Multi-Agent Reinforcement Learning Framework for Multi-Objective Kubernetes Scheduling

2026-03-12 · Hamed Hamzeh arxiv

Cloud-native container orchestration requires resource schedulers capable of balancing infrastructure expenditure, fault resilience, and node utilisation. Conventional reinforcement learning approaches typically rely on …

Multi-agent Reinforcement Learning Graph Neural Network