paper-with-me

Papers

One for All: Unified Workload Prediction for Dynamic Multi-tenant Edge Cloud Platforms

2023-06-02 · Shaoyuan Huang, Zheng Wang, Heng Zhang, Xiaofei Wang, Cheng Zhang, Wenyu Wang

Workload prediction in multi-tenant edge cloud platforms (MT-ECP) is vital for efficient application deployment and resource provisioning. However, the heterogeneous application patterns, variable infrastructure performance, and frequent deployments in MT-ECP pose significant challenges for accurate and efficient workload prediction. Clustering-based methods for dynamic MT-ECP modeling often incur excessive costs due to the need to maintain numerous data clusters and models, which leads to excessive costs. Existing end-to-end time series prediction methods are challenging to provide consistent prediction performance in dynamic MT-ECP. In this paper, we propose an end-to-end framework with global pooling and static content awareness, DynEformer, to provide a unified workload prediction scheme for dynamic MT-ECP. Meticulously designed global pooling and information merging mechanisms can effectively identify and utilize global application patterns to drive local workload predictions. The integration of static content-aware mechanisms enhances model robustness in real-world scenarios. Through experiments on five real-world datasets, DynEformer achieved state-of-the-art in the dynamic scene of MT-ECP and provided a unified end-to-end prediction scheme for MT-ECP.

📄 PDF Abstract BibTeX arXiv:2306.01507

Code (1)

hsy23/kdd23_dyneformer 공식 구현 pytorch

Tasks

AllPredictionTime SeriesTime Series Prediction

Similar Papers 제목 키워드 기반

JoyNexus: Service-Oriented Multi-Tenant Post-Training for VLA Models

2026-07-17 · Haoran Sun, Wentao Zhang, Junyang Hua, Hedan Yang 외 arxiv

The post-training of Vision-Language-Action (VLA) models is essential due to the diversity of simulators, robot embodiments, and task objectives. Existing compute services, whether offered as direct accelerator rental or…

Reinforcement Learning

Resource Sharing for Multi-Tenant NoSQL Data Store in Cloud

2016-01-05 · Jiaan Zeng

Multi-tenancy hosting of users in cloud NoSQL data stores is favored by cloud providers because it enables resource sharing at low operating cost. Multi-tenancy takes several forms depending on whether the back-end file …

Scheduling

DriftSched: Adaptive QoS-Aware Scheduling under Runtime Token Drift for Multi-Tenant GPU Inference

2026-06-02 · Kathiravan Palaniappan arxiv

The rapid growth of large language model (LLM) inference services has increased the demand for efficient multi-tenant GPU scheduling. While modern inference runtimes such as vLLM improve throughput through continuous bat…

Perseus: Characterizing Performance and Cost of Multi-Tenant Serving for CNN Models

2019-12-05 · Matthew LeMay, Shijian Li, Tian Guo

Deep learning models are increasingly used for end-user applications, supporting both novel features such as facial recognition, and traditional features, e.g. web search. To accommodate high inference throughput, it is …

CPU

A Simulation Platform for Multi-tenant Machine Learning Services on Thousands of GPUs

2022-01-10 · Ruofan Liang, Bingsheng He, Shengen Yan, Peng Sun

Multi-tenant machine learning services have become emerging data-intensive workloads in data centers with heavy usage of GPU resources. Due to the large scale, many tuning parameters and heavy resource usage, it is usual…

BIG-bench Machine LearningGPUScheduling