paper-with-me

Papers

Wasserstein Adversarial Transformer for Cloud Workload Prediction

2022-03-12 · Shivani Arbat, Vinodh Kumaran Jayakumar, Jaewoo Lee, Wei Wang, In Kee Kim

Predictive Virtual Machine (VM) auto-scaling is a promising technique to optimize cloud applications operating costs and performance. Understanding the job arrival rate is crucial for accurately predicting future changes in cloud workloads and proactively provisioning and de-provisioning VMs for hosting the applications. However, developing a model that accurately predicts cloud workload changes is extremely challenging due to the dynamic nature of cloud workloads. Long-Short-Term-Memory (LSTM) models have been developed for cloud workload prediction. Unfortunately, the state-of-the-art LSTM model leverages recurrences to predict, which naturally adds complexity and increases the inference overhead as input sequences grow longer. To develop a cloud workload prediction model with high accuracy and low inference overhead, this work presents a novel time-series forecasting model called WGAN-gp Transformer, inspired by the Transformer network and improved Wasserstein-GANs. The proposed method adopts a Transformer network as a generator and a multi-layer perceptron as a critic. The extensive evaluations with real-world workload traces show WGAN-gp Transformer achieves 5 times faster inference time with up to 5.1 percent higher prediction accuracy against the state-of-the-art approach. We also apply WGAN-gp Transformer to auto-scaling mechanisms on Google cloud platforms, and the WGAN-gp Transformer-based auto-scaling mechanism outperforms the LSTM-based mechanism by significantly reducing VM over-provisioning and under-provisioning rates.

📄 PDF Abstract BibTeX arXiv:2203.06501

Code (1)

shivaniarbat/wgan-gp-transformer 공식 구현 pytorch

Tasks

PredictionTime SeriesTime Series AnalysisTime Series Forecasting

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Tanh Activation 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Residual Connection 설명 없음
Sigmoid Activation 설명 없음

Similar Papers 제목 키워드 기반

Towards Accurate Prediction for High-Dimensional and Highly-Variable Cloud Workloads with Deep Learning

2020-04-01 · Zheyi Chen, Jia Hu, Geyong Min, Albert Y. Zomaya 외

Resource provisioning for cloud computing necessitates the adaptive and accurate prediction of cloud workloads. However, the existing methods cannot effectively predict the high-dimensional and highly-variable cloud work…

Cloud ComputingPrediction

CloudFormer: An Attention-based Performance Prediction for Public Clouds with Unknown Workload

2025-09-03 · Amirhossein Shahbazinia, Darong Huang, Luis Costero, David Atienza arxiv

Cloud platforms are increasingly relied upon to host diverse, resource-intensive workloads due to their scalability, flexibility, and cost-efficiency. In multi-tenant cloud environments, virtual machines are consolidated…

CWD: A Machine Learning based Approach to Detect Unknown Cloud Workloads

2022-11-28 · Mohammad Hossain, Derssie Mebratu, Niranjan Hasabnis, Jun Jin 외

Workloads in modern cloud data centers are becoming increasingly complex. The number of workloads running in cloud data centers has been growing exponentially for the last few years, and cloud service providers (CSP) hav…

CPU

Fremer: Lightweight and Effective Frequency Transformer for Workload Forecasting in Cloud Services

2025-07-17 · Jiadong Chen, Hengyu Ye, Fuxin Jiang, Xiao He 외

Workload forecasting is pivotal in cloud service applications, such as auto-scaling and scheduling, with profound implications for operational efficiency. Although Transformer-based forecasting models have demonstrated r…

Computational EfficiencyScheduling

PePNet: A Periodicity-Perceived Workload Prediction Network Supporting Rare Occurrence of Heavy Workload

2023-07-11 · Feiyi Chen, Zhen Qin, Hailiang Zhao, Shuiguang Deng

Cloud providers can greatly benefit from accurate workload prediction. However, the workload of cloud servers is highly variable, with occasional heavy workload bursts. This makes workload prediction challenging. There a…

Prediction