paper-with-me

홈 › Papers

Towards Accurate Prediction for High-Dimensional and Highly-Variable Cloud Workloads with Deep Learning

2020-04-01 · Zheyi Chen, Jia Hu, Geyong Min, Albert Y. Zomaya, Tarek El-Ghazawi

Resource provisioning for cloud computing necessitates the adaptive and accurate prediction of cloud workloads. However, the existing methods cannot effectively predict the high-dimensional and highly-variable cloud workloads. This results in resource wasting and inability to satisfy service level agreements (SLAs). Since recurrent neural network (RNN) is naturally suitable for sequential data analysis, it has been recently used to tackle the problem of workload prediction. However, RNN often performs poorly on learning long-term memory dependencies, and thus cannot make the accurate prediction of workloads. To address these important challenges, we propose a deep Learning based Prediction Algorithm for cloud Workloads (L-PAW). First, a top-sparse auto-encoder (TSA) is designed to effectively extract the essential representations of workloads from the original high-dimensional workload data. Next, we integrate TSA and gated recurrent unit (GRU) block into RNN to achieve the adaptive and accurate prediction for highly-variable workloads. Using real-world workload traces from Google and Alibaba cloud data centers and the DUX-based cluster, extensive experiments are conducted to demonstrate the effectiveness and adaptability of the L-PAW for different types of workloads with various prediction lengths. Moreover, the performance results show that the L-PAW achieves superior prediction accuracy compared to the classic RNN-based and other workload prediction methods for high-dimensional and highly-variable real-world cloud workloads.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Cloud ComputingPrediction

Similar Papers 제목 키워드 기반

Multiple split approach -- multidimensional probabilistic forecasting of electricity markets

2024-07-10 · Katarzyna Maciejowska, Weronika Nitka

In this article, a multiple split method is proposed that enables construction of multidimensional probabilistic forecasts of a selected set of variables. The method uses repeated resampling to estimate uncertainty of si…

Time Series Prediction by Multi-task GPR with Spatiotemporal Information Transformation

2022-04-26 · Peng Tao, Xiaohu Hao, Jie Cheng, Luonan Chen

Making an accurate prediction of an unknown system only from a short-term time series is difficult due to the lack of sufficient information, especially in a multi-step-ahead manner. However, a high-dimensional short-ter…

GPRPredictionTime SeriesTime Series Analysis+1

Modeling Rare Interactions in Time Series Data Through Qualitative Change: Application to Outcome Prediction in Intensive Care Units

2020-04-03 · Zina Ibrahim, Honghan Wu, Richard Dobson

Many areas of research are characterised by the deluge of large-scale highly-dimensional time-series data. However, using the data available for prediction and decision making is hampered by the current lag in our abilit…

Decision MakingTime SeriesTime Series Analysis

Information-Theoretic Bounds and Approximations in Neural Population Coding

2016-11-04 · Wentao Huang, Kechen Zhang

While Shannon's mutual information has widespread applications in many disciplines, for practical applications it is often difficult to calculate its value accurately for high-dimensional variables because of the curse o…

Dimensionality Reductionvalid

From field-scale to large-scale spectral libraries: Tabular foundation models in soil spectroscopy

2026-08-01 · Viacheslav Barkov, Jonas Schmidinger, Robin Gebbers, Martin Atzmueller arxiv

Visible and near-infrared (vis-NIR) and mid-infrared (MIR) spectroscopy enable rapid, cost-effective prediction of soil properties. Yet, translating high-dimensional, highly collinear spectra into accurate soil property …

Dimensionality Reduction