Robust Load Prediction of Power Network Clusters Based on Cloud-Model-Improved Transformer

2024-07-30 · Cheng Jiang, Gang Lu, Xue Ma, Di wu

Load data from power network clusters indicates economic development in each area, crucial for predicting regional trends and guiding power enterprise decisions. The Transformer model, a leading method for load prediction, faces challenges modeling historical data due to variables like weather, events, festivals, and data volatility. To tackle this, the cloud model's fuzzy feature is utilized to manage uncertainties effectively. Presenting an innovative approach, the Cloud Model Improved Transformer (CMIT) method integrates the Transformer model with the cloud model utilizing the particle swarm optimization algorithm, with the aim of achieving robust and precise power load predictions. Through comparative experiments conducted on 31 real datasets within a power network cluster, it is demonstrated that CMIT significantly surpasses the Transformer model in terms of prediction accuracy, thereby highlighting its effectiveness in enhancing forecasting capabilities within the power network cluster sector.

📄 PDF Abstract BibTeX arXiv:2407.20817

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Attention 설명 없음

Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…

Adam 설명 없음

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…

Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Position-Wise Feed-Forward Layer 설명 없음

The MIT Supercloud Dataset

2021-08-04 · Siddharth Samsi, Matthew L Weiss, David Bestor, Baolin Li 외

Artificial intelligence (AI) and Machine learning (ML) workloads are an increasingly larger share of the compute workloads in traditional High-Performance Computing (HPC) centers and commercial cloud systems. This has le…

CPU GPU Scheduling

TAPAS: Thermal- and Power-Aware Scheduling for LLM Inference in Cloud Platforms

2025-01-05 · Jovan Stojkovic, Chaojie Zhang, Íñigo Goiri, Esha Choukse 외

The rising demand for generative large language models (LLMs) poses challenges for thermal and power management in cloud datacenters. Traditional techniques often are inadequate for LLM inference due to the fine-grained,…

GPU Quantization Scheduling

POLCA: Power Oversubscription in LLM Cloud Providers

2023-08-24 · Pratyush Patel, Esha Choukse, Chaojie Zhang, Íñigo Goiri 외

Recent innovation in large language models (LLMs), and their myriad use-cases have rapidly driven up the compute capacity demand for datacenter GPUs. Several cloud providers and other enterprises have made substantial pl…

GPU

One for All: Unified Workload Prediction for Dynamic Multi-tenant Edge Cloud Platforms

2023-06-02 · Shaoyuan Huang, Zheng Wang, Heng Zhang, Xiaofei Wang 외

Workload prediction in multi-tenant edge cloud platforms (MT-ECP) is vital for efficient application deployment and resource provisioning. However, the heterogeneous application patterns, variable infrastructure performa…

All Prediction Time Series Time Series Prediction

Wasserstein Adversarial Transformer for Cloud Workload Prediction

2022-03-12 · Shivani Arbat, Vinodh Kumaran Jayakumar, Jaewoo Lee, Wei Wang 외

Predictive Virtual Machine (VM) auto-scaling is a promising technique to optimize cloud applications operating costs and performance. Understanding the job arrival rate is crucial for accurately predicting future changes…

Prediction Time Series Time Series Analysis Time Series Forecasting