paper-with-me

홈 › Papers

Fast-Powerformer: A Memory-Efficient Transformer for Accurate Mid-Term Wind Power Forecasting

2025-04-15 · Mingyi Zhu, Zhaoxin Li, Qiao Lin, Li Ding

Wind power forecasting (WPF), as a significant research topic within renewable energy, plays a crucial role in enhancing the security, stability, and economic operation of power grids. However, due to the high stochasticity of meteorological factors (e.g., wind speed) and significant fluctuations in wind power output, mid-term wind power forecasting faces a dual challenge of maintaining high accuracy and computational efficiency. To address these issues, this paper proposes an efficient and lightweight mid-term wind power forecasting model, termed Fast-Powerformer. The proposed model is built upon the Reformer architecture, incorporating structural enhancements such as a lightweight Long Short-Term Memory (LSTM) embedding module, an input transposition mechanism, and a Frequency Enhanced Channel Attention Mechanism (FECAM). These improvements enable the model to strengthen temporal feature extraction, optimize dependency modeling across variables, significantly reduce computational complexity, and enhance sensitivity to periodic patterns and dominant frequency components. Experimental results conducted on multiple real-world wind farm datasets demonstrate that the proposed Fast-Powerformer achieves superior prediction accuracy and operational efficiency compared to mainstream forecasting approaches. Furthermore, the model exhibits fast inference speed and low memory consumption, highlighting its considerable practical value for real-world deployment scenarios.

📄 PDF Abstract BibTeX arXiv:2504.10923

Code (0)

등록된 구현이 없습니다.

Tasks

Computational Efficiency

Methods 이 논문이 사용한 방법론

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Attention 설명 없음
1x1 Convolution A 1 x 1 Convolution is a convolution with some special properties in that it can be used for dimensionality reduction,…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Reversible Residual Block 설명 없음

Similar Papers 제목 키워드 기반

Powerformer: A Transformer with Weighted Causal Attention for Time-series Forecasting

2025-02-10 · Kareem Hegazy, Michael W. Mahoney, N. Benjamin Erichson

Transformers have recently shown strong performance in time-series forecasting, but their all-to-all attention mechanism overlooks the (temporal) causal and often (temporally) local nature of data. We introduce Powerform…

Inductive BiasTime SeriesTime Series Forecasting

Powerformer: A Section-adaptive Transformer for Power Flow Adjustment

2024-01-05 · KaiXuan Chen, Wei Luo, Shunyu Liu, Yaoquan Wei 외

In this paper, we present a novel transformer architecture tailored for learning robust power system state representations, which strives to optimize power dispatch for the power flow adjustment across different transmis…

Graph Neural Network

An Efficient Memory-Augmented Transformer for Knowledge-Intensive NLP Tasks

2022-10-30 · Yuxiang Wu, Yu Zhao, Baotian Hu, Pasquale Minervini 외

Access to external knowledge is essential for many natural language processing tasks, such as question answering and dialogue. Existing methods often rely on a parametric model that stores knowledge in its parameters, or…

Computational EfficiencyQuestion AnsweringRetrieval

Titans: Learning to Memorize at Test Time

2024-12-31 · Ali Behrouz, Peilin Zhong, Vahab Mirrokni

Over more than a decade there has been an extensive research effort on how to effectively utilize recurrent models and attention. While recurrent models aim to compress the data into a fixed-size memory (called hidden st…

Common Sense ReasoningLanguage ModelingLanguage Modelling

SOTFormer: A Minimal Transformer for Unified Object Tracking and Trajectory Prediction

2025-11-14 · Zhongping Dong, Pengyang Yu, Shuangjian Li, Liming Chen 외 arxiv

Accurate single-object tracking and short-term motion forecasting remain challenging under occlusion, scale variation, and temporal drift, which disrupt the temporal coherence required for real-time perception. We introd…

Trajectory PredictionMotion ForecastingObject DetectionObject Tracking