paper-with-me

Papers

Hiformer: Hybrid Frequency Feature Enhancement Inverted Transformer for Long-Term Wind Power Prediction

2024-10-17 · Chongyang Wan, Shunbo Lei, Yuan Luo

The increasing severity of climate change necessitates an urgent transition to renewable energy sources, making the large-scale adoption of wind energy crucial for mitigating environmental impact. However, the inherent uncertainty of wind power poses challenges for grid stability, underscoring the need for accurate wind energy prediction models to enable effective power system planning and operation. While many existing studies on wind power prediction focus on short-term forecasting, they often overlook the importance of long-term predictions. Long-term wind power forecasting is essential for effective power grid dispatch and market transactions, as it requires careful consideration of weather features such as wind speed and direction, which directly influence power output. Consequently, methods designed for short-term predictions may lead to inaccurate results and high computational costs in long-term settings. To adress these limitations, we propose a novel approach called Hybrid Frequency Feature Enhancement Inverted Transformer (Hiformer). Hiformer introduces a unique structure that integrates signal decomposition technology with weather feature extraction technique to enhance the modeling of correlations between meteorological conditions and wind power generation. Additionally, Hiformer employs an encoder-only architecture, which reduces the computational complexity associated with long-term wind power forecasting. Compared to the state-of-the-art methods, Hiformer: (i) can improve the prediction accuracy by up to 52.5\%; and (ii) can reduce computational time by up to 68.5\%.

📄 PDF Abstract BibTeX arXiv:2410.13303

Code (1)

valuestdio/Hiformer 공식 구현 pytorch

Tasks

PredictionTime Series

Methods 이 논문이 사용한 방법론

Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Adam 설명 없음
Attention 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Residual Connection 설명 없음
Position-Wise Feed-Forward Layer 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Similar Papers 제목 키워드 기반

HiFormer: Hierarchical Multi-scale Representations Using Transformers for Medical Image Segmentation

2022-07-18 · Moein Heidari, Amirhossein Kazerouni, Milad Soltany, Reza Azad 외

Convolutional neural networks (CNNs) have been the consensus for medical image segmentation tasks. However, they suffer from the limitation in modeling long-range dependencies and spatial correlations due to the nature o…

DecoderImage SegmentationMedical Image SegmentationSegmentation+1

Hiformer: Heterogeneous Feature Interactions Learning with Transformers for Recommender Systems

2023-11-10 · Huan Gui, Ruoxi Wang, Ke Yin, Long Jin 외

Learning feature interaction is the critical backbone to building recommender systems. In web-scale applications, learning feature interaction is extremely challenging due to the sparse and large input feature space; mea…

Recommendation Systems

Multi-Domain Processing via Hybrid Denoising Networks for Speech Enhancement

2018-10-22 · Anonymous

We present a hybrid framework that leverages the trade-off between temporal and frequency precision in audio representations to improve the performance of speech enhancement task. We first show that conventional approach…

DenoisingSpeech Enhancement

CRNet: A Detail-Preserving Network for Unified Image Restoration and Enhancement Task

2024-04-22 · Kangzhen Yang, Tao Hu, Kexin Dai, Genggeng Chen 외

In real-world scenarios, images captured often suffer from blurring, noise, and other forms of image degradation, and due to sensor limitations, people usually can only obtain low dynamic range images. To achieve high-qu…

DeblurringDenoisingImage EnhancementImage Restoration+1

BASENet: Band-Adapted Speech Enhancement Network with Cross-Band Attention

2026-06-10 · Damien Martins Gomes, François Capman arxiv

Speech enhancement models typically apply uniform capacity across all frequencies, disregarding the non-uniform spectral resolution of human hearing. We propose BASENet, a frequency-adapted architecture that partitions t…

Speech Enhancement