paper-with-me

Papers

Spatio-Temporal Wind Speed Forecasting using Graph Networks and Novel Transformer Architectures

2022-08-29 · Lars Ødegaard Bentsen, Narada Dilp Warakagoda, Roy Stenbro, Paal Engelstad

This study focuses on multi-step spatio-temporal wind speed forecasting for the Norwegian continental shelf. The study aims to leverage spatial dependencies through the relative physical location of different measurement stations to improve local wind forecasts. Our multi-step forecasting models produce either 10-minute, 1- or 4-hour forecasts, with 10-minute resolution, meaning that the models produce more informative time series for predicted future trends. A graph neural network (GNN) architecture was used to extract spatial dependencies, with different update functions to learn temporal correlations. These update functions were implemented using different neural network architectures. One such architecture, the Transformer, has become increasingly popular for sequence modelling in recent years. Various alterations have been proposed to better facilitate time series forecasting, of which this study focused on the Informer, LogSparse Transformer and Autoformer. This is the first time the LogSparse Transformer and Autoformer have been applied to wind forecasting and the first time any of these or the Informer have been formulated in a spatio-temporal setting for wind forecasting. By comparing against spatio-temporal Long Short-Term Memory (LSTM) and Multi-Layer Perceptron (MLP) models, the study showed that the models using the altered Transformer architectures as update functions in GNNs were able to outperform these. Furthermore, we propose the Fast Fourier Transformer (FFTransformer), which is a novel Transformer architecture based on signal decomposition and consists of two separate streams that analyse the trend and periodic components separately. The FFTransformer and Autoformer were found to achieve superior results for the 10-minute and 1-hour ahead forecasts, with the FFTransformer significantly outperforming all other models for the 4-hour ahead forecasts.

📄 PDF Abstract BibTeX arXiv:2208.13585

Code (1)

larsbentsen/fftransformer 공식 구현 pytorch

Tasks

Graph Neural NetworkMultivariate Time Series ForecastingSpatio-Temporal ForecastingTime SeriesTime Series AnalysisTime Series ForecastingWeather Forecasting

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Graph Neural Network 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…

Similar Papers 제목 키워드 기반

Enhancing Short-Term Wind Speed Forecasting using Graph Attention and Frequency-Enhanced Mechanisms

2023-05-19 · Hao liu, Huimin Ma, Tianyu Hu

The safe and stable operation of power systems is greatly challenged by the high variability and randomness of wind power in large-scale wind-power-integrated grids. Wind power forecasting is an effective solution to tac…

Graph Attention

Deep Forecast: Deep Learning-based Spatio-Temporal Forecasting

2017-07-24 · Amir Ghaderi, Borhan M. Sanandaji, Faezeh Ghaderi

The paper presents a spatio-temporal wind speed forecasting algorithm using Deep Learning (DL)and in particular, Recurrent Neural Networks(RNNs). Motivated by recent advances in renewable energy integration and smart gri…

Deep LearningSpatio-Temporal ForecastingTime SeriesTime Series Analysis

Low-dimensional Models in Spatio-Temporal Wind Speed Forecasting

2015-03-04 · Borhan M. Sanandaji, Akin Tascikaraoglu, Kameshwar Poolla, Pravin Varaiya

Integrating wind power into the grid is challenging because of its random nature. Integration is facilitated with accurate short-term forecasts of wind power. The paper presents a spatio-temporal wind speed forecasting a…

Compressive SensingTime SeriesTime Series Analysis

TCNFormer: Temporal Convolutional Network Former for Short-Term Wind Speed Forecasting

2024-08-27 · Abid Hasan Zim, Aquib Iqbal, Asad Malik, Zhicheng Dong 외

Global environmental challenges and rising energy demands have led to extensive exploration of wind energy technologies. Accurate wind speed forecasting (WSF) is crucial for optimizing wind energy capture and ensuring sy…

STDHL: Spatio-Temporal Dynamic Hypergraph Learning for Wind Power Forecasting

2024-12-16 · Xiaochong Dong, Xuemin Zhang, Ming Yang, Shengwei Mei

Leveraging spatio-temporal correlations among wind farms can significantly enhance the accuracy of ultra-short-term wind power forecasting. However, the complex and dynamic nature of these correlations presents significa…

Decoder