paper-with-me

Papers

Evaluating the effectiveness of predicting covariates in LSTM Networks for Time Series Forecasting

2024-04-29 · Gareth Davies

Autoregressive Recurrent Neural Networks are widely employed in time-series forecasting tasks, demonstrating effectiveness in univariate and certain multivariate scenarios. However, their inherent structure does not readily accommodate the integration of future, time-dependent covariates. A proposed solution, outlined by Salinas et al 2019, suggests forecasting both covariates and the target variable in a multivariate framework. In this study, we conducted comprehensive tests on publicly available time-series datasets, artificially introducing highly correlated covariates to future time-step values. Our evaluation aimed to assess the performance of an LSTM network when considering these covariates and compare it against a univariate baseline. As part of this study we introduce a novel approach using seasonal time segments in combination with an RNN architecture, which is both simple and extremely effective over long forecast horizons with comparable performance to many state of the art architectures. Our findings from the results of more than 120 models reveal that under certain conditions jointly training covariates with target variables can improve overall performance of the model, but often there exists a significant performance disparity between multivariate and univariate predictions. Surprisingly, even when provided with covariates informing the network about future target values, multivariate predictions exhibited inferior performance. In essence, compelling the network to predict multiple values can prove detrimental to model performance, even in the presence of informative covariates. These results suggest that LSTM architectures may not be suitable for forecasting tasks where predicting covariates would typically be expected to enhance model accuracy.

📄 PDF Abstract BibTeX arXiv:2404.18553

Code (1)

garethmd/nnts 공식 구현 pytorch

Tasks

Time SeriesTime Series Forecasting

Methods 이 논문이 사용한 방법론

Sigmoid Activation 설명 없음
Tanh Activation 설명 없음
LSTM An LSTM is a type of recurrent neural network that addresses the vanishing gradient problem in vanilla…

Similar Papers 제목 키워드 기반

ShortFuse: Biomedical Time Series Representations in the Presence of Structured Information

2017-05-13 · Madalina Fiterau, Suvrat Bhooshan, Jason Fries, Charles Bournhonesque 외

In healthcare applications, temporal variables that encode movement, health status and longitudinal patient evolution are often accompanied by rich structured information such as demographics, diagnostics and medical exa…

Time SeriesTime Series Analysis

DeepLINK-T: deep learning inference for time series data using knockoffs and LSTM

2024-04-05 · Wenxuan Zuo, Zifan Zhu, Yuxuan Du, Yi-Chun Yeh 외

High-dimensional longitudinal time series data is prevalent across various real-world applications. Many such applications can be modeled as regression problems with high-dimensional time series covariates. Deep learning…

Deep Learningfeature selectionregressionTime Series+1

Enhanced Photovoltaic Power Forecasting: An iTransformer and LSTM-Based Model Integrating Temporal and Covariate Interactions

2024-12-03 · Guang Wu, Yun Wang, Qian Zhou, Ziyang Zhang

Accurate photovoltaic (PV) power forecasting is critical for integrating renewable energy sources into the grid, optimizing real-time energy management, and ensuring energy reliability amidst increasing demand. However, …

energy managementManagement

Short-term prediction of stream turbidity using surrogate data and a meta-model approach

2022-10-11 · Bhargav Rele, Caleb Hogan, Sevvandi Kandanaarachchi, Catherine Leigh

Many water-quality monitoring programs aim to measure turbidity to help guide effective management of waterways and catchments, yet distributing turbidity sensors throughout networks is typically cost prohibitive. To thi…

Additive modelsManagementTime Series Analysis

LSTM-Based Text Generation: A Study on Historical Datasets

2024-03-11 · Mustafa Abbas Hussein Hussein, Serkan Savaş

This paper presents an exploration of Long Short-Term Memory (LSTM) networks in the realm of text generation, focusing on the utilization of historical datasets for Shakespeare and Nietzsche. LSTMs, known for their effec…

Text Generation