paper-with-me

Papers

SGRU: A High-Performance Structured Gated Recurrent Unit for Traffic Flow Prediction

2024-04-18 · Wenfeng Zhang, Xin Li, Anqi Li, Xiaoting Huang, Ti Wang, Honglei Gao

Traffic flow prediction is an essential task in constructing smart cities and is a typical Multivariate Time Series (MTS) Problem. Recent research has abandoned Gated Recurrent Units (GRU) and utilized dilated convolutions or temporal slicing for feature extraction, and they have the following drawbacks: (1) Dilated convolutions fail to capture the features of adjacent time steps, resulting in the loss of crucial transitional data. (2) The connections within the same temporal slice are strong, while the connections between different temporal slices are too loose. In light of these limitations, we emphasize the importance of analyzing a complete time series repeatedly and the crucial role of GRU in MTS. Therefore, we propose SGRU: Structured Gated Recurrent Units, which involve structured GRU layers and non-linear units, along with multiple layers of time embedding to enhance the model's fitting performance. We evaluate our approach on four publicly available California traffic datasets: PeMS03, PeMS04, PeMS07, and PeMS08 for regression prediction. Experimental results demonstrate that our model outperforms baseline models with average improvements of 11.7%, 18.6%, 18.5%, and 12.0% respectively.

📄 PDF Abstract BibTeX arXiv:2404.11854

Code (0)

등록된 구현이 없습니다.

Tasks

Time Series

Methods 이 논문이 사용한 방법론

MTS 설명 없음
GRU A Gated Recurrent Unit, or GRU, is a type of recurrent neural network. It is similar to an LSTM, but only has two gates - a reset…

Similar Papers 제목 키워드 기반

An Improved Time Feedforward Connections Recurrent Neural Networks

2022-11-03 · Jin Wang, Yongsong Zou, Se-Jung Lim

Recurrent Neural Networks (RNNs) have been widely applied to deal with temporal problems, such as flood forecasting and financial data processing. On the one hand, traditional RNNs models amplify the gradient issue due t…

Storytelling of Photo Stream with Bidirectional Multi-thread Recurrent Neural Network

2016-06-02 · Yu Liu, Jianlong Fu, Tao Mei, Chang Wen Chen

Visual storytelling aims to generate human-level narrative language (i.e., a natural paragraph with multiple sentences) from a photo streams. A typical photo story consists of a global timeline with multi-thread local st…

Video CaptioningVisual Storytelling

Task-Synchronized Recurrent Neural Networks

2022-04-11 · Mantas Lukoševičius, Arnas Uselis

Data are often sampled irregularly in time. Dealing with this using Recurrent Neural Networks (RNNs) traditionally involved ignoring the fact, feeding the time differences as additional inputs, or resampling the data. Al…

Hybrid Spiking Neural Networks for Low-Power Intra-Cortical Brain-Machine Interfaces

2024-09-06 · Alexandru Vasilache, Jann Krausse, Klaus Knobloch, Juergen Becker

Intra-cortical brain-machine interfaces (iBMIs) have the potential to dramatically improve the lives of people with paraplegia by restoring their ability to perform daily activities. However, current iBMIs suffer from sc…

TreeWY: Speculative Verification for Gated DeltaNet Hybrids

2026-08-21 · Sneha Murthy Ghantasala arxiv

Modern open models are hybrids: most layers are linear-attention (Gated DeltaNet, GDN) layers carrying a small fixed-size recurrent state instead of a growing key-value (KV) cache. This makes ordinary decoding memory-eff…