paper-with-me

홈 › Papers

Learning to Remember Patterns: Pattern Matching Memory Networks for Traffic Forecasting

2021-10-20 · ICLR 2022 4 · Hyunwook Lee, Seungmin Jin, Hyeshin Chu, Hongkyu Lim, Sungahn Ko

Traffic forecasting is a challenging problem due to complex road networks and sudden speed changes caused by various events on roads. A number of models have been proposed to solve this challenging problem with a focus on learning spatio-temporal dependencies of roads. In this work, we propose a new perspective of converting the forecasting problem into a pattern matching task, assuming that large data can be represented by a set of patterns. To evaluate the validness of the new perspective, we design a novel traffic forecasting model, called Pattern-Matching Memory Networks (PM-MemNet), which learns to match input data to the representative patterns with a key-value memory structure. We first extract and cluster representative traffic patterns, which serve as keys in the memory. Then via matching the extracted keys and inputs, PM-MemNet acquires necessary information of existing traffic patterns from the memory and uses it for forecasting. To model spatio-temporal correlation of traffic, we proposed novel memory architecture GCMem, which integrates attention and graph convolution for memory enhancement. The experiment results indicate that PM-MemNet is more accurate than state-of-the-art models, such as Graph WaveNet with higher responsiveness. We also present a qualitative analysis result, describing how PM-MemNet works and achieves its higher accuracy when road speed rapidly changes.

📄 PDF Abstract BibTeX arXiv:2110.10380

Code (1)

hyunwookl/pm-memnet 공식 구현 pytorch

Tasks

Traffic Prediction

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…
Mixture of Logistic Distributions 설명 없음
Dilated Causal Convolution A Dilated Causal Convolution is a causal convolution where the filter is applied over an area larger than its length by…
WaveNet WaveNet is an audio generative model based on the PixelCNN architecture. In order to deal with long-range temporal dependencies…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

Delay Learning Architectures for Memory and Classification

2013-11-06 · Shaista Hussain, Arindam Basu, R. Wang, Tara Julia Hamilton

We present a neuromorphic spiking neural network, the DELTRON, that can remember and store patterns by changing the delays of every connection as opposed to modifying the weights. The advantage of this architecture over …

ClassificationGeneral Classification

Forgetting Memories and their Attractiveness

2018-05-31 · Enzo Marinari

We study numerically the memory which forgets, introduced in 1986 by Parisi by bounding the synaptic strength, with a mechanism which avoid confusion, allows to remember the pattern learned more recently and has a physio…

Learning to update Auto-associative Memory in Recurrent Neural Networks for Improving Sequence Memorization

2017-09-19 · Wei Zhang, Bo-Wen Zhou

Learning to remember long sequences remains a challenging task for recurrent neural networks. Register memory and attention mechanisms were both proposed to resolve the issue with either high computational cost to retain…

MemorizationRepresentation Learning

Time Series Forecasting with Stacked Long Short-Term Memory Networks

2020-11-02 · Frank Xiao

Long Short-Term Memory (LSTM) networks are often used to capture temporal dependency patterns. By stacking multi-layer LSTM networks, it can capture even more complex patterns. This paper explores the effectiveness of ap…

Time SeriesTime Series AnalysisTime Series ForecastingTime Series Prediction

Pattern-Matching Dynamic Memory Network for Dual-Mode Traffic Prediction

2024-08-12 · Wenchao Weng, Mei Wu, Hanyu Jiang, Wanzeng Kong 외

In recent years, deep learning has increasingly gained attention in the field of traffic prediction. Existing traffic prediction models often rely on GCNs or attention mechanisms with O(N^2) complexity to dynamically ext…

PredictionTraffic Prediction