paper-with-me

홈 › Papers

Hierarchical Attention-Based Recurrent Highway Networks for Time Series Prediction

2018-06-02 · Yunzhe Tao, Lin Ma, Weizhong Zhang, Jian Liu, Wei Liu, Qiang Du

Time series prediction has been studied in a variety of domains. However, it is still challenging to predict future series given historical observations and past exogenous data. Existing methods either fail to consider the interactions among different components of exogenous variables which may affect the prediction accuracy, or cannot model the correlations between exogenous data and target data. Besides, the inherent temporal dynamics of exogenous data are also related to the target series prediction, and thus should be considered as well. To address these issues, we propose an end-to-end deep learning model, i.e., Hierarchical attention-based Recurrent Highway Network (HRHN), which incorporates spatio-temporal feature extraction of exogenous variables and temporal dynamics modeling of target variables into a single framework. Moreover, by introducing the hierarchical attention mechanism, HRHN can adaptively select the relevant exogenous features in different semantic levels. We carry out comprehensive empirical evaluations with various methods over several datasets, and show that HRHN outperforms the state of the arts in time series prediction, especially in capturing sudden changes and sudden oscillations of time series.

📄 PDF Abstract BibTeX arXiv:1806.00685

Code (2)

KurochkinAlexey/Hierarchical-Attention-Based-Recurrent-Highway-Networks-for-Time-Series-Prediction pytorch
KurochkinAlexey/Hierarchical-Attention-Based-Recurrent-Highway-Networks-for-Time-Series-Prediction/blob/master/README.md pytorch

Tasks

PredictionTime SeriesTime Series AnalysisTime Series Prediction

Methods 이 논문이 사용한 방법론

Sigmoid Activation 설명 없음
Highway Layer 설명 없음
Highway Network A Highway Network is an architecture designed to ease gradient-based training of very deep networks. They allow unimpeded information flow across several layers on…

Similar Papers 제목 키워드 기반

Hierarchical Recurrent Attention Networks for Structured Online Maps

2020-12-22 · CVPR 2018 6 · Namdar Homayounfar, Wei-Chiu Ma, Shrinidhi Kowshika Lakshmikanth, Raquel Urtasun

In this paper, we tackle the problem of online road network extraction from sparse 3D point clouds. Our method is inspired by how an annotator builds a lane graph, by first identifying how many lanes there are and then d…

Learning Multi-Level Information for Dialogue Response Selection by Highway Recurrent Transformer

2019-03-21 · Ting-Rui Chiang, Chao-Wei Huang, Shang-Yu Su, Yun-Nung Chen

With the increasing research interest in dialogue response generation, there is an emerging branch formulating this task as selecting next sentences, where given the partial dialogue contexts, the goal is to determine th…

Response GenerationSentence

Neural Machine Translation with Recurrent Highway Networks

2019-04-28 · Maulik Parmar, V. Susheela Devi

Recurrent Neural Networks have lately gained a lot of popularity in language modelling tasks, especially in neural machine translation(NMT). Very recent NMT models are based on Encoder-Decoder, where a deep LSTM based en…

DecoderLanguage ModellingMachine TranslationNMT+2

Transfer Learning with Graph Neural Networks for Short-Term Highway Traffic Forecasting

2020-04-17 · Tanwi Mallick, Prasanna Balaprakash, Eric Rask, Jane Macfarlane

Highway traffic modeling and forecasting approaches are critical for intelligent transportation systems. Recently, deep-learning-based traffic forecasting methods have emerged as state of the art for a wide range of traf…

Graph Neural NetworkTime Series AnalysisTransfer Learning

Recurrent Neural Networks for Forecasting Time Series with Multiple Seasonality: A Comparative Study

2022-03-17 · Grzegorz Dudek, Slawek Smyl, Paweł Pełka

This paper compares recurrent neural networks (RNNs) with different types of gated cells for forecasting time series with multiple seasonality. The cells we compare include classical long short term memory (LSTM), gated …

Load ForecastingTime SeriesTime Series Analysis