ARMA Cell: A Modular and Effective Approach for Neural Autoregressive Modeling
The autoregressive moving average (ARMA) model is a classical, and arguably one of the most studied approaches to model time series data. It has compelling theoretical properties and is widely used among practitioners. More recent deep learning approaches popularize recurrent neural networks (RNNs) and, in particular, Long Short-Term Memory (LSTM) cells that have become one of the best performing and most common building blocks in neural time series modeling. While advantageous for time series data or sequences with long-term effects, complex RNN cells are not always a must and can sometimes even be inferior to simpler recurrent approaches. In this work, we introduce the ARMA cell, a simpler, modular, and effective approach for time series modeling in neural networks. This cell can be used in any neural network architecture where recurrent structures are present and naturally handles multivariate time series using vector autoregression. We also introduce the ConvARMA cell as a natural successor for spatially-correlated time series. Our experiments show that the proposed methodology is competitive with popular alternatives in terms of performance while being more robust and compelling due to its simplicity
Code (2)
Tasks
Time SeriesTime Series AnalysisMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Simulation, Modeling and Prediction of a Pharmacodynamic Animal Tissue Culture Compartment Model by Physical Informed Neural Network
Compartment models of cell culture are widely used in cytology, pharmacology, toxicology and other fields. Numerical simulation, data modeling and prediction of compartment models can be realized by traditional different…
Cultural Vocal Bursts Intensity PredictionARMA Nets: Expanding Receptive Field for Dense Prediction
Global information is essential for dense prediction problems, whose goal is to compute a discrete or continuous label for each pixel in the images. Traditional convolutional layers in neural networks, initially designed…
image-classificationImage ClassificationPredictionSemantic Segmentation+1AssetFormer: Modular 3D Assets Generation with Autoregressive Transformer
The digital industry demands high-quality, diverse modular 3D assets, especially for user-generated content~(UGC). In this work, we introduce AssetFormer, an autoregressive Transformer-based model designed to generate mo…
GRAMA: Adaptive Graph Autoregressive Moving Average Models
Graph State Space Models (SSMs) have recently been introduced to enhance Graph Neural Networks (GNNs) in modeling long-range interactions. Despite their success, existing methods either compromise on permutation equivari…
State Space ModelsAutoregressive Moving-average Attention Mechanism for Time Series Forecasting
We propose an Autoregressive (AR) Moving-average (MA) attention structure that can adapt to various linear attention mechanisms, enhancing their ability to capture long-range and local temporal patterns in time series. I…
DecoderTime SeriesTime Series Forecasting