paper-with-me

홈 › Papers

ARMA Cell: A Modular and Effective Approach for Neural Autoregressive Modeling

2022-08-31 · Philipp Schiele, Christoph Berninger, David Rügamer

The autoregressive moving average (ARMA) model is a classical, and arguably one of the most studied approaches to model time series data. It has compelling theoretical properties and is widely used among practitioners. More recent deep learning approaches popularize recurrent neural networks (RNNs) and, in particular, Long Short-Term Memory (LSTM) cells that have become one of the best performing and most common building blocks in neural time series modeling. While advantageous for time series data or sequences with long-term effects, complex RNN cells are not always a must and can sometimes even be inferior to simpler recurrent approaches. In this work, we introduce the ARMA cell, a simpler, modular, and effective approach for time series modeling in neural networks. This cell can be used in any neural network architecture where recurrent structures are present and naturally handles multivariate time series using vector autoregression. We also introduce the ConvARMA cell as a natural successor for spatially-correlated time series. Our experiments show that the proposed methodology is competitive with popular alternatives in terms of performance while being more robust and compelling due to its simplicity

📄 PDF Abstract BibTeX arXiv:2208.14919

Code (2)

phschiele/armacell 공식 구현 tf
phschiele/armacell_paper 공식 구현 tf

Tasks

Time SeriesTime Series Analysis

Methods 이 논문이 사용한 방법론

ARMA The ARMA GNN layer implements a rational graph filter with a recursive approximation.

Similar Papers 제목 키워드 기반

Simulation, Modeling and Prediction of a Pharmacodynamic Animal Tissue Culture Compartment Model by Physical Informed Neural Network

2022-06-09 · Jiahao Ma

Compartment models of cell culture are widely used in cytology, pharmacology, toxicology and other fields. Numerical simulation, data modeling and prediction of compartment models can be realized by traditional different…

Cultural Vocal Bursts Intensity Prediction

ARMA Nets: Expanding Receptive Field for Dense Prediction

2020-02-15 · NeurIPS 2020 12 · Jiahao Su, Shiqi Wang, Furong Huang

Global information is essential for dense prediction problems, whose goal is to compute a discrete or continuous label for each pixel in the images. Traditional convolutional layers in neural networks, initially designed…

image-classificationImage ClassificationPredictionSemantic Segmentation+1

AssetFormer: Modular 3D Assets Generation with Autoregressive Transformer

2026-02-12 · Lingting Zhu, Shengju Qian, Haidi Fan, Jiayu Dong 외 arxiv

The digital industry demands high-quality, diverse modular 3D assets, especially for user-generated content~(UGC). In this work, we introduce AssetFormer, an autoregressive Transformer-based model designed to generate mo…

GRAMA: Adaptive Graph Autoregressive Moving Average Models

2025-01-22 · Moshe Eliasof, Alessio Gravina, Andrea Ceni, Claudio Gallicchio 외

Graph State Space Models (SSMs) have recently been introduced to enhance Graph Neural Networks (GNNs) in modeling long-range interactions. Despite their success, existing methods either compromise on permutation equivari…

State Space Models

Autoregressive Moving-average Attention Mechanism for Time Series Forecasting

2024-10-04 · Jiecheng Lu, Xu Han, Yan Sun, Shihao Yang

We propose an Autoregressive (AR) Moving-average (MA) attention structure that can adapt to various linear attention mechanisms, enhancing their ability to capture long-range and local temporal patterns in time series. I…

DecoderTime SeriesTime Series Forecasting