paper-with-me

Papers

GRAMA: Adaptive Graph Autoregressive Moving Average Models

2025-01-22 · Moshe Eliasof, Alessio Gravina, Andrea Ceni, Claudio Gallicchio, Davide Bacciu, Carola-Bibiane Schönlieb

Graph State Space Models (SSMs) have recently been introduced to enhance Graph Neural Networks (GNNs) in modeling long-range interactions. Despite their success, existing methods either compromise on permutation equivariance or limit their focus to pairwise interactions rather than sequences. Building on the connection between Autoregressive Moving Average (ARMA) and SSM, in this paper, we introduce GRAMA, a Graph Adaptive method based on a learnable Autoregressive Moving Average (ARMA) framework that addresses these limitations. By transforming from static to sequential graph data, GRAMA leverages the strengths of the ARMA framework, while preserving permutation equivariance. Moreover, GRAMA incorporates a selective attention mechanism for dynamic learning of ARMA coefficients, enabling efficient and flexible long-range information propagation. We also establish theoretical connections between GRAMA and Selective SSMs, providing insights into its ability to capture long-range dependencies. Extensive experiments on 14 synthetic and real-world datasets demonstrate that GRAMA consistently outperforms backbone models and performs competitively with state-of-the-art methods.

📄 PDF Abstract BibTeX arXiv:2501.12732

Code (0)

등록된 구현이 없습니다.

Tasks

State Space Models

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음
ARMA The ARMA GNN layer implements a rational graph filter with a recursive approximation.
Focus 설명 없음

Similar Papers 제목 키워드 기반

EngramaBench: Evaluating Long-Term Conversational Memory with Structured Graph Retrieval

2026-04-23 · Julian Acuna arxiv

Large language model assistants are increasingly expected to retain and reason over information accumulated across many sessions. We introduce EngramaBench, a benchmark for long-term conversational memory built around fi…

Identification of Non-causal Graphical Models

2024-10-12 · Junyao You, Mattia Zorzi

The paper considers the problem to estimate non-causal graphical models whose edges encode smoothing relations among the variables. We propose a new covariance extension problem and show that the solution minimizing the …

Autoregressive Moving Average Graph Filtering

2016-02-14 · Elvin Isufi, Andreas Loukas, Andrea Simonetto, Geert Leus

One of the cornerstones of the field of signal processing on graphs are graph filters, direct analogues of classical filters, but intended for signals defined on graphs. This work brings forth new insights on the distrib…

DenoisingPhilosophy

Ambigram Generation by A Diffusion Model

2023-06-21 · Takahiro Shirakawa, Seiichi Uchida

Ambigrams are graphical letter designs that can be read not only from the original direction but also from a rotated direction (especially with 180 degrees). Designing ambigrams is difficult even for human experts becaus…

model

Traffic Flow Combination Forecasting Method Based on Improved LSTM and ARIMA

2019-06-25 · Boyi Liu, Xiangyan Tang, Jieren Cheng, Pengchao Shi

Traffic flow forecasting is hot spot research of intelligent traffic system construction. The existing traffic flow prediction methods have problems such as poor stability, high data requirements, or poor adaptability. I…

PredictionTime SeriesTime Series AnalysisTraffic Prediction