paper-with-me

홈 › Papers

Graph-Time Convolutional Neural Networks: Architecture and Theoretical Analysis

2022-06-30 · Mohammad Sabbaqi, Elvin Isufi

Devising and analyzing learning models for spatiotemporal network data is of importance for tasks including forecasting, anomaly detection, and multi-agent coordination, among others. Graph Convolutional Neural Networks (GCNNs) are an established approach to learn from time-invariant network data. The graph convolution operation offers a principled approach to aggregate multiresolution information. However, extending the convolution principled learning and respective analysis to the spatiotemporal domain is challenging because spatiotemporal data have more intrinsic dependencies. Hence, a higher flexibility to capture jointly the spatial and the temporal dependencies is required to learn meaningful higher-order representations. Here, we leverage product graphs to represent the spatiotemporal dependencies in the data and introduce Graph-Time Convolutional Neural Networks (GTCNNs) as a principled architecture to aid learning. The proposed approach can work with any type of product graph and we also introduce a parametric product graph to learn also the spatiotemporal coupling. The convolution principle further allows a similar mathematical tractability as for GCNNs. In particular, the stability result shows GTCNNs are stable to spatial perturbations but there is an implicit trade-off between discriminability and robustness; i.e., the more complex the model, the less stable. Extensive numerical results on benchmark datasets corroborate our findings and show the GTCNN compares favorably with state-of-the-art solutions. We anticipate the GTCNN to be a starting point for more sophisticated models that achieve good performance but are also fundamentally grounded.

📄 PDF Abstract BibTeX arXiv:2206.15174

Code (0)

등록된 구현이 없습니다.

Tasks

Anomaly Detection

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

Space-Time Graph Neural Networks with Stochastic Graph Perturbations

2022-10-28 · Samar Hadou, Charilaos Kanatsoulis, Alejandro Ribeiro

Space-time graph neural networks (ST-GNNs) are recently developed architectures that learn efficient graph representations of time-varying data. ST-GNNs are particularly useful in multi-agent systems, due to their stabil…

Transfer Learning

GraphMix: Improved Training of GNNs for Semi-Supervised Learning

2019-09-25 · Vikas Verma, Meng Qu, Kenji Kawaguchi, Alex Lamb 외

We present GraphMix, a regularization method for Graph Neural Network based semi-supervised object classification, whereby we propose to train a fully-connected network jointly with the graph neural network via parameter…

Generalization BoundsGraph AttentionGraph Neural NetworkNode Classification

Path Signatures and Graph Neural Networks for Slow Earthquake Analysis: Better Together?

2024-02-05 · Hans Riess, Manolis Veveakis, Michael M. Zavlanos

The path signature, having enjoyed recent success in the machine learning community, is a theoretically-driven method for engineering features from irregular paths. On the other hand, graph neural networks (GNN), neural …

Earthquake prediction

The Topos of Transformer Networks

2024-03-27 · Mattia Jacopo Villani, Peter McBurney

The transformer neural network has significantly out-shined all other neural network architectures as the engine behind large language models. We provide a theoretical analysis of the expressivity of the transformer arch…

Stability of Graph Convolutional Neural Networks to Stochastic Perturbations

2021-06-19 · Zhan Gao, Elvin Isufi, Alejandro Ribeiro

Graph convolutional neural networks (GCNNs) are nonlinear processing tools to learn representations from network data. A key property of GCNNs is their stability to graph perturbations. Current analysis considers determi…