paper-with-me

홈 › Papers

Equivariant Spatio-Temporal Attentive Graph Networks to Simulate Physical Dynamics

2024-05-21 · NeurIPS 2023 11 · Liming Wu, Zhichao Hou, Jirui Yuan, Yu Rong, Wenbing Huang

Learning to represent and simulate the dynamics of physical systems is a crucial yet challenging task. Existing equivariant Graph Neural Network (GNN) based methods have encapsulated the symmetry of physics, \emph{e.g.}, translations, rotations, etc, leading to better generalization ability. Nevertheless, their frame-to-frame formulation of the task overlooks the non-Markov property mainly incurred by unobserved dynamics in the environment. In this paper, we reformulate dynamics simulation as a spatio-temporal prediction task, by employing the trajectory in the past period to recover the Non-Markovian interactions. We propose Equivariant Spatio-Temporal Attentive Graph Networks (ESTAG), an equivariant version of spatio-temporal GNNs, to fulfill our purpose. At its core, we design a novel Equivariant Discrete Fourier Transform (EDFT) to extract periodic patterns from the history frames, and then construct an Equivariant Spatial Module (ESM) to accomplish spatial message passing, and an Equivariant Temporal Module (ETM) with the forward attention and equivariant pooling mechanisms to aggregate temporal message. We evaluate our model on three real datasets corresponding to the molecular-, protein- and macro-level. Experimental results verify the effectiveness of ESTAG compared to typical spatio-temporal GNNs and equivariant GNNs.

📄 PDF Abstract BibTeX arXiv:2405.12868

Code (1)

ManlioWu/ESTAG 공식 구현 pytorch

Tasks

Graph Neural Network

Methods 이 논문이 사용한 방법론

Graph Neural Network 설명 없음

Similar Papers 제목 키워드 기반

Spacetime $E(n)$-Transformer: Equivariant Attention for Spatio-temporal Graphs

2024-08-12 · Sergio G. Charles

We introduce an $E(n)$-equivariant Transformer architecture for spatio-temporal graph data. By imposing rotation, translation, and permutation equivariance inductive biases in both space and time, we show that the Spacet…

Translation

stagNet: An Attentive Semantic RNN for Group Activity Recognition

2018-09-01 · ECCV 2018 9 · Mengshi Qi, Jie Qin, Annan Li, Yunhong Wang 외

Group activity recognition plays a fundamental role in a variety of applications, e.g. sports video analysis and intelligent surveillance. How to model the spatio-temporal contextual information in a scene still remains …

Activity RecognitionGroup Activity Recognition

SpaER: Learning Spatio-temporal Equivariant Representations for Fetal Brain Motion Tracking

2024-07-29 · Jian Wang, Razieh Faghihpirayesh, Polina Golland, Ali Gholipour

In this paper, we introduce SpaER, a pioneering method for fetal motion tracking that leverages equivariant filters and self-attention mechanisms to effectively learn spatio-temporal representations. Different from conve…

Data Augmentation

LiDAR-based Online 3D Video Object Detection with Graph-based Message Passing and Spatiotemporal Transformer Attention

2020-04-03 · CVPR 2020 6 · Junbo Yin, Jianbing Shen, Chenye Guan, Dingfu Zhou 외

Existing LiDAR-based 3D object detectors usually focus on the single-frame detection, while ignoring the spatiotemporal information in consecutive point cloud frames. In this paper, we propose an end-to-end online 3D vid…

Objectobject-detectionObject DetectionVideo Object Detection

SRE-CNN: A Spatiotemporal Rotation-Equivariant CNN for Cardiac Cine MR Imaging

2024-09-13 · Yuliang Zhu, Jing Cheng, Zhuo-Xu Cui, Jianfeng Ren 외

Dynamic MR images possess various transformation symmetries,including the rotation symmetry of local features within the image and along the temporal dimension. Utilizing these symmetries as prior knowledge can facilitat…