paper-with-me

Papers

Sparse-Dyn: Sparse Dynamic Graph Multi-representation Learning via Event-based Sparse Temporal Attention Network

2022-01-04 · Yan Pang, Chao Liu

Dynamic graph neural networks have been widely used in modeling and representation learning of graph structure data. Current dynamic representation learning focuses on either discrete learning which results in temporal information loss or continuous learning that involves heavy computation. In this work, we proposed a novel dynamic graph neural network, Sparse-Dyn. It adaptively encodes temporal information into a sequence of patches with an equal amount of temporal-topological structure. Therefore, while avoiding the use of snapshots which causes information loss, it also achieves a finer time granularity, which is close to what continuous networks could provide. In addition, we also designed a lightweight module, Sparse Temporal Transformer, to compute node representations through both structural neighborhoods and temporal dynamics. Since the fully-connected attention conjunction is simplified, the computation cost is far lower than the current state-of-the-arts. Link prediction experiments are conducted on both continuous and discrete graph datasets. Through comparing with several state-of-the-art graph embedding baselines, the experimental results demonstrate that Sparse-Dyn has a faster inference speed while having competitive performance.

📄 PDF Abstract BibTeX arXiv:2201.01384

Code (0)

등록된 구현이 없습니다.

Tasks

Graph EmbeddingGraph Neural NetworkGraph Representation LearningLink PredictionRecommendation SystemsRepresentation Learning

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Residual Connection 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Adam 설명 없음

Similar Papers 제목 키워드 기반

Context-Aware Sparse Deep Coordination Graphs

2021-06-05 · ICLR 2022 4 · Tonghan Wang, Liang Zeng, Weijun Dong, Qianlan Yang 외

Learning sparse coordination graphs adaptive to the coordination dynamics among agents is a long-standing problem in cooperative multi-agent learning. This paper studies this problem and proposes a novel method using the…

graph constructionGraph LearningStarcraftStarcraft II

Learning Subspace-Preserving Sparse Attention Graphs from Heterogeneous Multiview Data

2026-05-12 · Jie Chen, Yuanbiao Gou, Chuanbin Liu, Zhu Wang 외 arxiv

The high-dimensional features extracted from large-scale unlabeled data via various pretrained models with diverse architectures are referred to as heterogeneous multiview data. Most existing unsupervised transfer learni…

Representation LearningTransfer LearningGraph Learning

Fast Training of Sparse Graph Neural Networks on Dense Hardware

2019-06-27 · Matej Balog, Bart van Merriënboer, Subhodeep Moitra, Yujia Li 외

Graph neural networks have become increasingly popular in recent years due to their ability to naturally encode relational input data and their ability to scale to large graphs by operating on a sparse representation of …

Graph Neural Network

The Graphon Limit Hypothesis: Understanding Neural Network Pruning via Infinite Width Analysis

2025-10-20 · Hoang Pham, The-Anh Ta, Tom Jacobs, Rebekka Burkholz 외 arxiv

Sparse neural networks promise efficiency, yet training them effectively remains a fundamental challenge. Despite advances in pruning methods that create sparse architectures, understanding why some sparse structures are…

Network Pruning

NerT-CA: Efficient Dynamic Reconstruction from Sparse-view X-ray Coronary Angiography

2025-07-25 · Kirsten W. H. Maas, Danny Ruijters, Nicola Pezzotti, Anna Vilanova arxiv

Three-dimensional (3D) and dynamic 3D+time (4D) reconstruction of coronary arteries from X-ray coronary angiography (CA) has the potential to improve clinical procedures. However, there are multiple challenges to be addr…

Dynamic Reconstruction