DyG2Vec: Efficient Representation Learning for Dynamic Graphs
Temporal graph neural networks have shown promising results in learning inductive representations by automatically extracting temporal patterns. However, previous works often rely on complex memory modules or inefficient random walk methods to construct temporal representations. To address these limitations, we present an efficient yet effective attention-based encoder that leverages temporal edge encodings and window-based subgraph sampling to generate task-agnostic embeddings. Moreover, we propose a joint-embedding architecture using non-contrastive SSL to learn rich temporal embeddings without labels. Experimental results on 7 benchmark datasets indicate that on average, our model outperforms SoTA baselines on the future link prediction task by 4.23% for the transductive setting and 3.30% for the inductive setting while only requiring 5-10x less training/inference time. Lastly, different aspects of the proposed framework are investigated through experimental analysis and ablation studies. The code is publicly available at https://github.com/huawei-noah/noah-research/tree/master/graph_atlas.
Code (2)
Tasks
Dynamic Link PredictionDynamic Node ClassificationLink PredictionRepresentation LearningSelf-Supervised LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Learning to Represent the Evolution of Dynamic Graphs with Recurrent Models
Graph representation learning for static graphs is a well studied topic. Recently, a few studies have focused on learning temporal information in addition to the topology of a graph. Most of these studies have relied on …
DecoderGraph ClassificationGraph Representation LearningRepresentation LearningDynamic Graph Representation Learning via Self-Attention Networks
Learning latent representations of nodes in graphs is an important and ubiquitous task with widespread applications such as link prediction, node classification, and graph visualization. Previous methods on graph represe…
General ClassificationGraph EmbeddingGraph Representation LearningLink Prediction+2UniDyG: A Unified and Effective Representation Learning Approach for Large Dynamic Graphs
Dynamic graphs are formulated in continuous-time or discrete-time dynamic graphs. They differ in temporal granularity: Continuous-Time Dynamic Graphs (CTDGs) exhibit rapid, localized changes, while Discrete-Time Dynamic …
Graph AttentionRepresentation LearningFILDNE: A Framework for Incremental Learning of Dynamic Networks Embeddings
Representation learning on graphs has emerged as a powerful mechanism to automate feature vector generation for downstream machine learning tasks. The advances in representation on graphs have centered on both homogeneou…
Dynamic graph embeddingGraph EmbeddingIncremental LearningLink Prediction+1Representation Learning for Dynamic Graphs: A Survey
Graphs arise naturally in many real-world applications including social networks, recommender systems, ontologies, biology, and computational finance. Traditionally, machine learning models for graphs have been mostly de…
DecoderKnowledge GraphsRecommendation SystemsRepresentation Learning+1