CLDG: Contrastive Learning on Dynamic Graphs
The graph with complex annotations is the most potent data type, whose constantly evolving motivates further exploration of the unsupervised dynamic graph representation. One of the representative paradigms is graph contrastive learning. It constructs self-supervised signals by maximizing the mutual information between the statistic graph's augmentation views. However, the semantics and labels may change within the augmentation process, causing a significant performance drop in downstream tasks. This drawback becomes greatly magnified on dynamic graphs. To address this problem, we designed a simple yet effective framework named CLDG. Firstly, we elaborate that dynamic graphs have temporal translation invariance at different levels. Then, we proposed a sampling layer to extract the temporally-persistent signals. It will encourage the node to maintain consistent local and global representations, i.e., temporal translation invariance under the timespan views. The extensive experiments demonstrate the effectiveness and efficiency of the method on seven datasets by outperforming eight unsupervised state-of-the-art baselines and showing competitiveness against four semi-supervised methods. Compared with the existing dynamic graph method, the number of model parameters and training time is reduced by an average of 2,001.86 times and 130.31 times on seven datasets, respectively.
Code (1)
Tasks
Contrastive LearningTranslationSimilar Papers 제목 키워드 기반
Learning Dynamic Graph Representations through Timespan View Contrasts
The rich information underlying graphs has inspired further investigation of unsupervised graph representation. Existing studies mainly depend on node features and topological properties within static graphs to create se…
Graph Anomaly DetectionContrastive LearningNode ClassificationControl-based Graph Embeddings with Data Augmentation for Contrastive Learning
In this paper, we study the problem of unsupervised graph representation learning by harnessing the control properties of dynamical networks defined on graphs. Our approach introduces a novel framework for contrastive le…
Contrastive LearningData AugmentationGraph Representation LearningRepresentation LearningSelf-Supervised Dynamic Graph Representation Learning via Temporal Subgraph Contrast
Self-supervised learning on graphs has recently drawn a lot of attention due to its independence from labels and its robustness in representation. Current studies on this topic mainly use static information such as graph…
Contrastive LearningGraph Representation LearningLink PredictionRepresentation Learning+1Contrastive Representation Learning of Longitudinal Disease Trajectories on Temporal Graphs
Understanding disease trajectories from longitudinal clinical data remains challenging due to complex temporal dynamics and heterogeneous patient cohorts. Here, we present a contrastive representation learning framework …
Representation LearningContrastive LearningEvidential Spectrum-Aware Contrastive Learning for OOD Detection in Dynamic Graphs
Recently, Out-of-distribution (OOD) detection in dynamic graphs, which aims to identify whether incoming data deviates from the distribution of the in-distribution (ID) training set, has garnered considerable attention i…
Contrastive LearningOut of Distribution (OOD) Detection