Dynamic Graph Representation Learning via Self-Attention Networks
Learning latent representations of nodes in graphs is an important and ubiquitous task with widespread applications such as link prediction, node classification, and graph visualization. Previous methods on graph representation learning mainly focus on static graphs, however, many real-world graphs are dynamic and evolve over time. In this paper, we present Dynamic Self-Attention Network (DySAT), a novel neural architecture that operates on dynamic graphs and learns node representations that capture both structural properties and temporal evolutionary patterns. Specifically, DySAT computes node representations by jointly employing self-attention layers along two dimensions: structural neighborhood and temporal dynamics. We conduct link prediction experiments on two classes of graphs: communication networks and bipartite rating networks. Our experimental results show that DySAT has a significant performance gain over several different state-of-the-art graph embedding baselines.
Code (2)
Tasks
General ClassificationGraph EmbeddingGraph Representation LearningLink PredictionNode ClassificationRepresentation LearningSimilar Papers 제목 키워드 기반
ConvDySAT: Deep Neural Representation Learning on Dynamic Graphs via Self-Attention and Convolutional Neural Networks
Learning node representations on temporal graphs is a fundamental step to learn real-word dynamic graphs efficiently. Real-world graphs have the nature of continuously evolving over time, such as changing edges weights, …
Graph Representation LearningLink PredictionRepresentation LearningSelf-Supervised Dynamic Graph Representation Learning via Temporal Subgraph Contrast
Self-supervised learning on graphs has recently drawn a lot of attention due to its independence from labels and its robustness in representation. Current studies on this topic mainly use static information such as graph…
Contrastive LearningGraph Representation LearningLink PredictionRepresentation Learning+1Structure Representation Learning by Jointly Learning to Pool and Represent
Structure representation learning is a task to provide an overall representation for a given structure (e.g., sequential text, non-sequential graph). This representation characterizes the property of that structure. Prev…
ClassificationGraph ClassificationRepresentation LearningSentence+1Multi-perspective Feedback-attention Coupling Model for Continuous-time Dynamic Graphs
Recently, representation learning over graph networks has gained popularity, with various models showing promising results. Despite this, several challenges persist: 1) most methods are designed for static or discrete-ti…
Representation LearningVStreamDRLS: Dynamic Graph Representation Learning with Self-Attention for Enterprise Distributed Video Streaming Solutions
Live video streaming has become a mainstay as a standard communication solution for several enterprises worldwide. To efficiently stream high-quality live video content to a large amount of offices, companies employ dist…
Graph Neural NetworkGraph Representation LearningLink PredictionRepresentation Learning