Exploring Edge Disentanglement for Node Classification
Edges in real-world graphs are typically formed by a variety of factors and carry diverse relation semantics. For example, connections in a social network could indicate friendship, being colleagues, or living in the same neighborhood. However, these latent factors are usually concealed behind mere edge existence due to the data collection and graph formation processes. Despite rapid developments in graph learning over these years, most models take a holistic approach and treat all edges as equal. One major difficulty in disentangling edges is the lack of explicit supervisions. In this work, with close examination of edge patterns, we propose three heuristics and design three corresponding pretext tasks to guide the automatic edge disentanglement. Concretely, these self-supervision tasks are enforced on a designed edge disentanglement module to be trained jointly with the downstream node classification task to encourage automatic edge disentanglement. Channels of the disentanglement module are expected to capture distinguishable relations and neighborhood interactions, and outputs from them are aggregated as node representations. The proposed DisGNN is easy to be incorporated with various neural architectures, and we conduct experiments on $6$ real-world datasets. Empirical results show that it can achieve significant performance gains.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationDisentanglementGraph LearningNode ClassificationSimilar Papers 제목 키워드 기반
Interpretable Deep Graph Generation with Node-Edge Co-Disentanglement
Disentangled representation learning has recently attracted a significant amount of attention, particularly in the field of image representation learning. However, learning the disentangled representations behind a graph…
DisentanglementGraph GenerationRepresentation LearningDisentangling Hyperedges through the Lens of Category Theory
Despite the promising results of disentangled representation learning in discovering latent patterns in graph-structured data, few studies have explored disentanglement for hypergraph-structured data. Integrating hypered…
Representation LearningGraphSAD: Learning Graph Representations with Structure-Attribute Disentanglement
Graph Neural Networks (GNNs) learn effective node/graph representations by aggregating the attributes of neighboring nodes, which commonly derives a single representation mixing the information of graph structure and nod…
AttributeDisentanglementGraph ClassificationDisentangling Neural Disjunctive Normal Form Models
Neural Disjunctive Normal Form (DNF) based models are powerful and interpretable approaches to neuro-symbolic learning and have shown promising results in classification and reinforcement learning settings without prior …
Reinforcement LearningContrastive Disentangled Learning on Graph for Node Classification
Contrastive learning methods have attracted considerable attention due to their remarkable success in analyzing graph-structured data. Inspired by the success of contrastive learning, we propose a novel framework for con…
ClassificationContrastive LearningDisentanglementNode Classification+1