paper-with-me

홈 › Papers

Position-Aware Subgraph Neural Networks with Data-Efficient Learning

2022-11-01 · Chang Liu, Yuwen Yang, Zhe Xie, Hongtao Lu, Yue Ding

Data-efficient learning on graphs (GEL) is essential in real-world applications. Existing GEL methods focus on learning useful representations for nodes, edges, or entire graphs with `small'' labeled data. But the problem of data-efficient learning for subgraph prediction has not been explored. The challenges of this problem lie in the following aspects: 1) It is crucial for subgraphs to learn positional features to acquire structural information in the base graph in which they exist. Although the existing subgraph neural network method is capable of learning disentangled position encodings, the overall computational complexity is very high. 2) Prevailing graph augmentation methods for GEL, including rule-based, sample-based, adaptive, and automated methods, are not suitable for augmenting subgraphs because a subgraph contains fewer nodes but richer information such as position, neighbor, and structure. Subgraph augmentation is more susceptible to undesirable perturbations. 3) Only a small number of nodes in the base graph are contained in subgraphs, which leads to a potential bias'' problem that the subgraph representation learning is dominated by these `hot'' nodes. By contrast, the remaining nodes fail to be fully learned, which reduces the generalization ability of subgraph representation learning. In this paper, we aim to address the challenges above and propose a Position-Aware Data-Efficient Learning framework for subgraph neural networks called PADEL. Specifically, we propose a novel node position encoding method that is anchor-free, and design a new generative subgraph augmentation method based on a diffused variational subgraph autoencoder, and we propose exploratory and exploitable views for subgraph contrastive learning. Extensive experiment results on three real-world datasets show the superiority of our proposed method over state-of-the-art baselines.

📄 PDF Abstract BibTeX arXiv:2211.00572

Code (1)

alvinisonomia/padel 공식 구현 pytorch

Tasks

Contrastive LearningPositionRepresentation Learning

Methods 이 논문이 사용한 방법론

fail 설명 없음
BASE 설명 없음

Similar Papers 제목 키워드 기반

Structure-Aware Transformer for Graph Representation Learning

2022-02-07 · Dexiong Chen, Leslie O'Bray, Karsten Borgwardt

The Transformer architecture has gained growing attention in graph representation learning recently, as it naturally overcomes several limitations of graph neural networks (GNNs) by avoiding their strict structural induc…

Emotion Recognition in ConversationGraph Representation LearningRepresentation Learning

Atomic and Subgraph-aware Bilateral Aggregation for Molecular Representation Learning

2023-05-22 · Jiahao Chen, Yurou Liu, Jiangmeng Li, Bing Su 외

Molecular representation learning is a crucial task in predicting molecular properties. Molecules are often modeled as graphs where atoms and chemical bonds are represented as nodes and edges, respectively, and Graph Neu…

Molecular Property Predictionmolecular representationProperty PredictionRepresentation Learning+1

Learn to Cluster Faces with Better Subgraphs

2023-04-21 · Yuan Cao, Di Jiang, Guanqun Hou, Fan Deng 외

Face clustering can provide pseudo-labels to the massive unlabeled face data and improve the performance of different face recognition models. The existing clustering methods generally aggregate the features within subgr…

ClusteringFace ClusteringFace Recognition

Hierarchy-Aware Neural Subgraph Matching with Enhanced Similarity Measure

2025-10-01 · Zhouyang Liu, Ning Liu, Yixin Chen, Jiezhong He 외 arxiv

Subgraph matching is challenging as it necessitates time-consuming combinatorial searches. Recent Graph Neural Network (GNN)-based approaches address this issue by employing GNN encoders to extract graph information and …

Graph Neural Network

Subgraphormer: Unifying Subgraph GNNs and Graph Transformers via Graph Products

2024-02-13 · Guy Bar-Shalom, Beatrice Bevilacqua, Haggai Maron

In the realm of Graph Neural Networks (GNNs), two exciting research directions have recently emerged: Subgraph GNNs and Graph Transformers. In this paper, we propose an architecture that integrates both approaches, dubbe…