paper-with-me

홈 › Papers

Graph Structure Refinement with Energy-based Contrastive Learning

2024-12-20 · Xianlin Zeng, Yufeng Wang, Yuqi Sun, Guodong Guo, Baochang Zhang, Wenrui Ding

Graph Neural Networks (GNNs) have recently gained widespread attention as a successful tool for analyzing graph-structured data. However, imperfect graph structure with noisy links lacks enough robustness and may damage graph representations, therefore limiting the GNNs' performance in practical tasks. Moreover, existing generative architectures fail to fit discriminative graph-related tasks. To tackle these issues, we introduce an unsupervised method based on a joint of generative training and discriminative training to learn graph structure and representation, aiming to improve the discriminative performance of generative models. We propose an Energy-based Contrastive Learning (ECL) guided Graph Structure Refinement (GSR) framework, denoted as ECL-GSR. To our knowledge, this is the first work to combine energy-based models with contrastive learning for GSR. Specifically, we leverage ECL to approximate the joint distribution of sample pairs, which increases the similarity between representations of positive pairs while reducing the similarity between negative ones. Refined structure is produced by augmenting and removing edges according to the similarity metrics among node representations. Extensive experiments demonstrate that ECL-GSR outperforms the state-of-the-art on eight benchmark datasets in node classification. ECL-GSR achieves faster training with fewer samples and memories against the leading baseline, highlighting its simplicity and efficiency in downstream tasks.

📄 PDF Abstract BibTeX arXiv:2412.17856

Code (0)

등록된 구현이 없습니다.

Tasks

Contrastive LearningNode Classification

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음
Contrastive Learning 설명 없음

Similar Papers 제목 키워드 기반

Graph-level Protein Representation Learning by Structure Knowledge Refinement

2024-01-05 · Ge Wang, Zelin Zang, Jiangbin Zheng, Jun Xia 외

This paper focuses on learning representation on the whole graph level in an unsupervised manner. Learning graph-level representation plays an important role in a variety of real-world issues such as molecule property pr…

Contrastive LearningProperty PredictionRepresentation Learning

Reasoning as Energy Minimization over Structured Latent Trajectories

2026-03-30 · David K. Johansson arxiv

Single-shot neural decoders commit to answers without iterative refinement, while chain-of-thought methods introduce discrete intermediate steps but lack a scalar measure of reasoning progress. We propose Energy-Based Re…

AmGCL: Feature Imputation of Attribute Missing Graph via Self-supervised Contrastive Learning

2023-05-05 · Xiaochuan Zhang, Mengran Li, Ye Wang, Haojun Fei

Attribute graphs are ubiquitous in multimedia applications, and graph representation learning (GRL) has been successful in analyzing attribute graph data. However, incomplete graph data and missing node attributes can ha…

AttributeContrastive LearningGraph Representation LearningImputation+2

PASCL: Supervised Contrastive Learning with Perturbative Augmentation for Particle Decay Reconstruction

2024-02-18 · Junjian Lu, Siwei Liu, Dmitrii Kobylianski, Etienne Dreyer 외

In high-energy physics, particles produced in collision events decay in a format of a hierarchical tree structure, where only the final decay products can be observed using detectors. However, the large combinatorial spa…

Contrastive Learning

Are LLMs Better GNN Helpers? Rethinking Robust Graph Learning under Deficiencies with Iterative Refinement

2025-10-02 · Zhaoyan Wang, Zheng Gao, Arogya Kharel, In-Young Ko arxiv

Graph Neural Networks (GNNs) are widely adopted in Web-related applications, serving as a core technique for learning from graph-structured data, such as text-attributed graphs. Yet in real-world scenarios, such graphs e…

Contrastive LearningGraph Learning