paper-with-me

Papers

Energy-Balanced Hyperspherical Graph Representation Learning via Structural Binding and Entropic Dispersion

2025-12-30 · Rui Chen, Junjun Guo, Hongbin Wang, Yan Xiang, Yantuan Xian, Zhengtao Yu arxiv

Graph Representation Learning (GRL) can be fundamentally modeled as a physical process of seeking an energy equilibrium state for a node system on a latent manifold. However, existing Graph Neural Networks (GNNs) often suffer from uncontrolled energy dissipation during message passing, driving the system towards a state of Thermal Death--manifested as feature collapse or over-smoothing--due to the absence of explicit thermodynamic constraints. To address this, we propose HyperGRL, a thermodynamics-driven framework that embeds nodes on a unit hypersphere by minimizing a Helmholtz free energy objective composed of two competing potentials. First, we introduce Structural Binding Energy (via Neighbor-Mean Alignment), which functions as a local binding force to strengthen structural cohesion, encouraging structurally related nodes to form compact local clusters. Second, to counteract representation collapse, we impose a Mean-Field Repulsive Potential (via Sampling-Free Uniformity), which acts as a global entropic force to maximize representation dispersion without the need for negative sampling. Crucially, to govern the trade-off between local alignment and global uniformity, we devise an Adaptive Thermostat. This entropy-guided strategy dynamically regulates the system's "temperature" during training, guiding the representation towards a robust metastable state that balances local cohesion with global discriminability. Extensive experiments on node classification, node clustering, and link prediction show that HyperGRL consistently achieves strong performance across diverse benchmark datasets, yielding more discriminative and robust representations while alleviating over-smoothing.

📄 PDF Abstract BibTeX arXiv:2512.24062

Code (0)

등록된 구현이 없습니다.

Tasks

Graph Representation LearningNode ClassificationLink Prediction

Similar Papers 제목 키워드 기반

Graph Size-imbalanced Learning with Energy-guided Structural Smoothing

2024-12-23 · Jiawen Qin, Pengfeng Huang, Qingyun Sun, Cheng Ji 외

Graph is a prevalent data structure employed to represent the relationships between entities, frequently serving as a tool to depict and simulate numerous systems, such as molecules and social networks. However, real-wor…

Graph Classification

Regularizing Neural Networks via Minimizing Hyperspherical Energy

2019-06-12 · CVPR 2020 6 · Rongmei Lin, Weiyang Liu, Zhen Liu, Chen Feng 외

Inspired by the Thomson problem in physics where the distribution of multiple propelling electrons on a unit sphere can be modeled via minimizing some potential energy, hyperspherical energy minimization has demonstrated…

Hyperspherically Regularized Networks for Self-Supervision

2021-04-29 · Aiden Durrant, Georgios Leontidis

Bootstrap Your Own Latent (BYOL) introduced an approach to self-supervised learning avoiding the contrastive paradigm and subsequently removing the computational burden of negative sampling associated with such methods. …

DiversitySelf-Supervised Learning

Confidence Calibration for Intent Detection via Hyperspherical Space and Rebalanced Accuracy-Uncertainty Loss

2022-03-17 · Yantao Gong, Cao Liu, Fan Yang, Xunliang Cai 외

Data-driven methods have achieved notable performance on intent detection, which is a task to comprehend user queries. Nonetheless, they are controversial for over-confident predictions. In some scenarios, users do not o…

Intent Detection

Transferable Parasitic Estimation via Graph Contrastive Learning and Label Rebalancing in AMS Circuits

2025-07-09 · Shan Shen, Shenglu Hua, Jiajun Zou, Jiawei Liu 외 arxiv

Graph representation learning on Analog-Mixed Signal (AMS) circuits is crucial for various downstream tasks, e.g., parasitic estimation. However, the scarcity of design data, the unbalanced distribution of labels, and th…

Graph Representation LearningContrastive LearningNode Classification