Self-organization Preserved Graph Structure Learning with Principle of Relevant Information
Most Graph Neural Networks follow the message-passing paradigm, assuming the observed structure depicts the ground-truth node relationships. However, this fundamental assumption cannot always be satisfied, as real-world graphs are always incomplete, noisy, or redundant. How to reveal the inherent graph structure in a unified way remains under-explored. We proposed PRI-GSL, a Graph Structure Learning framework guided by the Principle of Relevant Information, providing a simple and unified framework for identifying the self-organization and revealing the hidden structure. PRI-GSL learns a structure that contains the most relevant yet least redundant information quantified by von Neumann entropy and Quantum Jensen-Shannon divergence. PRI-GSL incorporates the evolution of quantum continuous walk with graph wavelets to encode node structural roles, showing in which way the nodes interplay and self-organize with the graph structure. Extensive experiments demonstrate the superior effectiveness and robustness of PRI-GSL.
Code (0)
등록된 구현이 없습니다.
Tasks
Graph structure learningSimilar Papers 제목 키워드 기반
On Principles of Emergent Organization
After more than a century of concerted effort, physics still lacks basic principles of spontaneous self-organization. To appreciate why, we first state the problem, outline historical approaches, and survey the present s…
Multicellular self-organization in Escherichia coli
Escherichia coli has long been a trusty companion, maintaining health in our guts and advancing biological knowledge in the laboratory. In light of recent findings, we discuss multicellular self-organization in E. coli a…
Core-Periphery Principle Guided Redesign of Self-Attention in Transformers
Designing more efficient, reliable, and explainable neural network architectures is critical to studies that are based on artificial intelligence (AI) techniques. Previous studies, by post-hoc analysis, have found that t…
Self-organized MT Direction Maps Emerge from Spatiotemporal Contrastive Optimization
The spatial and functional organization of the primate visual cortex is a fundamental problem in neuroscience. While recent computational frameworks like the Topographic Deep Artificial Neural Network (TDANN) have succes…
Four Classes of Morphogenetic Collective Systems
We studied the roles of morphogenetic principles---heterogeneity of components, dynamic differentiation/re-differentiation of components, and local information sharing among components---in the self-organization of morph…