paper-with-me

홈 › Papers

Graph Structure Learning with Variational Information Bottleneck

2021-12-16 · Qingyun Sun, JianXin Li, Hao Peng, Jia Wu, Xingcheng Fu, Cheng Ji, Philip S. Yu

Graph Neural Networks (GNNs) have shown promising results on a broad spectrum of applications. Most empirical studies of GNNs directly take the observed graph as input, assuming the observed structure perfectly depicts the accurate and complete relations between nodes. However, graphs in the real world are inevitably noisy or incomplete, which could even exacerbate the quality of graph representations. In this work, we propose a novel Variational Information Bottleneck guided Graph Structure Learning framework, namely VIB-GSL, in the perspective of information theory. VIB-GSL advances the Information Bottleneck (IB) principle for graph structure learning, providing a more elegant and universal framework for mining underlying task-relevant relations. VIB-GSL learns an informative and compressive graph structure to distill the actionable information for specific downstream tasks. VIB-GSL deduces a variational approximation for irregular graph data to form a tractable IB objective function, which facilitates training stability. Extensive experimental results demonstrate that the superior effectiveness and robustness of VIB-GSL.

📄 PDF Abstract BibTeX arXiv:2112.08903

Code (1)

ringbdstack/vib-gsl 공식 구현 pytorch

Tasks

Graph structure learning

Similar Papers 제목 키워드 기반

Improving Subgraph Recognition with Variational Graph Information Bottleneck

2021-12-18 · CVPR 2022 1 · Junchi Yu, Jie Cao, Ran He

Subgraph recognition aims at discovering a compressed substructure of a graph that is most informative to the graph property. It can be formulated by optimizing Graph Information Bottleneck (GIB) with a mutual informatio…

Graph Classification

Deep Variational Multivariate Information Bottleneck -- A Framework for Variational Losses

2023-10-05 · Eslam Abdelaleem, Ilya Nemenman, K. Michael Martini

Variational dimensionality reduction methods are widely used for their accuracy, generative capabilities, and robustness. We introduce a unifying framework that generalizes both such as traditional and state-of-the-art m…

Contrastive LearningDecoderDimensionality ReductionRepresentation Learning

Graph Structure Learning with Temporal Graph Information Bottleneck for Inductive Representation Learning

2025-08-20 · Jiafeng Xiong, Rizos Sakellariou arxiv

Temporal graph learning is crucial for dynamic networks where nodes and edges evolve over time and new nodes continuously join the system. Inductive representation learning in such settings faces two major challenges: ef…

Graph structure learningRepresentation LearningGraph Learning

Towards Consistency and Complementarity: A Multiview Graph Information Bottleneck Approach

2022-10-11 · Xiaolong Fan, Maoguo Gong, Yue Wu, Mingyang Zhang 외

The empirical studies of Graph Neural Networks (GNNs) broadly take the original node feature and adjacency relationship as singleview input, ignoring the rich information of multiple graph views. To circumvent this issue…

Discrete Curvature Graph Information Bottleneck

2024-12-28 · Xingcheng Fu, Jian Wang, Yisen Gao, Qingyun Sun 외

Graph neural networks(GNNs) have been demonstrated to depend on whether the node effective information is sufficiently passing. Discrete curvature (Ricci curvature) is used to study graph connectivity and information pro…