paper-with-me

홈 › Papers

Graph Self-Supervised Learning with Learnable Structural and Positional Encodings

2025-02-22 · Asiri Wijesinghe, Hao Zhu, Piotr Koniusz

Traditional Graph Self-Supervised Learning (GSSL) struggles to capture complex structural properties well. This limitation stems from two main factors: (1) the inadequacy of conventional Graph Neural Networks (GNNs) in representing sophisticated topological features, and (2) the focus of self-supervised learning solely on final graph representations. To address these issues, we introduce \emph{GenHopNet}, a GNN framework that integrates a $k$-hop message-passing scheme, enhancing its ability to capture local structural information without explicit substructure extraction. We theoretically demonstrate that \emph{GenHopNet} surpasses the expressiveness of the classical Weisfeiler-Lehman (WL) test for graph isomorphism. Furthermore, we propose a structural- and positional-aware GSSL framework that incorporates topological information throughout the learning process. This approach enables the learning of representations that are both sensitive to graph topology and invariant to specific structural and feature augmentations. Comprehensive experiments on graph classification datasets, including those designed to test structural sensitivity, show that our method consistently outperforms the existing approaches and maintains computational efficiency. Our work significantly advances GSSL's capability in distinguishing graphs with similar local structures but different global topologies.

📄 PDF Abstract BibTeX arXiv:2502.16233

Code (1)

wokas36/structposgssl 공식 구현 pytorch

Tasks

Computational EfficiencyGraph ClassificationSelf-Supervised Learning

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

Graph Neural Networks with Learnable Structural and Positional Representations

2021-10-15 · ICLR 2022 4 · Vijay Prakash Dwivedi, Anh Tuan Luu, Thomas Laurent, Yoshua Bengio 외

Graph neural networks (GNNs) have become the standard learning architectures for graphs. GNNs have been applied to numerous domains ranging from quantum chemistry, recommender systems to knowledge graphs and natural lang…

Graph RegressionKnowledge GraphsRecommendation Systems

Does Structural Attention Improve Compositional Representations in Vision-Language Models?

2022-12-03 · NeurIPS Workshop: Self-Supervised Learning - Theory and Practice 2022 12 · Rohan Pandey, Rulin Shao, Paul Pu Liang, Louis-Philippe Morency

Although scaling self-supervised approaches has gained widespread success in Vision-Language pre-training, a number of works providing structural knowledge of visually-grounded semantics have recently shown incremental…

Visual Reasoning

Graph Positional and Structural Encoder

2023-07-14 · Semih Cantürk, Renming Liu, Olivier Lapointe-Gagné, Vincent Létourneau 외

Positional and structural encodings (PSE) enable better identifiability of nodes within a graph, rendering them essential tools for empowering modern GNNs, and in particular graph Transformers. However, designing PSEs th…

Mitigating Degree Bias in Graph Representation Learning with Learnable Structural Augmentation and Structural Self-Attention

2025-04-21 · Van Thuy Hoang, Hyeon-Ju Jeon, O-Joun Lee

Graph Neural Networks (GNNs) update node representations through message passing, which is primarily based on the homophily principle, assuming that adjacent nodes share similar features. However, in real-world graphs wi…

FairnessGraph Representation LearningNode ClassificationNode Clustering+2

Learnable Spatial-Temporal Positional Encoding for Link Prediction

2025-06-10 · Katherine Tieu, Dongqi Fu, Zihao Li, Ross Maciejewski 외

Accurate predictions rely on the expressiveness power of graph deep learning frameworks like graph neural networks and graph transformers, where a positional encoding mechanism has become much more indispensable in recen…

Link PredictionPrediction