paper-with-me

홈 › Papers

Beyond Smoothing: Unsupervised Graph Representation Learning with Edge Heterophily Discriminating

2022-11-25 · Yixin Liu, Yizhen Zheng, Daokun Zhang, Vincent CS Lee, Shirui Pan

Unsupervised graph representation learning (UGRL) has drawn increasing research attention and achieved promising results in several graph analytic tasks. Relying on the homophily assumption, existing UGRL methods tend to smooth the learned node representations along all edges, ignoring the existence of heterophilic edges that connect nodes with distinct attributes. As a result, current methods are hard to generalize to heterophilic graphs where dissimilar nodes are widely connected, and also vulnerable to adversarial attacks. To address this issue, we propose a novel unsupervised Graph Representation learning method with Edge hEterophily discriminaTing (GREET) which learns representations by discriminating and leveraging homophilic edges and heterophilic edges. To distinguish two types of edges, we build an edge discriminator that infers edge homophily/heterophily from feature and structure information. We train the edge discriminator in an unsupervised way through minimizing the crafted pivot-anchored ranking loss, with randomly sampled node pairs acting as pivots. Node representations are learned through contrasting the dual-channel encodings obtained from the discriminated homophilic and heterophilic edges. With an effective interplaying scheme, edge discriminating and representation learning can mutually boost each other during the training phase. We conducted extensive experiments on 14 benchmark datasets and multiple learning scenarios to demonstrate the superiority of GREET.

📄 PDF Abstract BibTeX arXiv:2211.14065

Code (1)

yixinliu233/greet 공식 구현 pytorch

Tasks

Graph Representation LearningRepresentation Learning

Similar Papers 제목 키워드 기반

More Discriminative Sentence Embeddings via Semantic Graph Smoothing

2024-02-20 · Chakib Fettal, Lazhar Labiod, Mohamed Nadif

This paper explores an empirical approach to learn more discriminantive sentence representations in an unsupervised fashion. Leveraging semantic graph smoothing, we enhance sentence embeddings obtained from pretrained mo…

ClusteringSentenceSentence EmbeddingsText Clustering

Smoothness Really Matters: A Simple Yet Effective Approach for Unsupervised Graph Domain Adaptation

2024-12-16 · Wei Chen, Guo Ye, Yakun Wang, Zhao Zhang 외

Unsupervised Graph Domain Adaptation (UGDA) seeks to bridge distribution shifts between domains by transferring knowledge from labeled source graphs to given unlabeled target graphs. Existing UGDA methods primarily focus…

Domain AdaptationGRAPH DOMAIN ADAPTATIONTransfer Learning

Deep Unsupervised Active Learning on Learnable Graphs

2021-11-08 · Handong Ma, Changsheng Li, Xinchu Shi, Ye Yuan 외

Recently deep learning has been successfully applied to unsupervised active learning. However, current method attempts to learn a nonlinear transformation via an auto-encoder while ignoring the sample relation, leaving h…

Active LearningGraph structure learningRelationRepresentation Learning

Unsupervised Deep Manifold Attributed Graph Embedding

2021-04-27 · Zelin Zang, Siyuan Li, Di wu, Jianzhu Guo 외

Unsupervised attributed graph representation learning is challenging since both structural and feature information are required to be represented in the latent space. Existing methods concentrate on learning latent repre…

ClusteringGraph EmbeddingGraph Representation LearningLink Prediction+2

Graph Construction using Principal Axis Trees for Simple Graph Convolution

2023-02-22 · Mashaan Alshammari, John Stavrakakis, Adel F. Ahmed, Masahiro Takatsuka

Graph Neural Networks (GNNs) are increasingly becoming the favorite method for graph learning. They exploit the semi-supervised nature of deep learning, and they bypass computational bottlenecks associated with tradition…

graph constructionGraph EmbeddingGraph Learninggraph partitioning+1