paper-with-me

Papers

Improving Textual Network Learning with Variational Homophilic Embeddings

2019-09-30 · NeurIPS 2019 12 · Wenlin Wang, Chenyang Tao, Zhe Gan, Guoyin Wang, Liqun Chen, Xinyuan Zhang, Ruiyi Zhang, Qian Yang, Ricardo Henao, Lawrence Carin

The performance of many network learning applications crucially hinges on the success of network embedding algorithms, which aim to encode rich network information into low-dimensional vertex-based vector representations. This paper considers a novel variational formulation of network embeddings, with special focus on textual networks. Different from most existing methods that optimize a discriminative objective, we introduce Variational Homophilic Embedding (VHE), a fully generative model that learns network embeddings by modeling the semantic (textual) information with a variational autoencoder, while accounting for the structural (topology) information through a novel homophilic prior design. Homophilic vertex embeddings encourage similar embedding vectors for related (connected) vertices. The proposed VHE promises better generalization for downstream tasks, robustness to incomplete observations, and the ability to generalize to unseen vertices. Extensive experiments on real-world networks, for multiple tasks, demonstrate that the proposed method consistently achieves superior performance relative to competing state-of-the-art approaches.

📄 PDF Abstract BibTeX arXiv:1909.13456

Code (1)

Wenlin-Wang/VHE19 공식 구현

Tasks

Network Embedding

Similar Papers 제목 키워드 기반

Language Model-Enhanced Message Passing for Heterophilic Graph Learning

2025-05-26 · Wenjun Wang, Dawei Cheng

Traditional graph neural networks (GNNs), which rely on homophily-driven message passing, struggle with heterophilic graphs where connected nodes exhibit dissimilar features and different labels. While existing methods a…

Active LearningGraph LearningLanguage ModelingLanguage Modelling

Imbalanced Node Classification Beyond Homophilic Assumption

2023-04-28 · Jie Liu, Mengting He, Guangtao Wang, Nguyen Quoc Viet Hung 외

Imbalanced node classification widely exists in real-world networks where graph neural networks (GNNs) are usually highly inclined to majority classes and suffer from severe performance degradation on classifying minorit…

ClassificationNode Classification

ClassContrast: Bridging the Spatial and Contextual Gaps for Node Representations

2024-10-03 · Md Joshem Uddin, Astrit Tola, Varin Sikand, Cuneyt Gurcan Akcora 외

Graph Neural Networks (GNNs) have revolutionized the domain of graph representation learning by utilizing neighborhood aggregation schemes in many popular architectures, such as message passing graph neural networks (MPG…

Graph Representation LearningLink PredictionNode ClassificationRepresentation Learning

Graph Attention Networks with Positional Embeddings

2021-05-09 · Liheng Ma, Reihaneh Rabbany, Adriana Romero-Soriano

Graph Neural Networks (GNNs) are deep learning methods which provide the current state of the art performance in node classification tasks. GNNs often assume homophily -- neighboring nodes having similar features and lab…

Graph AttentionNode ClassificationPOS

Variational Pretraining for Semi-supervised Text Classification

2019-06-05 · ACL 2019 7 · Suchin Gururangan, Tam Dang, Dallas Card, Noah A. Smith

We introduce VAMPIRE, a lightweight pretraining framework for effective text classification when data and computing resources are limited. We pretrain a unigram document model as a variational autoencoder on in-domain, u…

ClassificationGeneral ClassificationSemi-Supervised Text ClassificationText Classification