paper-with-me

홈 › Papers

You do not have to train Graph Neural Networks at all on text-attributed graphs

2024-04-17 · Kaiwen Dong, Zhichun Guo, Nitesh V. Chawla

Graph structured data, specifically text-attributed graphs (TAG), effectively represent relationships among varied entities. Such graphs are essential for semi-supervised node classification tasks. Graph Neural Networks (GNNs) have emerged as a powerful tool for handling this graph-structured data. Although gradient descent is commonly utilized for training GNNs for node classification, this study ventures into alternative methods, eliminating the iterative optimization processes. We introduce TrainlessGNN, a linear GNN model capitalizing on the observation that text encodings from the same class often cluster together in a linear subspace. This model constructs a weight matrix to represent each class's node attribute subspace, offering an efficient approach to semi-supervised node classification on TAG. Extensive experiments reveal that our trainless models can either match or even surpass their conventionally trained counterparts, demonstrating the possibility of refraining from gradient descent in certain configurations.

📄 PDF Abstract BibTeX arXiv:2404.11019

Code (0)

등록된 구현이 없습니다.

Tasks

AllAttributeClassificationNode ClassificationTAG

Similar Papers 제목 키워드 기반

Can LLMs Convert Graphs to Text-Attributed Graphs?

2024-12-13 · Zehong Wang, Sidney Liu, Zheyuan Zhang, Tianyi Ma 외

Graphs are ubiquitous data structures found in numerous real-world applications, such as drug discovery, recommender systems, and social network analysis. Graph neural networks (GNNs) have become a popular tool to learn …

Drug DiscoveryRecommendation Systems

Deep Bayesian Optimization on Attributed Graphs

2019-05-31 · Jiaxu Cui, Bo Yang, Xia Hu

Attributed graphs, which contain rich contextual features beyond just network structure, are ubiquitous and have been observed to benefit various network analytics applications. Graph structure optimization, aiming to fi…

Bayesian OptimizationGaussian ProcessesGraph Neural Network

LLM-Enhanced Energy Contrastive Learning for Out-of-Distribution Detection in Text-Attributed Graphs

2026-03-19 · Xiaoxu Ma, Dong Li, Minglai Shao, Xintao Wu 외 arxiv

Text-attributed graphs, where nodes are enriched with textual attributes, have become a powerful tool for modeling real-world networks such as citation, social, and transaction networks. However, existing methods for lea…

Out-of-Distribution DetectionContrastive LearningNode Classification

GRENADE: Graph-Centric Language Model for Self-Supervised Representation Learning on Text-Attributed Graphs

2023-10-23 · Yichuan Li, Kaize Ding, Kyumin Lee

Self-supervised representation learning on text-attributed graphs, which aims to create expressive and generalizable representations for various downstream tasks, has received increasing research attention lately. Howeve…

Contrastive LearningGraph Neural NetworkLanguage ModelingLanguage Modelling+2

SaVe-TAG: Semantic-aware Vicinal Risk Minimization for Long-Tailed Text-Attributed Graphs

2024-10-22 · Leyao Wang, Yu Wang, Bo Ni, Yuying Zhao 외

Real-world graph data often follows long-tailed distributions, making it difficult for Graph Neural Networks (GNNs) to generalize well across both head and tail classes. Recent advances in Vicinal Risk Minimization (VRM)…

ClassificationData AugmentationLanguage ModelingLanguage Modelling+3