paper-with-me

홈 › Papers

Bootstrapping Heterogeneous Graph Representation Learning via Large Language Models: A Generalized Approach

2024-12-11 · Hang Gao, Chenhao Zhang, Fengge Wu, Junsuo Zhao, Changwen Zheng, Huaping Liu

Graph representation learning methods are highly effective in handling complex non-Euclidean data by capturing intricate relationships and features within graph structures. However, traditional methods face challenges when dealing with heterogeneous graphs that contain various types of nodes and edges due to the diverse sources and complex nature of the data. Existing Heterogeneous Graph Neural Networks (HGNNs) have shown promising results but require prior knowledge of node and edge types and unified node feature formats, which limits their applicability. Recent advancements in graph representation learning using Large Language Models (LLMs) offer new solutions by integrating LLMs' data processing capabilities, enabling the alignment of various graph representations. Nevertheless, these methods often overlook heterogeneous graph data and require extensive preprocessing. To address these limitations, we propose a novel method that leverages the strengths of both LLM and GNN, allowing for the processing of graph data with any format and type of nodes and edges without the need for type information or special preprocessing. Our method employs LLM to automatically summarize and classify different data formats and types, aligns node features, and uses a specialized GNN for targeted learning, thus obtaining effective graph representations for downstream tasks. Theoretical analysis and experimental validation have demonstrated the effectiveness of our method.

📄 PDF Abstract BibTeX arXiv:2412.08038

Code (0)

등록된 구현이 없습니다.

Tasks

Graph Representation LearningRepresentation Learning

Similar Papers 제목 키워드 기반

Cross-view Self-Supervised Learning on Heterogeneous Graph Neural Network via Bootstrapping

2022-01-10 · Minjae Park

Heterogeneous graph neural networks can represent information of heterogeneous graphs with excellent ability. Recently, self-supervised learning manner is researched which learns the unique expression of a graph through …

Contrastive LearningGraph Neural NetworkSelf-Supervised Learning

Bootstrapping NLP tools across low-resourced African languages: an overview and prospects

2022-10-21 · C. Maria Keet

Computing and Internet access are substantially growing markets in Southern Africa, which brings with it increasing demands for local content and tools in indigenous African languages. Since most of those languages are l…

DiversityText Generation

The Structural Sources of Verb Meaning Revisited: Large Language Models Display Syntactic Bootstrapping

2025-08-17 · Xiaomeng Zhu, R. Thomas McCoy, Robert Frank arxiv

Syntactic bootstrapping (Gleitman, 1990) is the hypothesis that children use the syntactic environments in which a verb occurs to learn its meaning. In this paper, we examine whether large language models exhibit a simil…

HealthGPT: A Medical Large Vision-Language Model for Unifying Comprehension and Generation via Heterogeneous Knowledge Adaptation

2025-02-14 · Tianwei Lin, Wenqiao Zhang, Sijing Li, Yuqian Yuan 외

We present HealthGPT, a powerful Medical Large Vision-Language Model (Med-LVLM) that integrates medical visual comprehension and generation capabilities within a unified autoregressive paradigm. Our bootstrapping philoso…

Language ModelingLanguage ModellingPhilosophy

Bootstrapping Sentiment Labels For Unannotated Documents With Polarity PageRank

2012-05-01 · LREC 2012 5 · Christian Scheible, Hinrich Sch{\"u}tze

We present a novel graph-theoretic method for the initial annotation of high-confidence training data for bootstrapping sentiment classifiers. We estimate polarity using topic-specific PageRank. Sentiment information is …

Document ClassificationGeneral ClassificationSentiment Analysis