paper-with-me

Papers

An Automatic Graph Construction Framework based on Large Language Models for Recommendation

2024-12-24 · Rong Shan, Jianghao Lin, Chenxu Zhu, Bo Chen, Menghui Zhu, Kangning Zhang, Jieming Zhu, Ruiming Tang, Yong Yu, Weinan Zhang

Graph neural networks (GNNs) have emerged as state-of-the-art methods to learn from graph-structured data for recommendation. However, most existing GNN-based recommendation methods focus on the optimization of model structures and learning strategies based on pre-defined graphs, neglecting the importance of the graph construction stage. Earlier works for graph construction usually rely on speciffic rules or crowdsourcing, which are either too simplistic or too labor-intensive. Recent works start to utilize large language models (LLMs) to automate the graph construction, in view of their abundant open-world knowledge and remarkable reasoning capabilities. Nevertheless, they generally suffer from two limitations: (1) invisibility of global view (e.g., overlooking contextual information) and (2) construction inefficiency. To this end, we introduce AutoGraph, an automatic graph construction framework based on LLMs for recommendation. Specifically, we first use LLMs to infer the user preference and item knowledge, which is encoded as semantic vectors. Next, we employ vector quantization to extract the latent factors from the semantic vectors. The latent factors are then incorporated as extra nodes to link the user/item nodes, resulting in a graph with in-depth global-view semantics. We further design metapath-based message aggregation to effectively aggregate the semantic and collaborative information. The framework is model-agnostic and compatible with different backbone models. Extensive experiments on three real-world datasets demonstrate the efficacy and efffciency of AutoGraph compared to existing baseline methods. We have deployed AutoGraph in Huawei advertising platform, and gain a 2.69% improvement on RPM and a 7.31% improvement on eCPM in the online A/B test. Currently AutoGraph has been used as the main trafffc model, serving hundreds of millions of people.

📄 PDF Abstract BibTeX arXiv:2412.18241

Code (1)

lavieenrose365/autograph 공식 구현 pytorch

Tasks

graph constructionQuantizationWorld Knowledge

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

Construction of Knowledge Graph based on Language Model

2026-04-21 · Qiubai Zhu, Qingwang Wang, Haibin Yuan, Wei Chen 외 arxiv

Knowledge Graph (KG) can effectively integrate valuable information from massive data, and thus has been rapidly developed and widely used in many fields. Traditional KG construction methods rely on manual annotation, wh…

SAC-KG: Exploiting Large Language Models as Skilled Automatic Constructors for Domain Knowledge Graphs

2024-09-22 · Hanzhu Chen, Xu Shen, Qitan Lv, Jie Wang 외

Knowledge graphs (KGs) play a pivotal role in knowledge-intensive tasks across specialized domains, where the acquisition of precise and dependable knowledge is crucial. However, existing KG construction methods heavily …

Knowledge Graphs

AttacKG+:Boosting Attack Knowledge Graph Construction with Large Language Models

2024-05-08 · Yongheng Zhang, Tingwen Du, Yunshan Ma, Xiang Wang 외

Attack knowledge graph construction seeks to convert textual cyber threat intelligence (CTI) reports into structured representations, portraying the evolutionary traces of cyber attacks. Even though previous research has…

graph constructionIn-Context LearningKnowledge Graphs

KGValidator: A Framework for Automatic Validation of Knowledge Graph Construction

2024-04-24 · Jack Boylan, Shashank Mangla, Dominic Thorn, Demian Gholipour Ghalandari 외

This study explores the use of Large Language Models (LLMs) for automatic evaluation of knowledge graph (KG) completion models. Historically, validating information in KGs has been a challenging task, requiring large-sca…

Fact Checkinggraph constructionKnowledge GraphsRetrieval

Robustness of Graph Self-Supervised Learning to Real-World Noise: A Case Study on Text-Driven Biomedical Graphs

2026-05-06 · Othmane Kabal, Mounira Harzallah, Fabrice Guillet, Hideaki Takeda 외 arxiv

Graph Self-Supervised Learning (GSSL) offers a powerful paradigm for learning graph representations without labeled data. However, existing work assumes clean, manually curated graphs. Recent advances in NLP enable the l…

Self-Supervised LearningGraph Neural NetworkKnowledge Graphs