paper-with-me

Papers

LlamaRec-LKG-RAG: A Single-Pass, Learnable Knowledge Graph-RAG Framework for LLM-Based Ranking

2025-06-09 · Vahid Azizi, Fatemeh Koochaki

Recent advances in Large Language Models (LLMs) have driven their adoption in recommender systems through Retrieval-Augmented Generation (RAG) frameworks. However, existing RAG approaches predominantly rely on flat, similarity-based retrieval that fails to leverage the rich relational structure inherent in user-item interactions. We introduce LlamaRec-LKG-RAG, a novel single-pass, end-to-end trainable framework that integrates personalized knowledge graph context into LLM-based recommendation ranking. Our approach extends the LlamaRec architecture by incorporating a lightweight user preference module that dynamically identifies salient relation paths within a heterogeneous knowledge graph constructed from user behavior and item metadata. These personalized subgraphs are seamlessly integrated into prompts for a fine-tuned Llama-2 model, enabling efficient and interpretable recommendations through a unified inference step. Comprehensive experiments on ML-100K and Amazon Beauty datasets demonstrate consistent and significant improvements over LlamaRec across key ranking metrics (MRR, NDCG, Recall). LlamaRec-LKG-RAG demonstrates the critical value of structured reasoning in LLM-based recommendations and establishes a foundation for scalable, knowledge-aware personalization in next-generation recommender systems. Code is available at~\href{https://github.com/VahidAz/LlamaRec-LKG-RAG}{repository}.

📄 PDF Abstract BibTeX arXiv:2506.07449

Code (1)

vahidaz/llamarec-lkg-rag 공식 구현 pytorch

Tasks

RAGRecommendation SystemsRetrievalRetrieval-augmented Generation

Methods 이 논문이 사용한 방법론

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Attention 설명 없음
WordPiece 설명 없음
Weight Decay 설명 없음
Multi-Head Attention 설명 없음
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…

Similar Papers 제목 키워드 기반

LlamaRec: Two-Stage Recommendation using Large Language Models for Ranking

2023-10-25 · Zhenrui Yue, Sara Rabhi, Gabriel de Souza Pereira Moreira, Dong Wang 외

Recently, large language models (LLMs) have exhibited significant progress in language understanding and generation. By leveraging textual features, customized LLMs are also applied for recommendation and demonstrate imp…

Movie Recommendation

Visualization and Analysis of the Loss Landscape in Graph Neural Networks

2025-09-15 · Samir Moustafa, Lorenz Kummer, Simon Fetzel, Nils M. Kriege 외 arxiv

Graph Neural Networks (GNNs) are powerful models for graph-structured data, with broad applications. However, the interplay between GNN parameter optimization, expressivity, and generalization remains poorly understood. …

Dimensionality Reduction

Scene Graph Generation Strategy with Co-occurrence Knowledge and Learnable Term Frequency

2024-05-21 · Hyeongjin Kim, Sangwon Kim, Dasom Ahn, Jong Taek Lee 외

Scene graph generation (SGG) is an important task in image understanding because it represents the relationships between objects in an image as a graph structure, making it possible to understand the semantic relationshi…

Graph GenerationScene Graph Generation

Leap: Inductive Link Prediction via Learnable TopologyAugmentation

2025-03-05 · Ahmed E. Samy, Zekarias T. Kefato, Sarunas Girdzijauskas

Link prediction is a crucial task in many downstream applications of graph machine learning. To this end, Graph Neural Network (GNN) is a widely used technique for link prediction, mainly in transductive settings, where …

Graph Neural NetworkInductive BiasInductive Link PredictionLink Prediction+1

Towards Dynamic Message Passing on Graphs

2024-10-31 · Junshu Sun, Chenxue Yang, Xiangyang Ji, Qingming Huang 외

Message passing plays a vital role in graph neural networks (GNNs) for effective feature learning. However, the over-reliance on input topology diminishes the efficacy of message passing and restricts the ability of GNNs…

Graph Classification