paper-with-me

홈 › Papers

RALLRec: Improving Retrieval Augmented Large Language Model Recommendation with Representation Learning

2025-02-10 · Jian Xu, Sichun Luo, Xiangyu Chen, Haoming Huang, Hanxu Hou, Linqi Song

Large Language Models (LLMs) have been integrated into recommendation systems to enhance user behavior comprehension. The Retrieval Augmented Generation (RAG) technique is further incorporated into these systems to retrieve more relevant items and improve system performance. However, existing RAG methods rely primarily on textual semantics and often fail to incorporate the most relevant items, limiting the effectiveness of the systems. In this paper, we propose Representation learning for retrieval-Augmented Large Language model Recommendation (RALLRec). Specifically, we enhance textual semantics by prompting LLMs to generate more detailed item descriptions, followed by joint representation learning of textual and collaborative semantics, which are extracted by the LLM and recommendation models, respectively. Considering the potential time-varying characteristics of user interest, a simple yet effective reranking method is further introduced to capture the dynamics of user preference. We conducted extensive experiments on three real-world datasets, and the evaluation results validated the effectiveness of our method. Code is made public at https://github.com/JianXu95/RALLRec.

📄 PDF Abstract BibTeX arXiv:2502.06101

Code (1)

jianxu95/rallrec 공식 구현 pytorch

Tasks

Language ModelingLanguage ModellingLarge Language ModelRAGRecommendation SystemsRepresentation LearningRerankingRetrievalRetrieval-augmented Generation

Methods 이 논문이 사용한 방법론

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Attention 설명 없음
Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.
Weight Decay 설명 없음
WordPiece 설명 없음
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…

Similar Papers 제목 키워드 기반

RALLRec+: Retrieval Augmented Large Language Model Recommendation with Reasoning

2025-03-26 · Sichun Luo, Jian Xu, Xiaojie Zhang, Linrong Wang 외

Large Language Models (LLMs) have been integrated into recommender systems to enhance user behavior comprehension. The Retrieval Augmented Generation (RAG) technique is further incorporated into these systems to retrieve…

Language ModelingLanguage ModellingLarge Language ModelRAG+5

ARAG: Agentic Retrieval Augmented Generation for Personalized Recommendation

2025-06-27 · Reza Yousefi Maragheh, Pratheek Vadla, Priyank Gupta, Kai Zhao 외

Retrieval-Augmented Generation (RAG) has shown promise in enhancing recommendation systems by incorporating external context into large language model prompts. However, existing RAG-based approaches often rely on static …

Large Language ModelNatural Language InferenceRAGRecommendation Systems+2

Graph Retrieval-Augmented LLM for Conversational Recommendation Systems

2025-03-09 · Zhangchi Qiu, Linhao Luo, Zicheng Zhao, Shirui Pan 외

Conversational Recommender Systems (CRSs) have emerged as a transformative paradigm for offering personalized recommendations through natural language dialogue. However, they face challenges with knowledge sparsity, as u…

Conversational RecommendationIn-Context LearningLarge Language ModelNatural Language Understanding+3

Keyword-driven Retrieval-Augmented Large Language Models for Cold-start User Recommendations

2024-05-30 · Hai-Dang Kieu, Minh Duc Nguyen, Thanh-Son Nguyen, Dung D. Le

Recent advancements in Large Language Models (LLMs) have shown significant potential in enhancing recommender systems. However, addressing the cold-start recommendation problem, where users lack historical data, remains …

Recommendation SystemsRe-RankingRetrieval

G-Refer: Graph Retrieval-Augmented Large Language Model for Explainable Recommendation

2025-02-18 · Yuhan Li, Xinni Zhang, Linhao Luo, Heng Chang 외

Explainable recommendation has demonstrated significant advantages in informing users about the logic behind recommendations, thereby increasing system transparency, effectiveness, and trustworthiness. To provide persona…

Collaborative FilteringExplainable RecommendationLanguage ModelingLanguage Modelling+2