paper-with-me

Papers

LlamaRec: Two-Stage Recommendation using Large Language Models for Ranking

2023-10-25 · Zhenrui Yue, Sara Rabhi, Gabriel de Souza Pereira Moreira, Dong Wang, Even Oldridge

Recently, large language models (LLMs) have exhibited significant progress in language understanding and generation. By leveraging textual features, customized LLMs are also applied for recommendation and demonstrate improvements across diverse recommendation scenarios. Yet the majority of existing methods perform training-free recommendation that heavily relies on pretrained knowledge (e.g., movie recommendation). In addition, inference on LLMs is slow due to autoregressive generation, rendering existing methods less effective for real-time recommendation. As such, we propose a two-stage framework using large language models for ranking-based recommendation (LlamaRec). In particular, we use small-scale sequential recommenders to retrieve candidates based on the user interaction history. Then, both history and retrieved items are fed to the LLM in text via a carefully designed prompt template. Instead of generating next-item titles, we adopt a verbalizer-based approach that transforms output logits into probability distributions over the candidate items. Therefore, the proposed LlamaRec can efficiently rank items without generating long text. To validate the effectiveness of the proposed framework, we compare against state-of-the-art baseline methods on benchmark datasets. Our experimental results demonstrate the performance of LlamaRec, which consistently achieves superior performance in both recommendation performance and efficiency.

📄 PDF Abstract BibTeX arXiv:2311.02089

Code (2)

yueeeeeeee/llamarec 공식 구현 pytorch
pko89403/llm-for-recsys-shadow/tree/main/LlamaRec pytorch

Tasks

Movie Recommendation

Similar Papers 제목 키워드 기반

LlamaRec-LKG-RAG: A Single-Pass, Learnable Knowledge Graph-RAG Framework for LLM-Based Ranking

2025-06-09 · Vahid Azizi, Fatemeh Koochaki

Recent advances in Large Language Models (LLMs) have driven their adoption in recommender systems through Retrieval-Augmented Generation (RAG) frameworks. However, existing RAG approaches predominantly rely on flat, simi…

RAGRecommendation SystemsRetrievalRetrieval-augmented Generation

Improving the Performance of Sequential Recommendation Systems with an Extended Large Language Model

2025-07-26 · Sinnyum Choi, Woong Kim arxiv

Recently, competition in the field of artificial intelligence (AI) has intensified among major technological companies, resulting in the continuous release of new large-language models (LLMs) that exhibit improved langua…

Sequential RecommendationRecommendation Systems

GLoSS: Generative Language Models with Semantic Search for Sequential Recommendation

2025-06-02 · Krishna Acharya, Aleksandr V. Petrov, Juba Ziani

We propose Generative Low-rank language model with Semantic Search (GLoSS), a generative recommendation framework that combines large language models with dense retrieval for sequential recommendation. Unlike prior metho…

Sequential Recommendation

Towards the Better Ranking Consistency: A Multi-task Learning Framework for Early Stage Ads Ranking

2023-07-12 · Xuewei Wang, Qiang Jin, Shengyu Huang, Min Zhang 외

Dividing ads ranking system into retrieval, early, and final stages is a common practice in large scale ads recommendation to balance the efficiency and accuracy. The early stage ranking often uses efficient models to ge…

Multi-Task Learning

Killing Two Birds with One Stone: Unifying Retrieval and Ranking with a Single Generative Recommendation Model

2025-04-23 · Luankang Zhang, Kenan Song, Yi Quan Lee, Wei Guo 외

In recommendation systems, the traditional multi-stage paradigm, which includes retrieval and ranking, often suffers from information loss between stages and diminishes performance. Recent advances in generative models, …

Recommendation SystemsRetrieval