paper-with-me

홈 › Papers

ULMRec: User-centric Large Language Model for Sequential Recommendation

2024-12-07 · Minglai Shao, Hua Huang, Qiyao Peng, Hongtao Liu

Recent advances in Large Language Models (LLMs) have demonstrated promising performance in sequential recommendation tasks, leveraging their superior language understanding capabilities. However, existing LLM-based recommendation approaches predominantly focus on modeling item-level co-occurrence patterns while failing to adequately capture user-level personalized preferences. This is problematic since even users who display similar behavioral patterns (e.g., clicking or purchasing similar items) may have fundamentally different underlying interests. To alleviate this problem, in this paper, we propose ULMRec, a framework that effectively integrates user personalized preferences into LLMs for sequential recommendation. Considering there has the semantic gap between item IDs and LLMs, we replace item IDs with their corresponding titles in user historical behaviors, enabling the model to capture the item semantics. For integrating the user personalized preference, we design two key components: (1) user indexing: a personalized user indexing mechanism that leverages vector quantization on user reviews and user IDs to generate meaningful and unique user representations, and (2) alignment tuning: an alignment-based tuning stage that employs comprehensive preference alignment tasks to enhance the model's capability in capturing personalized information. Through this design, ULMRec achieves deep integration of language semantics with user personalized preferences, facilitating effective adaptation to recommendation. Extensive experiments on two public datasets demonstrate that ULMRec significantly outperforms existing methods, validating the effectiveness of our approach.

📄 PDF Abstract BibTeX arXiv:2412.05543

Code (0)

등록된 구현이 없습니다.

Tasks

Language ModelingLanguage ModellingLarge Language ModelQuantizationSequential Recommendation

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

Pre-trained LLMs Meet Sequential Recommenders: Efficient User-Centric Knowledge Distillation

2026-04-23 · Nikita Severin, Danil Kartushov, Vladislav Urzhumov, Vladislav Kulikov 외 arxiv

Sequential recommender systems have achieved significant success in modeling temporal user behavior but remain limited in capturing rich user semantics beyond interaction patterns. Large Language Models (LLMs) present op…

Knowledge Distillation

Preference Adaptive and Sequential Text-to-Image Generation

2024-12-10 · Ofir Nabati, Guy Tennenholtz, ChihWei Hsu, MoonKyung Ryu 외

We address the problem of interactive text-to-image (T2I) generation, designing a reinforcement learning (RL) agent which iteratively improves a set of generated images for a user through a sequence of prompt expansions.…

Image GenerationLanguage ModelingLanguage ModellingReinforcement Learning (RL)+2

Beyond Learning from Next Item: Sequential Recommendation via Personalized Interest Sustainability

2022-09-14 · Dongmin Hyun, Chanyoung Park, Junsu Cho, Hwanjo Yu

Sequential recommender systems have shown effective suggestions by capturing users' interest drift. There have been two groups of existing sequential models: user- and item-centric models. The user-centric models capture…

Recommendation SystemsSequential Recommendation

Human-Centric Autonomous Systems With LLMs for User Command Reasoning

2023-11-14 · Yi Yang, Qingwen Zhang, Ci Li, Daniel Simões Marta 외

The evolution of autonomous driving has made remarkable advancements in recent years, evolving into a tangible reality. However, a human-centric large-scale adoption hinges on meeting a variety of multifaceted requiremen…

Autonomous DrivingBinary Classification

Mutual Harmony: Sequential Recommendation with Dual Contrastive Network

2022-09-18 · GuanYu Lin, Chen Gao, Yinfeng Li, Yu Zheng 외

With the outbreak of today's streaming data, the sequential recommendation is a promising solution to achieve time-aware personalized modeling. It aims to infer the next interacted item of a given user based on the histo…

Contrastive LearningRepresentation LearningSequential Recommendation