paper-with-me

Papers

PAP-REC: Personalized Automatic Prompt for Recommendation Language Model

2024-02-01 · Zelong Li, Jianchao Ji, Yingqiang Ge, Wenyue Hua, Yongfeng Zhang

Recently emerged prompt-based Recommendation Language Models (RLM) can solve multiple recommendation tasks uniformly. The RLMs make full use of the inherited knowledge learned from the abundant pre-training data to solve the downstream recommendation tasks by prompts, without introducing additional parameters or network training. However, handcrafted prompts require significant expertise and human effort since slightly rewriting prompts may cause massive performance changes. In this paper, we propose PAP-REC, a framework to generate the Personalized Automatic Prompt for RECommendation language models to mitigate the inefficiency and ineffectiveness problems derived from manually designed prompts. Specifically, personalized automatic prompts allow different users to have different prompt tokens for the same task, automatically generated using a gradient-based method. One challenge for personalized automatic prompt generation for recommendation language models is the extremely large search space, leading to a long convergence time. To effectively and efficiently address the problem, we develop surrogate metrics and leverage an alternative updating schedule for prompting recommendation language models. Experimental results show that our PAP-REC framework manages to generate personalized prompts, and the automatically generated prompts outperform manually constructed prompts and also outperform various baseline recommendation models. The source code of the work is available at https://github.com/rutgerswiselab/PAP-REC.

📄 PDF Abstract BibTeX arXiv:2402.00284

Code (1)

rutgerswiselab/pap-rec 공식 구현 pytorch

Tasks

Language ModelingLanguage Modelling

Similar Papers 제목 키워드 기반

RecPrompt: A Self-tuning Prompting Framework for News Recommendation Using Large Language Models

2023-12-16 · Dairui Liu, Boming Yang, Honghui Du, Derek Greene 외

News recommendations heavily rely on Natural Language Processing (NLP) methods to analyze, understand, and categorize content, enabling personalized suggestions based on user interests and reading behaviors. Large Langua…

News RecommendationPrompt EngineeringRecommendation Systems

Preference Distillation for Personalized Generative Recommendation

2024-07-06 · Jerome Ramos, Bin Wu, Aldo Lipani

Recently, researchers have investigated the capabilities of Large Language Models (LLMs) for generative recommender systems. Existing LLM-based recommender models are trained by adding user and item IDs to a discrete pro…

Explanation GenerationRecommendation SystemsSequential Recommendation

Recommendation as Language Processing (RLP): A Unified Pretrain, Personalized Prompt & Predict Paradigm (P5)

2022-03-24 · Shijie Geng, Shuchang Liu, Zuohui Fu, Yingqiang Ge 외

For a long time, different recommendation tasks typically require designing task-specific architectures and training objectives. As a result, it is hard to transfer the learned knowledge and representations from one task…

Language ModelingLanguage ModellingRecommendation SystemsReview Generation+1

Personalized Prompt for Sequential Recommendation

2022-05-19 · Yiqing Wu, Ruobing Xie, Yongchun Zhu, Fuzhen Zhuang 외

Pre-training models have shown their power in sequential recommendation. Recently, prompt has been widely explored and verified for tuning in NLP pre-training, which could help to more effectively and efficiently extract…

Contrastive LearningSequential Recommendation

PBNR: Prompt-based News Recommender System

2023-04-16 · Xinyi Li, Yongfeng Zhang, Edward C. Malthouse

Online news platforms often use personalized news recommendation methods to help users discover articles that align with their interests. These methods typically predict a matching score between a user and a candidate ar…

ArticlesLanguage ModelingLanguage ModellingLarge Language Model+4