paper-with-me

Papers

Aligning Large Language Models for Controllable Recommendations

2024-03-08 · Wensheng Lu, Jianxun Lian, Wei zhang, Guanghua Li, Mingyang Zhou, Hao Liao, Xing Xie

Inspired by the exceptional general intelligence of Large Language Models (LLMs), researchers have begun to explore their application in pioneering the next generation of recommender systems - systems that are conversational, explainable, and controllable. However, existing literature primarily concentrates on integrating domain-specific knowledge into LLMs to enhance accuracy, often neglecting the ability to follow instructions. To address this gap, we initially introduce a collection of supervised learning tasks, augmented with labels derived from a conventional recommender model, aimed at explicitly improving LLMs' proficiency in adhering to recommendation-specific instructions. Subsequently, we develop a reinforcement learning-based alignment procedure to further strengthen LLMs' aptitude in responding to users' intentions and mitigating formatting errors. Through extensive experiments on two real-world datasets, our method markedly advances the capability of LLMs to comply with instructions within recommender systems, while sustaining a high level of accuracy performance.

📄 PDF Abstract BibTeX arXiv:2403.05063

Code (1)

microsoft/recai 공식 구현 pytorch

Tasks

Recommendation Systems

Similar Papers 제목 키워드 기반

Aligning Language Models with Investor and Market Behavior for Financial Recommendations

2025-10-14 · Fernando Spadea, Oshani Seneviratne arxiv

Most financial recommendation systems often fail to account for key behavioral and regulatory factors, leading to advice that is misaligned with user preferences, difficult to interpret, or unlikely to be followed. We pr…

Recommendation SystemsFederated LearningKnowledge Graphs

Editable User Profiles for Controllable Text Recommendation

2023-04-09 · Sheshera Mysore, Mahmood Jasim, Andrew McCallum, Hamed Zamani

Methods for making high-quality recommendations often rely on learning latent representations from interaction data. These methods, while performant, do not provide ready mechanisms for users to control the recommendatio…

Recommendation SystemsRetrieval

Controllable Meaning Representation to Text Generation: Linearization and Data Augmentation Strategies

2020-11-01 · EMNLP 2020 11 · Chris Kedzie, Kathleen McKeown

We study the degree to which neural sequence-to-sequence models exhibit fine-grained controllability when performing natural language generation from a meaning representation. Using two task-oriented dialogue generation …

Data AugmentationDialogue GenerationText Generation

Bursting Filter Bubble: Enhancing Serendipity Recommendations with Aligned Large Language Models

2025-02-19 · Yunjia Xi, Muyan Weng, Wen Chen, Chao Yi 외

Recommender systems (RSs) often suffer from the feedback loop phenomenon, e.g., RSs are trained on data biased by their recommendations. This leads to the filter bubble effect that reinforces homogeneous content and redu…

Profile GenerationRecommendation SystemsWorld Knowledge

Controllable Value Alignment in Large Language Models through Neuron-Level Editing

2026-02-07 · Yonghui Yang, Yihui Wang, Junwei Li, Jilong Liu 외 arxiv

Aligning large language models (LLMs) with human values has become increasingly important as their influence on human behavior and decision-making expands. However, existing steering-based alignment methods suffer from l…