paper-with-me

Papers

Adapting Large Language Models by Integrating Collaborative Semantics for Recommendation

2023-11-15 · Bowen Zheng, Yupeng Hou, Hongyu Lu, Yu Chen, Wayne Xin Zhao, Ming Chen, Ji-Rong Wen

Recently, large language models (LLMs) have shown great potential in recommender systems, either improving existing recommendation models or serving as the backbone. However, there exists a large semantic gap between LLMs and recommender systems, since items to be recommended are often indexed by discrete identifiers (item ID) out of the LLM's vocabulary. In essence, LLMs capture language semantics while recommender systems imply collaborative semantics, making it difficult to sufficiently leverage the model capacity of LLMs for recommendation. To address this challenge, in this paper, we propose a new LLM-based recommendation model called LC-Rec, which can better integrate language and collaborative semantics for recommender systems. Our approach can directly generate items from the entire item set for recommendation, without relying on candidate items. Specifically, we make two major contributions in our approach. For item indexing, we design a learning-based vector quantization method with uniform semantic mapping, which can assign meaningful and non-conflicting IDs (called item indices) for items. For alignment tuning, we propose a series of specially designed tuning tasks to enhance the integration of collaborative semantics in LLMs. Our fine-tuning tasks enforce LLMs to deeply integrate language and collaborative semantics (characterized by the learned item indices), so as to achieve an effective adaptation to recommender systems. Extensive experiments demonstrate the effectiveness of our method, showing that our approach can outperform a number of competitive baselines including traditional recommenders and existing LLM-based recommenders. Our code is available at https://github.com/RUCAIBox/LC-Rec/.

📄 PDF Abstract BibTeX arXiv:2311.09049

Code (1)

rucaibox/lc-rec 공식 구현 pytorch

Tasks

QuantizationRecommendation Systems

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

CoRA: Collaborative Information Perception by Large Language Model's Weights for Recommendation

2024-08-20 · YuTing Liu, Jinghao Zhang, Yizhou Dang, Yuliang Liang 외

Involving collaborative information in Large Language Models (LLMs) is a promising technique for adapting LLMs for recommendation. Existing methods achieve this by concatenating collaborative features with text tokens in…

Collaborative FilteringGeneral KnowledgeWorld Knowledge

CoLLM: Integrating Collaborative Embeddings into Large Language Models for Recommendation

2023-10-30 · Yang Zhang, Fuli Feng, Jizhi Zhang, Keqin Bao 외

Leveraging Large Language Models as Recommenders (LLMRec) has gained significant attention and introduced fresh perspectives in user preference modeling. Existing LLMRec approaches prioritize text semantics, usually negl…

Adapting Vision-Language Model with Fine-grained Semantics for Open-Vocabulary Segmentation

2024-09-24 · Yong Xien Chng, Xuchong Qiu, Yizeng Han, Kai Ding 외

Despite extensive research, open-vocabulary segmentation methods still struggle to generalize across diverse domains. To reduce the computational cost of adapting Vision-Language Models (VLMs) while preserving their pre-…

Language ModelingLanguage ModellingOpen Vocabulary Panoptic SegmentationPanoptic Segmentation

Enhancing Collaborative Semantics of Language Model-Driven Recommendations via Graph-Aware Learning

2024-06-19 · Zhong Guan, Likang Wu, Hongke Zhao, Ming He 외

Large Language Models (LLMs) are increasingly prominent in the recommendation systems domain. Existing studies usually utilize in-context learning or supervised fine-tuning on task-specific data to align LLMs into recomm…

In-Context LearningLanguage ModelingLanguage ModellingRecommendation Systems

Laser: Parameter-Efficient LLM Bi-Tuning for Sequential Recommendation with Collaborative Information

2024-09-03 · Xinyu Zhang, Linmei Hu, Luhao Zhang, Dandan song 외

Sequential recommender systems are essential for discerning user preferences from historical interactions and facilitating targeted recommendations. Recent innovations employing Large Language Models (LLMs) have advanced…

Large Language ModelRecommendation SystemsSequential Recommendation