LEARN: Knowledge Adaptation from Large Language Model to Recommendation for Practical Industrial Application
Contemporary recommendation systems predominantly rely on ID embedding to capture latent associations among users and items. However, this approach overlooks the wealth of semantic information embedded within textual descriptions of items, leading to suboptimal performance and poor generalizations. Leveraging the capability of large language models to comprehend and reason about textual content presents a promising avenue for advancing recommendation systems. To achieve this, we propose an Llm-driven knowlEdge Adaptive RecommeNdation (LEARN) framework that synergizes open-world knowledge with collaborative knowledge. We address computational complexity concerns by utilizing pretrained LLMs as item encoders and freezing LLM parameters to avoid catastrophic forgetting and preserve open-world knowledge. To bridge the gap between the open-world and collaborative domains, we design a twin-tower structure supervised by the recommendation task and tailored for practical industrial application. Through experiments on the real large-scale industrial dataset and online A/B tests, we demonstrate the efficacy of our approach in industry application. We also achieve state-of-the-art performance on six Amazon Review datasets to verify the superiority of our method.
Code (1)
Tasks
Collaborative FilteringLanguage ModelingLanguage ModellingLarge Language ModelRecommendation SystemsWorld KnowledgeSimilar Papers 제목 키워드 기반
Avoiding Over-Personalization with Rule-Guided Knowledge Graph Adaptation for LLM Recommendations
We present a lightweight neuro-symbolic framework to mitigate over-personalization in LLM-based recommender systems by adapting user-side Knowledge Graphs (KGs) at inference time. Instead of retraining models or relying …
Knowledge GraphsLearning Structure and Knowledge Aware Representation with Large Language Models for Concept Recommendation
Concept recommendation aims to suggest the next concept for learners to study based on their knowledge states and the human knowledge system. While knowledge states can be predicted using knowledge tracing models, previo…
Contrastive LearningKnowledge TracingRepresentation LearningLarge Language Model Empowered Recommendation Meets All-domain Continual Pre-Training
Recent research efforts have investigated how to integrate Large Language Models (LLMs) into recommendation, capitalizing on their semantic comprehension and open-world knowledge for user behavior understanding. These ap…
AllLanguage ModelingLanguage ModellingLarge Language Model+1Federated Adaptation for Foundation Model-based Recommendations
With the recent success of large language models, particularly foundation models with generalization abilities, applying foundation models for recommendations becomes a new paradigm to improve existing recommendation sys…
Federated LearningmodelPrivacy PreservingRecommendation SystemsLLM4Rec: Large Language Models for Multimodal Generative Recommendation with Causal Debiasing
Contemporary generative recommendation systems face significant challenges in handling multimodal data, eliminating algorithmic biases, and providing transparent decision-making processes. This paper introduces an enhanc…
Computational EfficiencyRecommendation SystemsCausal Inference