A Model-based Multi-Agent Personalized Short-Video Recommender System
Recommender selects and presents top-K items to the user at each online request, and a recommendation session consists of several sequential requests. Formulating a recommendation session as a Markov decision process and solving it by reinforcement learning (RL) framework has attracted increasing attention from both academic and industry communities. In this paper, we propose a RL-based industrial short-video recommender ranking framework, which models and maximizes user watch-time in an environment of user multi-aspect preferences by a collaborative multi-agent formulization. Moreover, our proposed framework adopts a model-based learning approach to alleviate the sample selection bias which is a crucial but intractable problem in industrial recommender system. Extensive offline evaluations and live experiments confirm the effectiveness of our proposed method over alternatives. Our proposed approach has been deployed in our real large-scale short-video sharing platform, successfully serving over hundreds of millions users.
Code (0)
등록된 구현이 없습니다.
Tasks
Recommendation SystemsReinforcement Learning (RL)Selection biasSimilar Papers 제목 키워드 기반
Multi-Agent Video Recommenders: Evolution, Patterns, and Open Challenges
Video recommender systems are among the most popular and impactful applications of AI, shaping content consumption and influencing culture for billions of users. Traditional single-model recommenders, which optimize stat…
Multi-agent Reinforcement LearningRecommendation SystemsShort Video Segment-level User Dynamic Interests Modeling in Personalized Recommendation
The rapid growth of short videos has necessitated effective recommender systems to match users with content tailored to their evolving preferences. Current video recommendation models primarily treat each video as a whol…
Recommendation SystemsA Multi-Task Learning Algorithm for Non-personalized Recommendations
In this paper, we introduce a multi-task learning (MTL) algorithm for recommending non-personalized videos to watch next on industrial video sharing platforms. Personalized recommendations have been studied for decades, …
Collaborative FilteringMulti-Task LearningRecommendation SystemsMultimodal Pretraining, Adaptation, and Generation for Recommendation: A Survey
Personalized recommendation serves as a ubiquitous channel for users to discover information tailored to their interests. However, traditional recommendation models primarily rely on unique IDs and categorical features f…
Recommendation SystemsSurveyMultimodal Pretraining and Generation for Recommendation: A Tutorial
Personalized recommendation stands as a ubiquitous channel for users to explore information or items aligned with their interests. Nevertheless, prevailing recommendation models predominantly rely on unique IDs and categ…
multimodal generationMultimodal RecommendationRecommendation Systems