paper-with-me

Papers

Sequential Recommendation for Optimizing Both Immediate Feedback and Long-term Retention

2024-04-04 · Ziru Liu, Shuchang Liu, Zijian Zhang, Qingpeng Cai, Xiangyu Zhao, Kesen Zhao, Lantao Hu, Peng Jiang, Kun Gai

In the landscape of Recommender System (RS) applications, reinforcement learning (RL) has recently emerged as a powerful tool, primarily due to its proficiency in optimizing long-term rewards. Nevertheless, it suffers from instability in the learning process, stemming from the intricate interactions among bootstrapping, off-policy training, and function approximation. Moreover, in multi-reward recommendation scenarios, designing a proper reward setting that reconciles the inner dynamics of various tasks is quite intricate. In response to these challenges, we introduce DT4IER, an advanced decision transformer-based recommendation model that is engineered to not only elevate the effectiveness of recommendations but also to achieve a harmonious balance between immediate user engagement and long-term retention. The DT4IER applies an innovative multi-reward design that adeptly balances short and long-term rewards with user-specific attributes, which serve to enhance the contextual richness of the reward sequence ensuring a more informed and personalized recommendation process. To enhance its predictive capabilities, DT4IER incorporates a high-dimensional encoder, skillfully designed to identify and leverage the intricate interrelations across diverse tasks. Furthermore, we integrate a contrastive learning approach within the action embedding predictions, a strategy that significantly boosts the model's overall performance. Experiments on three real-world datasets demonstrate the effectiveness of DT4IER against state-of-the-art Sequential Recommender Systems (SRSs) and Multi-Task Learning (MTL) models in terms of both prediction accuracy and effectiveness in specific tasks. The source code is accessible online to facilitate replication

📄 PDF Abstract BibTeX arXiv:2404.03637

Code (1)

applied-machine-learning-lab/dt4ier 공식 구현 pytorch

Tasks

Contrastive LearningMulti-Task LearningRecommendation SystemsReinforcement Learning (RL)Sequential Recommendation

Methods 이 논문이 사용한 방법론

Contrastive Learning 설명 없음

Similar Papers 제목 키워드 기반

Improving Sequential Query Recommendation with Immediate User Feedback

2022-05-12 · Shameem A Puthiya Parambath, Christos Anagnostopoulos, Roderick Murray-Smith

We propose an algorithm for next query recommendation in interactive data exploration settings, like knowledge discovery for information gathering. The state-of-the-art query recommendation algorithms are based on sequen…

Modeling User Retention through Generative Flow Networks

2024-06-10 · Ziru Liu, Shuchang Liu, Bin Yang, Zhenghai Xue 외

Recommender systems aim to fulfill the user's daily demands. While most existing research focuses on maximizing the user's engagement with the system, it has recently been pointed out that how frequently the users come b…

Learning-To-RankRecommendation Systems

RecoMind: A Reinforcement Learning Framework for Optimizing In-Session User Satisfaction in Recommendation Systems

2025-07-31 · Mehdi Ben Ayed, Fei Feng, Jay Adams, Vishwakarma Singh 외 arxiv

Existing web-scale recommendation systems commonly use supervised learning methods that prioritize immediate user feedback. Although reinforcement learning (RL) offers a solution to optimize longer-term goals, such as in…

Reinforcement LearningRecommendation Systems

ResAct: Reinforcing Long-term Engagement in Sequential Recommendation with Residual Actor

2022-06-01 · Wanqi Xue, Qingpeng Cai, Ruohan Zhan, Dong Zheng 외

Long-term engagement is preferred over immediate engagement in sequential recommendation as it directly affects product operational metrics such as daily active users (DAUs) and dwell time. Meanwhile, reinforcement learn…

Reinforcement Learning (RL)Sequential Recommendation

Developing a Conversational Recommendation System for Navigating Limited Options

2021-04-13 · Victor S. Bursztyn, Jennifer Healey, Eunyee Koh, Nedim Lipka 외

We have developed a conversational recommendation system designed to help users navigate through a set of limited options to find the best choice. Unlike many internet scale systems that use a singular set of search term…

Conversational RecommendationNavigate