Hierarchical Reinforcement Learning for Temporal Abstraction of Listwise Recommendation

2024-09-11 · Luo Ji, Gao Liu, Mingyang Yin, Hongxia Yang, Jingren Zhou

Modern listwise recommendation systems need to consider both long-term user perceptions and short-term interest shifts. Reinforcement learning can be applied on recommendation to study such a problem but is also subject to large search space, sparse user feedback and long interactive latency. Motivated by recent progress in hierarchical reinforcement learning, we propose a novel framework called mccHRL to provide different levels of temporal abstraction on listwise recommendation. Within the hierarchical framework, the high-level agent studies the evolution of user perception, while the low-level agent produces the item selection policy by modeling the process as a sequential decision-making problem. We argue that such framework has a well-defined decomposition of the outra-session context and the intra-session context, which are encoded by the high-level and low-level agents, respectively. To verify this argument, we implement both a simulator-based environment and an industrial dataset-based experiment. Results observe significant performance improvement by our method, compared with several well-known baselines. Data and codes have been made public.

📄 PDF Abstract BibTeX arXiv:2409.07416

Code (0)

등록된 구현이 없습니다.

Tasks

Decision Making Hierarchical Reinforcement Learning Recommendation Systems reinforcement-learning Reinforcement LearningSequential Decision Making

Learning Temporal Abstraction with Information-theoretic Constraints for Hierarchical Reinforcement Learning

2019-09-25 · Wenshan Wang, Yaoyu Hu, Sebastian Scherer

Applying reinforcement learning (RL) to real-world problems will require reasoning about action-reward correlation over long time horizons. Hierarchical reinforcement learning (HRL) methods handle this by dividing the ta…

Hierarchical Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Hierarchical Deep Multiagent Reinforcement Learning with Temporal Abstraction

2018-09-25 · Hongyao Tang, Jianye Hao, Tangjie Lv, Yingfeng Chen 외

Multiagent reinforcement learning (MARL) is commonly considered to suffer from non-stationary environments and exponentially increasing policy space. It would be even more challenging when rewards are sparse and delayed …

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Language as an Abstraction for Hierarchical Deep Reinforcement Learning

2019-06-18 · NeurIPS 2019 12 · Yiding Jiang, Shixiang Gu, Kevin Murphy, Chelsea Finn

Solving complex, temporally-extended tasks is a long-standing problem in reinforcement learning (RL). We hypothesize that one critical element of solving such problems is the notion of compositionality. With the ability …

Deep Reinforcement Learning Instruction Following MuJoCo Object+4

Deep Hierarchical Reinforcement Learning Based Recommendations via Multi-goals Abstraction

2019-03-22 · Dongyang Zhao, Liang Zhang, Bo Zhang, Lizhou Zheng 외

The recommender system is an important form of intelligent application, which assists users to alleviate from information redundancy. Among the metrics used to evaluate a recommender system, the metric of conversion has …

Hierarchical Reinforcement Learning Recommendation Systems reinforcement-learning Reinforcement Learning+1

DHRL: A Graph-Based Approach for Long-Horizon and Sparse Hierarchical Reinforcement Learning

2022-10-11 · Seungjae Lee, Jigang Kim, Inkyu Jang, H. Jin Kim

Hierarchical Reinforcement Learning (HRL) has made notable progress in complex control tasks by leveraging temporal abstraction. However, previous HRL algorithms often suffer from serious data inefficiency as environment…