Exploration-Exploitation Motivated Variational Auto-Encoder for Recommender Systems

2020-06-05 · Yizi Zhang, Meimei Liu

Recent years have witnessed rapid developments on collaborative filtering techniques for improving the performance of recommender systems due to the growing need of companies to help users discover new and relevant items. However, the majority of existing literature focuses on delivering items which match the user model learned from users' past preferences. A good recommendation model is expected to recommend items that are known to enjoy and items that are novel to try. In this work, we introduce an exploitation-exploration motivated variational auto-encoder (XploVAE) to collaborative filtering. To facilitate personalized recommendations, we construct user-specific subgraphs, which contain the first-order proximity capturing observed user-item interactions for exploitation and the high-order proximity for exploration. A hierarchical latent space model is utilized to learn the personalized item embedding for a given user, along with the population distribution of all user subgraphs. Finally, experimental results on various real-world datasets clearly demonstrate the effectiveness of our proposed model on leveraging the exploitation and exploration recommendation tasks.

📄 PDF Abstract BibTeX arXiv:2006.03573

Code (0)

등록된 구현이 없습니다.

Tasks

Collaborative Filtering Recommendation Systems

Methods 이 논문이 사용한 방법론

USD Coin Customer Service Number +1-833-534-1729 설명 없음

A Neural Topical Expansion Framework for Unstructured Persona-oriented Dialogue Generation

2020-02-06 · Minghong Xu, Piji Li, Haoran Yang, Pengjie Ren 외

Unstructured Persona-oriented Dialogue Systems (UPDS) has been demonstrated effective in generating persona consistent responses by utilizing predefined natural language user persona descriptions (e.g., "I am a vegan"). …

Descriptive Dialogue Generation

LECO: Learnable Episodic Count for Task-Specific Intrinsic Reward

2022-10-11 · DaeJin Jo, Sungwoong Kim, Daniel Wontae Nam, Taehwan Kwon 외

Episodic count has been widely used to design a simple yet effective intrinsic motivation for reinforcement learning with a sparse reward. However, the use of episodic count in a high-dimensional state space as well as o…

Efficient Exploration reinforcement-learning

Balancing Exploration and Exploitation: Disentangled $β$-CVAE in De Novo Drug Design

2023-06-02 · Guang Jun Nicholas Ang, De Tao Irwin Chin, Bingquan Shen

Deep generative models have recently emerged as a promising de novo drug design method. In this respect, deep generative conditional variational autoencoder (CVAE) models are a powerful approach for generating novel mole…

Disentanglement Drug Design

Decoupled Reinforcement Learning to Stabilise Intrinsically-Motivated Exploration

2021-07-19 · ICML Workshop URL 2021 7 · Lukas Schäfer, Filippos Christianos, Josiah P. Hanna, Stefano V. Albrecht

Intrinsic rewards can improve exploration in reinforcement learning, but the exploration process may suffer from instability caused by non-stationary reward shaping and strong dependency on hyperparameters. In this work,…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Conditional Variational Autoencoder for Neural Machine Translation

2018-12-11 · Artidoro Pagnoni, Kevin Liu, Shangyan Li

We explore the performance of latent variable models for conditional text generation in the context of neural machine translation (NMT). Similar to Zhang et al., we augment the encoder-decoder NMT paradigm by introducing…

Conditional Text Generation Decoder Machine Translation NMT+2