Policy Gradient for items Recommendation on Virtual Taobao

2020-12-14 · CUHK Course IERG5350 2020 12 · Wei Fang, Fanyuan Zeng

Recent years have witnessed digital content appear with plenty of forms (including online courses, online shopping and e-news) in daily life of people, which has provided with opportunities as well as challenges for systems to provide users with personalized services and information. The goal of our project is to design a recommender algorithm that can return a good list such that the consumers might have high chance of clicking the items on a simulated environment named Virtual Taobao, a simulator trained from the real-data from Taobao. Firstly, We tried some state-of-art deep-reinforcement algorithms, such as deep deterministic policy gradient (DDPG) method and Twin Delayed DDPG (TD3), what's more, we also used the Proximal Policy Optimisation (PPO) algorithm and tried to improve the PPO algorithm with the features of the attributes of the consumers. Video Link: https://drive.google.com/file/d/1WVoAjKcJ-4t5o6n_U5KaoDn7BymksYqr/view?usp=sharing

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…

Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Adam 설명 없음

Entropy Regularization 설명 없음

PPO Proximal Policy Optimization, or PPO, is a policy gradient method for reinforcement learning. The motivation was to have an algorithm with the data efficiency and reliable…

Experience Replay Experience Replay is a replay memory technique used in reinforcement learning where we store the agent’s experiences at each time-step, $e\_{t} = \left(s\_{t}, a\_{t}, r\_{t},…

Weight Decay 설명 없음

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Ranking Items in Large-Scale Item Search Engines with Reinforcement Learning

2020-12-14 · CUHK Course IERG5350 2020 12 · Chang Gao

Ranking items in large-scale item search engines such as Amazon and Taobao is a typical multi-step decision-making problem. Due to the interactive nature between the human user and the search engine, reinforcement learni…

Decision Making reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Billion-scale Commodity Embedding for E-commerce Recommendation in Alibaba

2018-03-06 · KDD 2018 5 · Jizhe Wang, Pipei Huang, Huan Zhao, Zhibo Zhang 외

Recommender systems (RSs) have been the most important technology for increasing the business in Taobao, the largest online consumer-to-consumer (C2C) platform in China. The billion-scale data in Taobao creates three maj…

Graph Embedding Recommendation Systems

Virtual-Taobao: Virtualizing Real-world Online Retail Environment for Reinforcement Learning

2018-05-25 · Jing-Cheng Shi, Yang Yu, Qing Da, Shi-Yong Chen 외

Applying reinforcement learning in physical-world tasks is extremely challenging. It is commonly infeasible to sample a large number of trials, as required by current reinforcement learning methods, in a physical environ…

Imitation Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Rec4Ad: A Free Lunch to Mitigate Sample Selection Bias for Ads CTR Prediction in Taobao

2023-06-06 · Jingyue Gao, Shuguang Han, Han Zhu, Siran Yang 외

Click-Through Rate (CTR) prediction serves as a fundamental component in online advertising. A common practice is to train a CTR model on advertisement (ad) impressions with user feedback. Since ad impressions are purpos…

Click-Through Rate Prediction Data Augmentation Selection bias

Reinforcement Learning to Rank in E-Commerce Search Engine: Formalization, Analysis, and Application

2018-03-02 · Yujing Hu, Qing Da, An-Xiang Zeng, Yang Yu 외

In e-commerce platforms such as Amazon and TaoBao, ranking items in a search session is a typical multi-step decision-making problem. Learning to rank (LTR) methods have been widely applied to ranking problems. However, …

Decision Making Learning-To-Rank Reinforcement Learning Reinforcement Learning (RL)