paper-with-me

Papers

Generate What You Prefer: Reshaping Sequential Recommendation via Guided Diffusion

2023-10-31 · NeurIPS 2023 11 · Zhengyi Yang, Jiancan Wu, Zhicai Wang, Xiang Wang, Yancheng Yuan, Xiangnan He

Sequential recommendation aims to recommend the next item that matches a user's interest, based on the sequence of items he/she interacted with before. Scrutinizing previous studies, we can summarize a common learning-to-classify paradigm -- given a positive item, a recommender model performs negative sampling to add negative items and learns to classify whether the user prefers them or not, based on his/her historical interaction sequence. Although effective, we reveal two inherent limitations:(1) it may differ from human behavior in that a user could imagine an oracle item in mind and select potential items matching the oracle; and (2) the classification is limited in the candidate pool with noisy or easy supervision from negative samples, which dilutes the preference signals towards the oracle item. Yet, generating the oracle item from the historical interaction sequence is mostly unexplored. To bridge the gap, we reshape sequential recommendation as a learning-to-generate paradigm, which is achieved via a guided diffusion model, termed DreamRec.Specifically, for a sequence of historical items, it applies a Transformer encoder to create guidance representations. Noising target items explores the underlying distribution of item space; then, with the guidance of historical interactions, the denoising process generates an oracle item to recover the positive item, so as to cast off negative sampling and depict the true preference of the user directly. We evaluate the effectiveness of DreamRec through extensive experiments and comparisons with existing methods. Codes and data are open-sourced at https://github.com/YangZhengyi98/DreamRec.

📄 PDF Abstract BibTeX arXiv:2310.20453

Code (1)

yangzhengyi98/dreamrec 공식 구현 pytorch

Tasks

DenoisingSequential Recommendation

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Similar Papers 제목 키워드 기반

Detecting Changes in User Preferences using Hidden Markov Models for Sequential Recommendation Tasks

2018-09-29 · Farzad Eskandanian, Bamshad Mobasher

Recommender systems help users find relevant items of interest based on the past preferences of those users. In many domains, however, the tastes and preferences of users change over time due to a variety of factors and …

Change Point DetectionRecommendation SystemsSequential Recommendation

Preference Discerning with LLM-Enhanced Generative Retrieval

2024-12-11 · Fabian Paischer, Liu Yang, Linfeng Liu, Shuai Shao 외

Sequential recommendation systems aim to provide personalized recommendations for users based on their interaction history. To achieve this, they often incorporate auxiliary information, such as textual descriptions of i…

Recommendation SystemsRetrievalSequential Recommendation

When and What to Recommend: Joint Modeling of Timing and Content for Active Sequential Recommendation

2025-11-24 · Jin Chai, Xiaoxiao Ma, Jian Yang, Jia Wu arxiv

Sequential recommendation models user preferences to predict the next target item. Most existing work is passive, where the system responds only when users open the application, missing chances after closure. We investig…

Sequential Recommendation

Modeling User Behaviour in Research Paper Recommendation System

2021-07-16 · Arpita Chaudhuri, Debasis Samanta, Monalisa Sarma

User intention which often changes dynamically is considered to be an important factor for modeling users in the design of recommendation systems. Recent studies are starting to focus on predicting user intention (what u…

Recommendation Systems

A Practice-Friendly LLM-Enhanced Paradigm with Preference Parsing for Sequential Recommendation

2024-06-01 · Dugang Liu, Shenxian Xian, Xiaolin Lin, Xiaolian Zhang 외

The training paradigm integrating large language models (LLM) is gradually reshaping sequential recommender systems (SRS) and has shown promising results. However, most existing LLM-enhanced methods rely on rich textual …

Recommendation SystemsSequential Recommendation