paper-with-me

Papers

Disentangled Self-Supervision in Sequential Recommenders

2020-08-23 · Jianxin Ma, Chang Zhou, Hongxia Yang, Peng Cui, Xin Wang, Wenwu Zhu

To learn a sequential recommender, the existing methods typically adopt the sequence-to-item (seq2item) training strategy, which supervises a sequence model with a user’s next behavior as the label and the user’s past behaviors as the input. The seq2item strategy, however, is myopic and usually produces non-diverse recommendation lists. In this paper, we study the problem of mining extra signals for supervision by looking at the longer-term future. There exist two challenges: i) reconstructing a future sequence containing many behaviors is exponentially harder than reconstructing a single next behavior, which can lead to difficulty in convergence, and ii) the sequence of all future behaviors can involve many intentions, not all of which may be predictable from the sequence of earlier behaviors. To address these challenges, we propose a sequence-to-sequence (seq2seq) training strategy based on latent self-supervision and disentanglement. Specifically, we perform self-supervision in the latent space, i.e., reconstructing the representation of the future sequence as a whole, instead of reconstructing the items in the future sequence individually. We also disentangle the intentions behind any given sequence of behaviors and construct seq2seq training samples using only pairs of sub-sequences that involve a shared intention. Results on real-world benchmarks and synthetic data demonstrate the improvement brought by seq2seq training.

📄 PDF Abstract BibTeX

Code (1)

abinashsinha330/DSSRec pytorch

Tasks

Disentanglement

Methods 이 논문이 사용한 방법론

Tanh Activation 설명 없음
Sigmoid Activation 설명 없음
LSTM An LSTM is a type of recurrent neural network that addresses the vanishing gradient problem in vanilla…
Seq2Seq Seq2Seq, or Sequence To Sequence, is a model used in sequence prediction tasks, such as language modelling and machine translation. The idea is to use one…

Similar Papers 제목 키워드 기반

S3VAE: Self-Supervised Sequential VAE for Representation Disentanglement and Data Generation

2020-05-23 · CVPR 2020 6 · Yizhe Zhu, Martin Renqiang Min, Asim Kadav, Hans Peter Graf

We propose a sequential variational autoencoder to learn disentangled representations of sequential data (e.g., videos and audios) under self-supervision. Specifically, we exploit the benefits of some readily accessible …

Disentanglement

Debiasing Learning for Membership Inference Attacks Against Recommender Systems

2022-06-24 · Zihan Wang, Na Huang, Fei Sun, Pengjie Ren 외

Learned recommender systems may inadvertently leak information about their training data, leading to privacy violations. We investigate privacy threats faced by recommender systems through the lens of membership inferenc…

Recommendation Systems

DisenPOI: Disentangling Sequential and Geographical Influence for Point-of-Interest Recommendation

2022-10-29 · Yifang Qin, Yifan Wang, Fang Sun, Wei Ju 외

Point-of-Interest (POI) recommendation plays a vital role in various location-aware services. It has been observed that POI recommendation is driven by both sequential and geographical influences. However, since there is…

Contrastive LearningDisentanglement

Lightweight Self-Attentive Sequential Recommendation

2021-08-25 · Yang Li, Tong Chen, Peng-Fei Zhang, Hongzhi Yin

Modern deep neural networks (DNNs) have greatly facilitated the development of sequential recommender systems by achieving state-of-the-art recommendation performance on various sequential recommendation tasks. Given a s…

Recommendation SystemsSequential Recommendation

Disentangled Speech Representation Learning Based on Factorized Hierarchical Variational Autoencoder with Self-Supervised Objective

2022-04-05 · Yuying Xie, Thomas Arildsen, Zheng-Hua Tan

Disentangled representation learning aims to extract explanatory features or factors and retain salient information. Factorized hierarchical variational autoencoder (FHVAE) presents a way to disentangle a speech signal i…

DisentanglementRepresentation LearningSpeaker Recognitionspeech-recognition+3