Memory Augmented Multi-Instance Contrastive Predictive Coding for Sequential Recommendation
The sequential recommendation aims to recommend items, such as products, songs and places, to users based on the sequential patterns of their historical records. Most existing sequential recommender models consider the next item prediction task as the training signal. Unfortunately, there are two essential challenges for these methods: (1) the long-term preference is difficult to capture, and (2) the supervision signal is too sparse to effectively train a model. In this paper, we propose a novel sequential recommendation framework to overcome these challenges based on a memory augmented multi-instance contrastive predictive coding scheme, denoted as MMInfoRec. The basic contrastive predictive coding (CPC) serves as encoders of sequences and items. The memory module is designed to augment the auto-regressive prediction in CPC to enable a flexible and general representation of the encoded preference, which can improve the ability to capture the long-term preference. For effective training of the MMInfoRec model, a novel multi-instance noise contrastive estimation (MINCE) loss is proposed, using multiple positive samples, which offers effective exploitation of samples inside a mini-batch. The proposed MMInfoRec framework falls into the contrastive learning style, within which, however, a further finetuning step is not required given that its contrastive training task is well aligned with the target recommendation task. With extensive experiments on four benchmark datasets, MMInfoRec can outperform the state-of-the-art baselines.
Code (2)
Tasks
Contrastive LearningSequential RecommendationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Predictive Reasoning with Augmented Anomaly Contrastive Learning for Compositional Visual Relations
While visual reasoning for simple analogies has received significant attention, compositional visual relations (CVR) remain relatively unexplored due to their greater complexity. To solve CVR tasks, we propose Predictive…
Contrastive LearningVisual ReasoningICE: Inter-instance Contrastive Encoding for Unsupervised Person Re-identification
Unsupervised person re-identification (ReID) aims at learning discriminative identity features without annotations. Recently, self-supervised contrastive learning has gained increasing attention for its effectiveness in …
Contrastive LearningPerson Re-IdentificationRepresentation LearningUnsupervised Person Re-IdentificationCross-Batch Memory for Embedding Learning
Mining informative negative instances are of central importance to deep metric learning (DML), however this task is intrinsically limited by mini-batch training, where only a mini-batch of instances is accessible at each…
GPUImage RetrievalMetric LearningRetrievalK-Shot Contrastive Learning of Visual Features with Multiple Instance Augmentations
In this paper, we propose the $K$-Shot Contrastive Learning (KSCL) of visual features by applying multiple augmentations to investigate the sample variations within individual instances. It aims to combine the advantages…
Contrastive LearningStrongly Augmented Contrastive Clustering
Deep clustering has attracted increasing attention in recent years due to its capability of joint representation learning and clustering via deep neural networks. In its latest developments, the contrastive learning has …
ClusteringContrastive LearningDeep ClusteringRepresentation Learning