paper-with-me

Papers

Memory Augmented Multi-Instance Contrastive Predictive Coding for Sequential Recommendation

2021-09-01 · Ruihong Qiu, Zi Huang, Hongzhi Yin

The sequential recommendation aims to recommend items, such as products, songs and places, to users based on the sequential patterns of their historical records. Most existing sequential recommender models consider the next item prediction task as the training signal. Unfortunately, there are two essential challenges for these methods: (1) the long-term preference is difficult to capture, and (2) the supervision signal is too sparse to effectively train a model. In this paper, we propose a novel sequential recommendation framework to overcome these challenges based on a memory augmented multi-instance contrastive predictive coding scheme, denoted as MMInfoRec. The basic contrastive predictive coding (CPC) serves as encoders of sequences and items. The memory module is designed to augment the auto-regressive prediction in CPC to enable a flexible and general representation of the encoded preference, which can improve the ability to capture the long-term preference. For effective training of the MMInfoRec model, a novel multi-instance noise contrastive estimation (MINCE) loss is proposed, using multiple positive samples, which offers effective exploitation of samples inside a mini-batch. The proposed MMInfoRec framework falls into the contrastive learning style, within which, however, a further finetuning step is not required given that its contrastive training task is well aligned with the target recommendation task. With extensive experiments on four benchmark datasets, MMInfoRec can outperform the state-of-the-art baselines.

📄 PDF Abstract BibTeX arXiv:2109.00368

Code (2)

RuihongQiu/MMInfoRec 공식 구현 pytorch
RuihongQiu/DuoRec pytorch

Tasks

Contrastive LearningSequential Recommendation

Methods 이 논문이 사용한 방법론

Contrastive Learning 설명 없음
InfoNCE 설명 없음
Contrastive Predictive Coding Contrastive Predictive Coding (CPC) learns self-supervised representations by predicting the future in latent space by using powerful autoregressive models. The model uses a…

Similar Papers 제목 키워드 기반

Predictive Reasoning with Augmented Anomaly Contrastive Learning for Compositional Visual Relations

2026-03-01 · Chengtai Li, Yuting He, Jianfeng Ren, Ruibin Bai 외 arxiv

While visual reasoning for simple analogies has received significant attention, compositional visual relations (CVR) remain relatively unexplored due to their greater complexity. To solve CVR tasks, we propose Predictive…

Contrastive LearningVisual Reasoning

ICE: Inter-instance Contrastive Encoding for Unsupervised Person Re-identification

2021-03-30 · ICCV 2021 10 · Hao Chen, Benoit Lagadec, Francois Bremond

Unsupervised person re-identification (ReID) aims at learning discriminative identity features without annotations. Recently, self-supervised contrastive learning has gained increasing attention for its effectiveness in …

Contrastive LearningPerson Re-IdentificationRepresentation LearningUnsupervised Person Re-Identification

Cross-Batch Memory for Embedding Learning

2019-12-14 · CVPR 2020 6 · Xun Wang, Haozhi Zhang, Weilin Huang, Matthew R. Scott

Mining informative negative instances are of central importance to deep metric learning (DML), however this task is intrinsically limited by mini-batch training, where only a mini-batch of instances is accessible at each…

GPUImage RetrievalMetric LearningRetrieval

K-Shot Contrastive Learning of Visual Features with Multiple Instance Augmentations

2020-07-27 · Haohang Xu, Hongkai Xiong, Guo-Jun Qi

In this paper, we propose the $K$-Shot Contrastive Learning (KSCL) of visual features by applying multiple augmentations to investigate the sample variations within individual instances. It aims to combine the advantages…

Contrastive Learning

Strongly Augmented Contrastive Clustering

2022-06-01 · Xiaozhi Deng, Dong Huang, Ding-Hua Chen, Chang-Dong Wang 외

Deep clustering has attracted increasing attention in recent years due to its capability of joint representation learning and clustering via deep neural networks. In its latest developments, the contrastive learning has …

ClusteringContrastive LearningDeep ClusteringRepresentation Learning