paper-with-me

홈 › Papers

Dimension Independent Mixup for Hard Negative Sample in Collaborative Filtering

2023-06-28 · Xi Wu, Liangwei Yang, Jibing Gong, Chao Zhou, Tianyu Lin, Xiaolong Liu, Philip S. Yu

Collaborative filtering (CF) is a widely employed technique that predicts user preferences based on past interactions. Negative sampling plays a vital role in training CF-based models with implicit feedback. In this paper, we propose a novel perspective based on the sampling area to revisit existing sampling methods. We point out that current sampling methods mainly focus on Point-wise or Line-wise sampling, lacking flexibility and leaving a significant portion of the hard sampling area un-explored. To address this limitation, we propose Dimension Independent Mixup for Hard Negative Sampling (DINS), which is the first Area-wise sampling method for training CF-based models. DINS comprises three modules: Hard Boundary Definition, Dimension Independent Mixup, and Multi-hop Pooling. Experiments with real-world datasets on both matrix factorization and graph-based models demonstrate that DINS outperforms other negative sampling methods, establishing its effectiveness and superiority. Our work contributes a new perspective, introduces Area-wise sampling, and presents DINS as a novel approach that achieves state-of-the-art performance for negative sampling. Our implementations are available in PyTorch.

📄 PDF Abstract BibTeX arXiv:2306.15905

Code (1)

wu-xi/dins 공식 구현 pytorch

Tasks

Collaborative Filtering

Methods 이 논문이 사용한 방법론

Mixup Mixup is a data augmentation technique that generates a weighted combination of random image pairs from the training data. Given two images and their ground truth labels:…
Focus 설명 없음

Similar Papers 제목 키워드 기반

DropMix: Better Graph Contrastive Learning with Harder Negative Samples

2023-10-15 · Yueqi Ma, Minjie Chen, Xiang Li

While generating better negative samples for contrastive learning has been widely studied in the areas of CV and NLP, very few work has focused on graph-structured data. Recently, Mixup has been introduced to synthesize …

Contrastive Learning

Negative Sampling with Adaptive Denoising Mixup for Knowledge Graph Embedding

2023-10-15 · Xiangnan Chen, Wen Zhang, Zhen Yao, Mingyang Chen 외

Knowledge graph embedding (KGE) aims to map entities and relations of a knowledge graph (KG) into a low-dimensional and dense vector space via contrasting the positive and negative triples. In the training process of KGE…

DenoisingGraph EmbeddingKnowledge Graph CompletionKnowledge Graph Embedding+1

Mixup Your Own Pairs

2023-09-28 · Yilei Wu, Zijian Dong, Chongyao Chen, Wangchunshu Zhou 외

In representation learning, regression has traditionally received less attention than classification. Directly applying representation learning techniques designed for classification to regression often results in fragme…

Contrastive LearningregressionRepresentation LearningTime Series+1

Universum-inspired Supervised Contrastive Learning

2022-04-22 · Aiyang Han, Chuanxing Geng, Songcan Chen

As an effective data augmentation method, Mixup synthesizes an extra amount of samples through linear interpolations. Despite its theoretical dependency on data properties, Mixup reportedly performs well as a regularizer…

Contrastive LearningData Augmentation

$m$-mix: Generating hard negatives via multiple samples mixing for contrastive learning

2021-09-29 · Shaofeng Zhang, Meng Liu, Junchi Yan, Hengrui Zhang 외

Negative pairs are essential in contrastive learning, which plays the role of avoiding degenerate solutions. Hard negatives can improve the representation ability on the basis of common negatives. Inspired by recent hard…

ClassificationContrastive LearningGraph Classificationimage-classification+2