paper-with-me

Papers

SimpleX: A Simple and Strong Baseline for Collaborative Filtering

2021-09-26 · Kelong Mao, Jieming Zhu, Jinpeng Wang, Quanyu Dai, Zhenhua Dong, Xi Xiao, Xiuqiang He

Collaborative filtering (CF) is a widely studied research topic in recommender systems. The learning of a CF model generally depends on three major components, namely interaction encoder, loss function, and negative sampling. While many existing studies focus on the design of more powerful interaction encoders, the impacts of loss functions and negative sampling ratios have not yet been well explored. In this work, we show that the choice of loss function as well as negative sampling ratio is equivalently important. More specifically, we propose the cosine contrastive loss (CCL) and further incorporate it to a simple unified CF model, dubbed SimpleX. Extensive experiments have been conducted on 11 benchmark datasets and compared with 29 existing CF models in total. Surprisingly, the results show that, under our CCL loss and a large negative sampling ratio, SimpleX can surpass most sophisticated state-of-the-art models by a large margin (e.g., max 48.5% improvement in NDCG@20 over LightGCN). We believe that SimpleX could not only serve as a simple strong baseline to foster future research on CF, but also shed light on the potential research direction towards improving loss function and negative sampling. Our source code will be available at https://reczoo.github.io/SimpleX.

📄 PDF Abstract BibTeX arXiv:2109.12613

Code (1)

reczoo/RecZoo/tree/main/matching/cf/SimpleX 공식 구현 pytorch

Tasks

Collaborative FilteringRecommendation Systems

Similar Papers 제목 키워드 기반

HEAT: A Highly Efficient and Affordable Training System for Collaborative Filtering Based Recommendation on CPUs

2023-04-14 · Chengming Zhang, Shaden Smith, Baixi Sun, Jiannan Tian 외

Collaborative filtering (CF) has been proven to be one of the most effective techniques for recommendation. Among all CF approaches, SimpleX is the state-of-the-art method that adopts a novel loss function and a proper n…

Collaborative FilteringCPUGPU

Unrestrained Simplex Denoising for Discrete Data. A Non-Markovian Approach Applied to Graph Generation

2026-03-30 · Yoann Boget, Alexandros Kalousis arxiv

Denoising models such as Diffusion or Flow Matching have recently advanced generative modeling for discrete structures, yet most approaches either operate directly in the discrete state space, causing abrupt state change…

Graph Generation

SKIing on Simplices: Kernel Interpolation on the Permutohedral Lattice for Scalable Gaussian Processes

2021-06-12 · Sanyam Kapoor, Marc Finzi, Ke Alexander Wang, Andrew Gordon Wilson

State-of-the-art methods for scalable Gaussian processes use iterative algorithms, requiring fast matrix vector multiplies (MVMs) with the covariance kernel. The Structured Kernel Interpolation (SKI) framework accelerate…

Gaussian ProcessesGPU

A Barrier Certificate-based Simplex Architecture for Systems with Approximate and Hybrid Dynamics

2022-02-20 · Amol Damare, Shouvik Roy, Roshan Sharma, Keith DSouza 외

We present Barrier-based Simplex (Bb-Simplex), a new, provably correct design for runtime assurance of continuous dynamical systems. Bb-Simplex is centered around the Simplex control architecture, which consists of a hig…

Graph-less Collaborative Filtering

2023-03-15 · Lianghao Xia, Chao Huang, Jiao Shi, Yong Xu

Graph neural networks (GNNs) have shown the power in representation learning over graph-structured user-item interaction data for collaborative filtering (CF) task. However, with their inherently recursive message propag…

Collaborative FilteringContrastive LearningKnowledge DistillationRepresentation Learning