paper-with-me

홈 › Papers

Filter-enhanced MLP is All You Need for Sequential Recommendation

2022-02-28 · Kun Zhou, Hui Yu, Wayne Xin Zhao, Ji-Rong Wen

Recently, deep neural networks such as RNN, CNN and Transformer have been applied in the task of sequential recommendation, which aims to capture the dynamic preference characteristics from logged user behavior data for accurate recommendation. However, in online platforms, logged user behavior data is inevitable to contain noise, and deep recommendation models are easy to overfit on these logged data. To tackle this problem, we borrow the idea of filtering algorithms from signal processing that attenuates the noise in the frequency domain. In our empirical experiments, we find that filtering algorithms can substantially improve representative sequential recommendation models, and integrating simple filtering algorithms (eg Band-Stop Filter) with an all-MLP architecture can even outperform competitive Transformer-based models. Motivated by it, we propose \textbf{FMLP-Rec}, an all-MLP model with learnable filters for sequential recommendation task. The all-MLP architecture endows our model with lower time complexity, and the learnable filters can adaptively attenuate the noise information in the frequency domain. Extensive experiments conducted on eight real-world datasets demonstrate the superiority of our proposed method over competitive RNN, CNN, GNN and Transformer-based methods. Our code and data are publicly available at the link: \textcolor{blue}{\url{https://github.com/RUCAIBox/FMLP-Rec}}.

📄 PDF Abstract BibTeX arXiv:2202.13556

Code (2)

rucaibox/fmlp-rec 공식 구현 pytorch
woeee/fmlp-rec pytorch

Tasks

AllSequential Recommendation

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Position-Wise Feed-Forward Layer 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Residual Connection 설명 없음
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…

Similar Papers 제목 키워드 기반

Online Distillation-enhanced Multi-modal Transformer for Sequential Recommendation

2023-08-08 · Wei Ji, Xiangyan Liu, An Zhang, Yinwei Wei 외

Multi-modal recommendation systems, which integrate diverse types of information, have gained widespread attention in recent years. However, compared to traditional collaborative filtering-based multi-modal recommendatio…

Collaborative FilteringMulti-modal RecommendationRecommendation SystemsRepresentation Learning+1

TV-Rec: Time-Variant Convolutional Filter for Sequential Recommendation

2025-10-29 · Yehjin Shin, Jeongwhan Choi, Seojin Kim, Noseong Park arxiv

Recently, convolutional filters have been increasingly adopted in sequential recommendation for their ability to capture local sequential patterns. However, most of these models complement convolutional filters with self…

Sequential Recommendation

Molar: Multimodal LLMs with Collaborative Filtering Alignment for Enhanced Sequential Recommendation

2024-12-24 · Yucong Luo, Qitao Qin, Hao Zhang, Mingyue Cheng 외

Sequential recommendation (SR) systems have evolved significantly over the past decade, transitioning from traditional collaborative filtering to deep learning approaches and, more recently, to large language models (LLM…

Collaborative FilteringSequential Recommendation

SSLRec: A Self-Supervised Learning Framework for Recommendation

2023-08-10 · Xubin Ren, Lianghao Xia, Yuhao Yang, Wei Wei 외

Self-supervised learning (SSL) has gained significant interest in recent years as a solution to address the challenges posed by sparse and noisy data in recommender systems. Despite the growing number of SSL algorithms d…

Collaborative FilteringData AugmentationRecommendation SystemsSelf-Supervised Learning+1

Multimodal Enhancement of Sequential Recommendation

2026-02-06 · Bucher Sahyouni, Matthew Vowels, Liqun Chen, Simon Hadfield arxiv

We propose a novel recommender framework, MuSTRec (Multimodal and Sequential Transformer-based Recommendation), that unifies multimodal and sequential recommendation paradigms. MuSTRec captures cross-item similarities an…

Sequential RecommendationCollaborative Filtering