paper-with-me

Papers

RecGPT: A Foundation Model for Sequential Recommendation

2025-06-06 · Yangqin Jiang, Xubin Ren, Lianghao Xia, Da Luo, Kangyi Lin, Chao Huang

This work addresses a fundamental barrier in recommender systems: the inability to generalize across domains without extensive retraining. Traditional ID-based approaches fail entirely in cold-start and cross-domain scenarios where new users or items lack sufficient interaction history. Inspired by foundation models' cross-domain success, we develop a foundation model for sequential recommendation that achieves genuine zero-shot generalization capabilities. Our approach fundamentally departs from existing ID-based methods by deriving item representations exclusively from textual features. This enables immediate embedding of any new item without model retraining. We introduce unified item tokenization with Finite Scalar Quantization that transforms heterogeneous textual descriptions into standardized discrete tokens. This eliminates domain barriers that plague existing systems. Additionally, the framework features hybrid bidirectional-causal attention that captures both intra-item token coherence and inter-item sequential dependencies. An efficient catalog-aware beam search decoder enables real-time token-to-item mapping. Unlike conventional approaches confined to their training domains, RecGPT naturally bridges diverse recommendation contexts through its domain-invariant tokenization mechanism. Comprehensive evaluations across six datasets and industrial scenarios demonstrate consistent performance advantages.

📄 PDF Abstract BibTeX arXiv:2506.06270

Code (1)

hkuds/recgpt 공식 구현 pytorch

Tasks

DecodermodelQuantizationRecommendation SystemsSequential RecommendationZero-shot Generalization

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음

Similar Papers 제목 키워드 기반

RecGPT: Generative Pre-training for Text-based Recommendation

2024-05-21 · Hoang Ngo, Dat Quoc Nguyen

We present the first domain-adapted and fully-trained large language model, RecGPT-7B, and its instruction-following variant, RecGPT-7B-Instruct, for text-based recommendation. Experimental results on rating prediction a…

Instruction FollowingLanguage ModelingLanguage ModellingLarge Language Model+1

RecGPT Technical Report

2025-07-30 · Chao Yi, Dian Chen, Gaoyang Guo, Jiakai Tang 외 arxiv

Recommender systems are among the most impactful applications of artificial intelligence, serving as critical infrastructure connecting users, merchants, and platforms. However, most current industrial systems remain hea…

Explanation Generation

RecGPT-V3 Technical Report

2026-07-17 · Bowen Zheng, Chao Yi, Dian Chen, Gaoyang Guo 외 hf

Large language models (LLMs) are transforming recommender systems from matching co-occurrence patterns in historical behavior toward reasoning about the intent that drives it. RecGPT-V1 pioneered this paradigm on Taobao …

RecGPT: Generative Personalized Prompts for Sequential Recommendation via ChatGPT Training Paradigm

2024-04-06 · Yabin Zhang, Wenhui Yu, Erhan Zhang, Xu Chen 외

ChatGPT has achieved remarkable success in natural language understanding. Considering that recommendation is indeed a conversation between users and the system with items as words, which has similar underlying pattern w…

Natural Language UnderstandingSequential Recommendation

RecGPT-V2 Technical Report

2025-12-16 · Chao Yi, Dian Chen, Gaoyang Guo, Jiakai Tang 외 arxiv

Large language models (LLMs) have demonstrated remarkable potential in transforming recommender systems from implicit behavioral pattern matching to explicit intent reasoning. While RecGPT-V1 successfully pioneered this …

Reinforcement Learning