paper-with-me

홈 › Papers

Empowering Contrastive Federated Sequential Recommendation with LLMs

2026-02-10 · Thi Minh Chau Nguyen, Minh Hieu Nguyen, Duc Anh Nguyen, Xuan Huong Tran, Thanh Trung Huynh, Quoc Viet Hung Nguyen arxiv

Federated sequential recommendation (FedSeqRec) aims to perform next-item prediction while keeping user data decentralised, yet model quality is frequently constrained by fragmented, noisy, and homogeneous interaction logs stored on individual devices. Many existing approaches attempt to compensate through manual data augmentation or additional server-side constraints, but these strategies either introduce limited semantic diversity or increase system overhead. To overcome these challenges, we propose \textbf{LUMOS}, a parameter-isolated FedSeqRec architecture that integrates large language models (LLMs) as \emph{local semantic generators}. Instead of sharing gradients or auxiliary parameters, LUMOS privately invokes an on-device LLM to construct three complementary sequence variants from each user history: (i) \emph{future-oriented} trajectories that infer plausible behavioural continuations, (ii) \emph{semantically equivalent rephrasings} that retain user intent while diversifying interaction patterns, and (iii) \emph{preference-inconsistent counterfactuals} that serve as informative negatives. These synthesized sequences are jointly encoded within the federated backbone through a tri-view contrastive optimisation scheme, enabling richer representation learning without exposing sensitive information. Experimental results across three public benchmarks show that LUMOS achieves consistent gains over competitive centralised and federated baselines on HR@20 and NDCG@20. In addition, the use of semantically grounded positive signals and counterfactual negatives improves robustness under noisy and adversarial environments, even without dedicated server-side protection modules. Overall, this work demonstrates the potential of LLM-driven semantic generation as a new paradigm for advancing privacy-preserving federated recommendation.

📄 PDF Abstract BibTeX arXiv:2602.09306

Code (0)

등록된 구현이 없습니다.

Tasks

Sequential RecommendationRepresentation LearningData Augmentation

Similar Papers 제목 키워드 기반

FELLAS: Enhancing Federated Sequential Recommendation with LLM as External Services

2024-10-07 · Wei Yuan, Chaoqun Yang, Guanhua Ye, Tong Chen 외

Federated sequential recommendation (FedSeqRec) has gained growing attention due to its ability to protect user privacy. Unfortunately, the performance of FedSeqRec is still unsatisfactory because the models used in FedS…

Contrastive LearningPrivacy PreservingSequential Recommendation

Empowering Large Language Model for Sequential Recommendation via Multimodal Embeddings and Semantic IDs

2025-09-02 · Yuhao Wang, Junwei Pan, Xinhang Li, Maolin Wang 외 arxiv

Sequential recommendation (SR) aims to capture users' dynamic interests and sequential patterns based on their historical interactions. Recently, the powerful capabilities of large language models (LLMs) have driven thei…

Sequential RecommendationContrastive Learning

DV-FSR: A Dual-View Target Attack Framework for Federated Sequential Recommendation

2024-09-10 · Qitao Qin, Yucong Luo, Mingyue Cheng, Qingyang Mao 외

Federated recommendation (FedRec) preserves user privacy by enabling decentralized training of personalized models, but this architecture is inherently vulnerable to adversarial attacks. Significant research has been con…

Contrastive LearningSequential Recommendation

DARTS: A Dual-View Attack Framework for Targeted Manipulation in Federated Sequential Recommendation

2025-07-02 · Qitao Qin, Yucong Luo, Zhibo Chu

Federated recommendation (FedRec) preserves user privacy by enabling decentralized training of personalized models, but this architecture is inherently vulnerable to adversarial attacks. Significant research has been con…

Contrastive LearningSequential Recommendation

CALRec: Contrastive Alignment of Generative LLMs for Sequential Recommendation

2024-05-03 · Yaoyiran Li, Xiang Zhai, Moustafa Alzantot, Keyi Yu 외

Traditional recommender systems such as matrix factorization methods have primarily focused on learning a shared dense embedding space to represent both items and user preferences. Subsequently, sequence models such as R…

Language ModelingLanguage ModellingRecommendation SystemsSequential Recommendation