paper-with-me

홈 › Papers

MergeRec: Model Merging for Data-Isolated Cross-Domain Sequential Recommendation

2026-01-05 · Hyunsoo Kim, Jaewan Moon, Seongmin Park, Jongwuk Lee arxiv

Modern recommender systems trained on domain-specific data often struggle to generalize across multiple domains. Cross-domain sequential recommendation has emerged as a promising research direction to address this challenge; however, existing approaches face fundamental limitations, such as reliance on overlapping users or items across domains, or unrealistic assumptions that ignore privacy constraints. In this work, we propose a new framework, MergeRec, based on model merging under a new and realistic problem setting termed data-isolated cross-domain sequential recommendation, where raw user interaction data cannot be shared across domains. MergeRec consists of three key components: (1) merging initialization, (2) pseudo-user data construction, and (3) collaborative merging optimization. First, we initialize a merged model using training-free merging techniques. Next, we construct pseudo-user data by treating each item as a virtual sequence in each domain, enabling the synthesis of meaningful training samples without relying on real user interactions. Finally, we optimize domain-specific merging weights through a joint objective that combines a recommendation loss, which encourages the merged model to identify relevant items, and a distillation loss, which transfers collaborative filtering signals from the fine-tuned source models. Extensive experiments demonstrate that MergeRec not only preserves the strengths of the original models but also significantly enhances generalizability to unseen domains. Compared to conventional model merging methods, MergeRec consistently achieves superior performance, with average improvements of up to 17.21% in Recall@10, highlighting the potential of model merging as a scalable and effective approach for building universal recommender systems. The source code is available at https://github.com/DIALLab-SKKU/MergeRec.

📄 PDF Abstract BibTeX arXiv:2601.01753

Code (0)

등록된 구현이 없습니다.

Tasks

Sequential RecommendationCollaborative Filtering

Similar Papers 제목 키워드 기반

Merging Text Transformer Models from Different Initializations

2024-03-01 · Neha Verma, Maha Elbayad

Recent work on permutation-based model merging has shown impressive low- or zero-barrier mode connectivity between models from completely different initializations. However, this line of work has not yet extended to the …

Language ModelingLanguage ModellingMasked Language Modeling

Read, Grep, and Synthesize: Diagnosing Cross-Domain Seed Exposure for LLM Research Ideation

2026-05-12 · Yunju Choi, Min Song arxiv

The discovery of novel methodologies for emerging problems is a continuing cycle in ML, often driven by the migration of techniques across domains. Building on this observation, we ask whether current LLM ideation system…

Interaction, Process, Infrastructure: A Unified Architecture for Human-Agent Collaboration

2025-06-13 · Yun Wang, Yan Lu

As AI tools proliferate across domains, from chatbots and copilots to emerging agents, they increasingly support professional knowledge work. Yet despite their growing capabilities, these systems remain fragmented: they …

Human Agent Collaboration

One Model to Translate Them All? A Journey to Mount Doom for Multilingual Model Merging

2026-04-03 · Baban Gain, Asif Ekbal, Trilok Nath Singh arxiv

Weight-space model merging combines independently fine-tuned models without accessing original training data, offering a practical alternative to joint training. While merging succeeds in multitask settings, its behavior…

Machine Translation

Transferring Cross-domain Knowledge for Video Sign Language Recognition

2020-03-08 · CVPR 2020 6 · Dongxu Li, Xin Yu, Chenchen Xu, Lars Petersson 외

Word-level sign language recognition (WSLR) is a fundamental task in sign language interpretation. It requires models to recognize isolated sign words from videos. However, annotating WSLR data needs expert knowledge, th…

Sign Language Recognition