paper-with-me

Papers

User-specific Adaptive Fine-tuning for Cross-domain Recommendations

2021-06-15 · Lei Chen, Fajie Yuan, Jiaxi Yang, Xiangnan He, Chengming Li, Min Yang

Making accurate recommendations for cold-start users has been a longstanding and critical challenge for recommender systems (RS). Cross-domain recommendations (CDR) offer a solution to tackle such a cold-start problem when there is no sufficient data for the users who have rarely used the system. An effective approach in CDR is to leverage the knowledge (e.g., user representations) learned from a related but different domain and transfer it to the target domain. Fine-tuning works as an effective transfer learning technique for this objective, which adapts the parameters of a pre-trained model from the source domain to the target domain. However, current methods are mainly based on the global fine-tuning strategy: the decision of which layers of the pre-trained model to freeze or fine-tune is taken for all users in the target domain. In this paper, we argue that users in RS are personalized and should have their own fine-tuning policies for better preference transfer learning. As such, we propose a novel User-specific Adaptive Fine-tuning method (UAF), selecting which layers of the pre-trained network to fine-tune, on a per-user basis. Specifically, we devise a policy network with three alternative strategies to automatically decide which layers to be fine-tuned and which layers to have their parameters frozen for each user. Extensive experiments show that the proposed UAF exhibits significantly better and more robust performance for user cold-start recommendation.

📄 PDF Abstract BibTeX arXiv:2106.07864

Code (0)

등록된 구현이 없습니다.

Tasks

Recommendation SystemsTransfer Learning

Similar Papers 제목 키워드 기반

MTA: A Merge-then-Adapt Framework for Personalized Large Language Model

2025-11-25 · Xiaopeng Li, Yuanjin Zheng, Wanyu Wang, wenlin zhang 외 arxiv

Personalized Large Language Models (PLLMs) aim to align model outputs with individual user preferences, a crucial capability for user-centric applications. However, the prevalent approach of fine-tuning a separate module…

Adaptive Self-Supervised Learning Strategies for Dynamic On-Device LLM Personalization

2024-09-25 · Rafael Mendoza, Isabella Cruz, Richard Liu, Aarav Deshmukh 외

Large language models (LLMs) have revolutionized how we interact with technology, but their personalization to individual user preferences remains a significant challenge, particularly in on-device applications. Traditio…

Self-Supervised Learning

Adaptive LoRA Experts Allocation and Selection for Federated Fine-Tuning

2025-09-18 · Lei Wang, Jieming Bian, Letian Zhang, Jie Xu arxiv

Large Language Models (LLMs) have demonstrated impressive capabilities across various tasks, but fine-tuning them for domain-specific applications often requires substantial domain-specific data that may be distributed a…

parameter-efficient fine-tuningFederated Learning

One Step to the Side: Why Defenses Against Malicious Finetuning Fail Under Adaptive Adversaries

2026-05-14 · Itay Zloczower, Eyal Lenga, Gilad Gressel, Yisroel Mirsky arxiv

Model providers increasingly release open weights or allow users to fine-tune foundation models through APIs. Although these models are safety-aligned before release, their safeguards can often be removed by fine-tuning …

A Study of Optimizations for Fine-tuning Large Language Models

2024-06-04 · Arjun Singh, Nikhil Pandey, Anup Shirgaonkar, Pavan Manoj 외

Fine-tuning large language models is a popular choice among users trying to adapt them for specific applications. However, fine-tuning these models is a demanding task because the user has to examine several factors, suc…

GPU