Budgeted Online Model Selection and Fine-Tuning via Federated Learning
Online model selection involves selecting a model from a set of candidate models 'on the fly' to perform prediction on a stream of data. The choice of candidate models henceforth has a crucial impact on the performance. Although employing a larger set of candidate models naturally leads to more flexibility in model selection, this may be infeasible in cases where prediction tasks are performed on edge devices with limited memory. Faced with this challenge, the present paper proposes an online federated model selection framework where a group of learners (clients) interacts with a server with sufficient memory such that the server stores all candidate models. However, each client only chooses to store a subset of models that can be fit into its memory and performs its own prediction task using one of the stored models. Furthermore, employing the proposed algorithm, clients and the server collaborate to fine-tune models to adapt them to a non-stationary environment. Theoretical analysis proves that the proposed algorithm enjoys sub-linear regret with respect to the best model in hindsight. Experiments on real datasets demonstrate the effectiveness of the proposed algorithm.
Code (0)
등록된 구현이 없습니다.
Tasks
Federated LearningModel SelectionPredictionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Budgeted Online Selection of Candidate IoT Clients to Participate in Federated Learning
Machine Learning (ML), and Deep Learning (DL) in particular, play a vital role in providing smart services to the industry. These techniques however suffer from privacy and security concerns since data is collected from …
Federated LearningCompute-Constrained Data Selection
Data selection can reduce the amount of training data needed to finetune LLMs; however, the efficacy of data selection scales directly with its compute. Motivated by the practical challenge of compute-constrained finetun…
Personalized Federated Learning with Mixture of Models for Adaptive Prediction and Model Fine-Tuning
Federated learning is renowned for its efficacy in distributed model training, ensuring that users, called clients, retain data privacy by not disclosing their data to the central server that orchestrates collaborations.…
Federated LearningPersonalized Federated LearningA Federated Fine-Tuning Paradigm of Foundation Models in Heterogenous Wireless Networks
Edge intelligence has emerged as a promising strategy to deliver low-latency and ubiquitous services for mobile devices. Recent advances in fine-tuning mechanisms of foundation models have enabled edge intelligence by in…
Federated LearningAdaptive LoRA Experts Allocation and Selection for Federated Fine-Tuning
Large Language Models (LLMs) have demonstrated impressive capabilities across various tasks, but fine-tuning them for domain-specific applications often requires substantial domain-specific data that may be distributed a…
parameter-efficient fine-tuningFederated Learning