Federated Learning While Providing Model as a Service: Joint Training and Inference Optimization

2023-12-20 · Pengchao Han, Shiqiang Wang, Yang Jiao, Jianwei Huang

While providing machine learning model as a service to process users' inference requests, online applications can periodically upgrade the model utilizing newly collected data. Federated learning (FL) is beneficial for enabling the training of models across distributed clients while keeping the data locally. However, existing work has overlooked the coexistence of model training and inference under clients' limited resources. This paper focuses on the joint optimization of model training and inference to maximize inference performance at clients. Such an optimization faces several challenges. The first challenge is to characterize the clients' inference performance when clients may partially participate in FL. To resolve this challenge, we introduce a new notion of age of model (AoM) to quantify client-side model freshness, based on which we use FL's global model convergence error as an approximate measure of inference performance. The second challenge is the tight coupling among clients' decisions, including participation probability in FL, model download probability, and service rates. Toward the challenges, we propose an online problem approximation to reduce the problem complexity and optimize the resources to balance the needs of model training and inference. Experimental results demonstrate that the proposed algorithm improves the average inference accuracy by up to 12%.

📄 PDF Abstract BibTeX arXiv:2312.12863

Code (0)

등록된 구현이 없습니다.

Tasks

Federated LearningInference Optimization

Methods 이 논문이 사용한 방법론

Golden Queue Managers 설명 없음

NebulaFL: Effective Asynchronous Federated Learning for JointCloud Computing

2024-12-06 · Fei Gao, Ming Hu, Zhiyu Xie, Peichang Shi 외

With advancements in AI infrastructure and Trusted Execution Environment (TEE) technology, Federated Learning as a Service (FLaaS) through JointCloud Computing (JCC) is promising to break through the resource constraints…

Federated Learning Scheduling

Learning-Based Client Selection for Federated Learning Services Over Wireless Networks with Constrained Monetary Budgets

2022-08-08 · Zhipeng Cheng, Xuwei Fan, Minghui LiWang, Ning Chen 외

We investigate a data quality-aware dynamic client selection problem for multiple federated learning (FL) services in a wireless network, where each client offers dynamic datasets for the simultaneous training of multipl…

Deep Reinforcement Learning Federated Learning reinforcement-learning Reinforcement Learning (RL)

Toward Multiple Federated Learning Services Resource Sharing in Mobile Edge Networks

2020-11-25 · Minh N. H. Nguyen, Nguyen H. Tran, Yan Kyaw Tun, Zhu Han 외

Federated Learning is a new learning scheme for collaborative training a shared prediction model while keeping data locally on participating devices. In this paper, we study a new model of multiple federated learning ser…

CPU Edge-computing Federated Learning

Project Florida: Federated Learning Made Easy

2023-07-21 · Daniel Madrigal Diaz, Andre Manoel, Jialei Chen, Nalin Singal 외

We present Project Florida, a system architecture and software development kit (SDK) enabling deployment of large-scale Federated Learning (FL) solutions across a heterogeneous device ecosystem. Federated learning is an …

Federated Learning Management

Profit Allocation for Federated Learning

2019-01-01 · IEEE International Conference on Big Data (Big Data) 2019 1 · Tianshu Song, Yongxin Tong*, Shuyue Wei

Due to stricter data management regulations such as General Data Protection Regulation (GDPR), traditional production mode of machine learning services is shifting to federated learning, a paradigm that allows multiple d…

Data Valuation Federated Learning