Policy-Based Federated Learning
In this paper we present PoliFL, a decentralized, edge-based framework that supports heterogeneous privacy policies for federated learning. We evaluate our system on three use cases that train models with sensitive user data collected by mobile phones - predictive text, image classification, and notification engagement prediction - on a Raspberry Pi edge device. We find that PoliFL is able to perform accurate model training and inference within reasonable resource and time budgets while also enforcing heterogeneous privacy policies.
Code (2)
Tasks
Federated Learningimage-classificationImage ClassificationSimilar Papers 제목 키워드 기반
On Global Convergence Rates for Federated Policy Gradient under Heterogeneous Environment
Ensuring convergence of policy gradient methods in federated reinforcement learning (FRL) under environment heterogeneity remains a major challenge. In this work, we first establish that heterogeneity, perhaps counter-in…
Federated LearningPolicy Gradient MethodsQ-LearningFederated Reinforcement Learning with Constraint Heterogeneity
We study a Federated Reinforcement Learning (FedRL) problem with constraint heterogeneity. In our setting, we aim to solve a reinforcement learning problem with multiple constraints while $N$ training agents are located …
Language ModelingLanguage ModellingLarge Language ModelPolicy Gradient Methods+2Federated Natural Policy Gradient and Actor Critic Methods for Multi-task Reinforcement Learning
Federated reinforcement learning (RL) enables collaborative decision making of multiple distributed agents without sharing local data trajectories. In this work, we consider a multi-task setting, in which each agent has …
Decision MakingPolicy Gradient Methodsreinforcement-learningReinforcement Learning (RL)Efficient Federated RLHF via Zeroth-Order Policy Optimization
This paper considers reinforcement learning from human feedback in a federated learning setting with resource-constrained agents, such as edge devices. We propose an efficient federated RLHF algorithm, named Partitioned,…
Reinforcement LearningFederated LearningFORLER: Federated Offline Reinforcement Learning with Q-Ensemble and Actor Rectification
In Internet-of-Things systems, federated learning has advanced online reinforcement learning (RL) by enabling parallel policy training without sharing raw data. However, interacting with real environments online can be r…
Reinforcement LearningFederated LearningOffline RL