Communication-Efficient and Privacy-Preserving Decentralized Meta-Learning
Distributed learning, which does not require gathering training data in a central location, has become increasingly important in the big-data era. In particular, random-walk-based decentralized algorithms are flexible in that they do not need a central server trusted by all clients and do not require all clients to be active in all iterations. However, existing distributed learning algorithms assume that all learning clients share the same task. In this paper, we consider the more difficult meta-learning setting, in which different clients perform different (but related) tasks with limited training data. To reduce communication cost and allow better privacy protection, we propose LoDMeta (Local Decentralized Meta-learning) with the use of local auxiliary optimization parameters and random perturbations on the model parameter. Theoretical results are provided on both convergence and privacy analysis. Empirical results on a number of few-shot learning data sets demonstrate that LoDMeta has similar meta-learning accuracy as centralized meta-learning algorithms, but does not require gathering data from each client and is able to better protect data privacy for each client.
Code (0)
등록된 구현이 없습니다.
Tasks
AllFew-Shot LearningMeta-LearningPrivacy PreservingSimilar Papers 제목 키워드 기반
Privacy-Preserving Decentralized Inference with Graph Neural Networks in Wireless Networks
As an efficient neural network model for graph data, graph neural networks (GNNs) recently find successful applications for various wireless optimization problems. Given that the inference stage of GNNs can be naturally …
Efficient Neural NetworkManagementPrivacy PreservingPrivacy-preserving Decentralized Federated Learning over Time-varying Communication Graph
Establishing how a set of learners can provide privacy-preserving federated learning in a fully decentralized (peer-to-peer, no coordinator) manner is an open problem. We propose the first privacy-preserving consensus-ba…
Computational EfficiencyFederated LearningPrivacy PreservingMetaFed: Advancing Privacy, Performance, and Sustainability in Federated Metaverse Systems
The rapid expansion of immersive Metaverse applications introduces complex challenges at the intersection of performance, privacy, and environmental sustainability. Centralized architectures fall short in addressing thes…
Multi-agent Reinforcement LearningFederated LearningPrivacy-Preserving Communication-Efficient Federated Multi-Armed Bandits
Communication bottleneck and data privacy are two critical concerns in federated multi-armed bandit (MAB) problems, such as situations in decision-making and recommendations of connected vehicles via wireless. In this pa…
Decision MakingMulti-Armed BanditsPrivacy PreservingPrivacy-preserving Decentralized Aggregation for Federated Learning
Federated learning is a promising framework for learning over decentralized data spanning multiple regions. This approach avoids expensive central training data aggregation cost and can improve privacy because distribute…
Federated Learningimage-classificationImage ClassificationPrivacy Preserving