paper-with-me

Papers

Robust Federated Learning for Neural Networks

2021-01-01 · Yao Zhou, Jun Wu, Jingrui He

In federated learning, data is distributed among local clients which collaboratively train a prediction model using secure aggregation. To preserve the privacy of the clients, the federated learning paradigm requires each client to maintain a private local training data set, and only uploads its summarized model updates to the server. In this work, we show that this paradigm could lead to a degenerate model, which collapses in performance when the corrupted updates (under adversarial manipulations) are uploaded and aggregated at the server. To improve model robustness, we first decompose the aggregation error of the central server into bias and variance, and then, propose a robust federated learning framework, named Fed_BVA, that performs on-device adversarial training using the bias-variance oriented adversarial examples supplied by the server via asymmetrical communications. The experiments are conducted on multiple benchmark data sets using a few prevalent neural network models, and the empirical results show that our framework is robust against white-box and black-box adversarial corruptions under both IID and non-IID settings.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Federated Learning

Similar Papers 제목 키워드 기반

Survey of Privacy Threats and Countermeasures in Federated Learning

2024-02-01 · Masahiro Hayashitani, Junki Mori, Isamu Teranishi

Federated learning is widely considered to be as a privacy-aware learning method because no training data is exchanged directly between clients. Nevertheless, there are threats to privacy in federated learning, and priva…

Federated LearningSurveyVertical Federated Learning

A Benchmark for Federated Hetero-Task Learning

2022-06-07 · Liuyi Yao, Dawei Gao, Zhen Wang, Yuexiang Xie 외

To investigate the heterogeneity in federated learning in real-world scenarios, we generalize the classic federated learning to federated hetero-task learning, which emphasizes the inconsistency across the participants i…

Federated LearningMeta-LearningMulti-Task LearningText Generation

Federated Machine Learning: Concept and Applications

2019-02-13 · Qiang Yang, Yang Liu, Tianjian Chen, Yongxin Tong

Today's AI still faces two major challenges. One is that in most industries, data exists in the form of isolated islands. The other is the strengthening of data privacy and security. We propose a possible solution to the…

BIG-bench Machine LearningFederated LearningTransfer LearningVertical Federated Learning

Accelerating Fair Federated Learning: Adaptive Federated Adam

2023-01-23 · Li Ju, Tianru Zhang, Salman Toor, Andreas Hellander

Federated learning is a distributed and privacy-preserving approach to train a statistical model collaboratively from decentralized data of different parties. However, when datasets of participants are not independent an…

FairnessFederated LearningPrivacy Preserving

Federated Instrumental Variable Analysis via Federated Generalized Method of Moments

2025-05-27 · Geetika, Somya Tyagi, Bapi Chatterjee

Instrumental variables (IV) analysis is an important applied tool for areas such as healthcare and consumer economics. For IV analysis in high-dimensional settings, the Generalized Method of Moments (GMM) using deep neur…

Federated Learning