paper-with-me

Papers

Federated Learning with Data-Agnostic Distribution Fusion

2021-09-29 · CVPR 2023 1 · Jian-hui Duan, Wenzhong Li, Sanglu Lu

Federated learning has emerged as a promising distributed machine learning paradigm to preserve data privacy. One of the fundamental challenges of federated learning is that data samples across clients are usually not independent and identically distributed (non-IID), leading to slow convergence and severe performance drop of the aggregated global model. In this paper, we propose a novel data-agnostic distribution fusion based model aggregation method called \texttt{FedDAF} to optimize federated learning with non-IID local datasets, based on which the heterogeneous clients' data distributions can be represented by the fusion of several virtual components with different parameters and weights. We develop a variational autoencoder (VAE) method to derive the optimal parameters for the fusion distribution using the limited statistical information extracted from local models, which optimizes model aggregation for federated learning by solving a probabilistic maximization problem. Extensive experiments based on various federated learning scenarios with real-world datasets show that \texttt{FedDAF} achieves significant performance improvement compared to the state-of-the-art.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Federated Learning

Similar Papers 제목 키워드 기반

Dynamic Fusion based Federated Learning for COVID-19 Detection

2020-09-22 · Weishan Zhang, Tao Zhou, Qinghua Lu, Xiao Wang 외

Medical diagnostic image analysis (e.g., CT scan or X-Ray) using machine learning is an efficient and accurate way to detect COVID-19 infections. However, sharing diagnostic images across medical institutions is usually …

BIG-bench Machine LearningDecision MakingDiagnosticFederated Learning+3

Fairness-aware Agnostic Federated Learning

2020-10-10 · Wei Du, Depeng Xu, Xintao Wu, Hanghang Tong

Federated learning is an emerging framework that builds centralized machine learning models with training data distributed across multiple devices. Most of the previous works about federated learning focus on the privacy…

FairnessFederated Learning

Communication-Efficient Agnostic Federated Averaging

2021-04-06 · Jae Ro, Mingqing Chen, Rajiv Mathews, Mehryar Mohri 외

In distributed learning settings such as federated learning, the training algorithm can be potentially biased towards different clients. Mohri et al. (2019) proposed a domain-agnostic learning algorithm, where the model …

Federated LearningLanguage ModelingLanguage Modelling

Agnostic Federated Learning

2019-02-01 · Mehryar Mohri, Gary Sivek, Ananda Theertha Suresh

A key learning scenario in large-scale applications is that of federated learning, where a centralized model is trained based on data originating from a large number of clients. We argue that, with the existing training …

Cloud ComputingDomain AdaptationFairnessFederated Learning+1

MOSAIC: Modality-agnostic Spectral Alignment for Federated Image-level Weakly Supervised Tumor Segmentation under Client-specific Missing Modalities

2026-08-20 · Tarun Kumar Garg, Vaanathi Sundaresan arxiv

Trustworthy multimodal fusion in clinical settings requires handling incomplete and heterogeneous modality subsets across institutions, where privacy constraints prohibit centralized data sharing. Federated learning (FL)…

Federated LearningTumor Segmentation