One-Shot Federated Learning with Classifier-Free Diffusion Models

2025-02-12 · Obaidullah Zaland, Shutong Jin, Florian T. Pokorny, Monowar Bhuyan

Federated learning (FL) enables collaborative learning without data centralization but introduces significant communication costs due to multiple communication rounds between clients and the server. One-shot federated learning (OSFL) addresses this by forming a global model with a single communication round, often relying on the server's model distillation or auxiliary dataset generation - often through pre-trained diffusion models (DMs). Existing DM-assisted OSFL methods, however, typically employ classifier-guided DMs, which require training auxiliary classifier models at each client, introducing additional computation overhead. This work introduces OSCAR (One-Shot Federated Learning with Classifier-Free Diffusion Models), a novel OSFL approach that eliminates the need for auxiliary models. OSCAR uses foundation models to devise category-specific data representations at each client, seamlessly integrated into a classifier-free diffusion model pipeline for server-side data generation. OSCAR is a simple yet cost-effective OSFL approach that outperforms the state-of-the-art on four benchmarking datasets while reducing the communication load by at least 99%.

📄 PDF Abstract BibTeX arXiv:2502.08488

Code (0)

등록된 구현이 없습니다.

Tasks

BenchmarkingDataset GenerationFederated Learning

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Auxiliary Classifier Auxiliary Classifiers are type of architectural component that seek to improve the convergence of very deep networks. They are classifier heads we attach to layers before the…

OSCAR OSCAR is a new learning method that uses object tags detected in images as anchor points to ease the learning of image-text alignment. The model take a triple as input…

Meta-Learning via Classifier(-free) Diffusion Guidance

2022-10-17 · Elvis Nava, Seijin Kobayashi, Yifei Yin, Robert K. Katzschmann 외

We introduce meta-learning algorithms that perform zero-shot weight-space adaptation of neural network models to unseen tasks. Our methods repurpose the popular generative image synthesis techniques of natural language g…

Few-Shot Learning Image Generation Meta-Learning Visual Question Answering (VQA)+1

Understanding and Improving Training-free Loss-based Diffusion Guidance

2024-03-19 · Yifei Shen, Xinyang Jiang, Yezhen Wang, Yifan Yang 외

Adding additional control to pretrained diffusion models has become an increasingly popular research area, with extensive applications in computer vision, reinforcement learning, and AI for science. Recently, several stu…

Motion Generation

One-Shot Federated Learning with Classifier-Guided Diffusion Models

2023-11-15 · Mingzhao Yang, Shangchao Su, Bin Li, xiangyang xue

One-shot federated learning (OSFL) has gained attention in recent years due to its low communication cost. However, most of the existing methods require auxiliary datasets or training generators, which hinders their prac…

Federated Learning

A Simple and Efficient Baseline for Zero-Shot Generative Classification

2024-12-17 · Zipeng Qi, Buhua Liu, Shiyan Zhang, Bao Li 외

Large diffusion models have become mainstream generative models in both academic studies and industrial AIGC applications. Recently, a number of works further explored how to employ the power of large diffusion models as…

zero-shot-classification Zero-Shot Learning

Navigating Heterogeneity and Privacy in One-Shot Federated Learning with Diffusion Models

2024-05-02 · Matias Mendieta, Guangyu Sun, Chen Chen

Federated learning (FL) enables multiple clients to train models collectively while preserving data privacy. However, FL faces challenges in terms of communication cost and data heterogeneity. One-shot federated learning…