paper-with-me

홈 › Papers

Diffusion Model-Based Data Synthesis Aided Federated Semi-Supervised Learning

2025-01-04 · Zhongwei Wang, Tong Wu, Zhiyong Chen, Liang Qian, Yin Xu, Meixia Tao

Federated semi-supervised learning (FSSL) is primarily challenged by two factors: the scarcity of labeled data across clients and the non-independent and identically distribution (non-IID) nature of data among clients. In this paper, we propose a novel approach, diffusion model-based data synthesis aided FSSL (DDSA-FSSL), which utilizes a diffusion model (DM) to generate synthetic data, bridging the gap between heterogeneous local data distributions and the global data distribution. In DDSA-FSSL, clients address the challenge of the scarcity of labeled data by employing a federated learning-trained classifier to perform pseudo labeling for unlabeled data. The DM is then collaboratively trained using both labeled and precision-optimized pseudo-labeled data, enabling clients to generate synthetic samples for classes that are absent in their labeled datasets. This process allows clients to generate more comprehensive synthetic datasets aligned with the global distribution. Extensive experiments conducted on multiple datasets and varying non-IID distributions demonstrate the effectiveness of DDSA-FSSL, e.g., it improves accuracy from 38.46% to 52.14% on CIFAR-10 datasets with 10% labeled data.

📄 PDF Abstract BibTeX arXiv:2501.02219

Code (0)

등록된 구현이 없습니다.

Tasks

Federated Learning

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Federated Learning with GAN-based Data Synthesis for Non-IID Clients

2022-06-11 · Zijian Li, Jiawei Shao, Yuyi Mao, Jessie Hui Wang 외

Federated learning (FL) has recently emerged as a popular privacy-preserving collaborative learning paradigm. However, it suffers from the non-independent and identically distributed (non-IID) data among clients. In this…

Federated LearningGenerative Adversarial NetworkPrivacy Preserving

Federated Semi-Supervised Learning for COVID Region Segmentation in Chest CT using Multi-National Data from China, Italy, Japan

2020-11-23 · Dong Yang, Ziyue Xu, Wenqi Li, Andriy Myronenko 외

The recent outbreak of COVID-19 has led to urgent needs for reliable diagnosis and management of SARS-CoV-2 infection. As a complimentary tool, chest CT has been shown to be able to reveal visual patterns characteristic …

Federated LearningManagement

RetroDiff: Retrosynthesis as Multi-stage Distribution Interpolation

2023-11-23 · Yiming Wang, Yuxuan Song, Minkai Xu, Rui Wang 외

Retrosynthesis poses a fundamental challenge in biopharmaceuticals, aiming to aid chemists in finding appropriate reactant molecules and synthetic pathways given determined product molecules. With the reactant and produc…

Graph GenerationRetrosynthesis

Exploring One-shot Semi-supervised Federated Learning with A Pre-trained Diffusion Model

2023-05-06 · Mingzhao Yang, Shangchao Su, Bin Li, xiangyang xue

Recently, semi-supervised federated learning (semi-FL) has been proposed to handle the commonly seen real-world scenarios with labeled data on the server and unlabeled data on the clients. However, existing methods face …

DiversityFederated LearningPrivacy Preserving

MakeSinger: A Semi-Supervised Training Method for Data-Efficient Singing Voice Synthesis via Classifier-free Diffusion Guidance

2024-06-10 · Semin Kim, Myeonghun Jeong, Hyeonseung Lee, Minchan Kim 외

In this paper, we propose MakeSinger, a semi-supervised training method for singing voice synthesis (SVS) via classifier-free diffusion guidance. The challenge in SVS lies in the costly process of gathering aligned sets …

Singing Voice Synthesistext-to-speechText to Speech