FedMix: Approximation of Mixup under Mean Augmented Federated Learning
Federated learning (FL) allows edge devices to collectively learn a model without directly sharing data within each device, thus preserving privacy and eliminating the need to store data globally. While there are promising results under the assumption of independent and identically distributed (iid) local data, current state-of-the-art algorithms suffer from performance degradation as the heterogeneity of local data across clients increases. To resolve this issue, we propose a simple framework, Mean Augmented Federated Learning (MAFL), where clients send and receive averaged local data, subject to the privacy requirements of target applications. Under our framework, we propose a new augmentation algorithm, named FedMix, which is inspired by a phenomenal yet simple data augmentation method, Mixup, but does not require local raw data to be directly shared among devices. Our method shows greatly improved performance in the standard benchmark datasets of FL, under highly non-iid federated settings, compared to conventional algorithms.
Code (1)
Tasks
Data AugmentationFederated LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
FedMix: Mixed Supervised Federated Learning for Medical Image Segmentation
The purpose of federated learning is to enable multiple clients to jointly train a machine learning model without sharing data. However, the existing methods for training an image segmentation model have been based on an…
Federated LearningImage SegmentationLesion SegmentationMedical Image Segmentation+4RankMixup: Ranking-Based Mixup Training for Network Calibration
Network calibration aims to accurately estimate the level of confidences, which is particularly important for employing deep neural networks in real-world systems. Recent approaches leverage mixup to calibrate the networ…
Federated Mixture of Experts
Federated learning (FL) has emerged as the predominant approach for collaborative training of neural network models across multiple users, without the need to gather the data at a central location. One of the important c…
Federated LearningMixture-of-ExpertsSaliency Grafting: Innocuous Attribution-Guided Mixup with Calibrated Label Mixing
The Mixup scheme suggests mixing a pair of samples to create an augmented training sample and has gained considerable attention recently for improving the generalizability of neural networks. A straightforward and widely…
AMPLIFY:Attention-based Mixup for Performance Improvement and Label Smoothing in Transformer
Mixup is an effective data augmentation method that generates new augmented samples by aggregating linear combinations of different original samples. However, if there are noises or aberrant features in the original samp…
Data AugmentationSentencetext-classificationText Classification