FedNoisy: Federated Noisy Label Learning Benchmark

2023-06-20 · Siqi Liang, Jintao Huang, Junyuan Hong, Dun Zeng, Jiayu Zhou, Zenglin Xu

Federated learning has gained popularity for distributed learning without aggregating sensitive data from clients. But meanwhile, the distributed and isolated nature of data isolation may be complicated by data quality, making it more vulnerable to noisy labels. Many efforts exist to defend against the negative impacts of noisy labels in centralized or federated settings. However, there is a lack of a benchmark that comprehensively considers the impact of noisy labels in a wide variety of typical FL settings. In this work, we serve the first standardized benchmark that can help researchers fully explore potential federated noisy settings. Also, we conduct comprehensive experiments to explore the characteristics of these data settings and unravel challenging scenarios on the federated noisy label learning, which may guide method development in the future. We highlight the 20 basic settings for more than 5 datasets proposed in our benchmark and standardized simulation pipeline for federated noisy label learning. We hope this benchmark can facilitate idea verification in federated learning with noisy labels. \texttt{FedNoisy} is available at \codeword{https://github.com/SMILELab-FL/FedNoisy}.

📄 PDF Abstract BibTeX arXiv:2306.11650

Code (1)

smilelab-fl/fednoisy 공식 구현 pytorch

Tasks

Federated Learning Learning with noisy labels

Federated Medical Image Segmentation under Real-World Label Noise: A Benchmark Suite for Noisy Label Learning Method Selection

2026-06-15 · Markus Bujotzek, Dimitrios Bounias, Stefan Denner, Ralf Floca 외 arxiv

While federated learning (FL) enables collaborative medical image segmentation without centralizing sensitive data, real-world deployment is frequently complicated by cross-site label imperfections such as contour disagr…

Medical Image Segmentation Federated Learning

FedSIR: Spectral Client Identification and Relabeling for Federated Learning with Noisy Labels

2026-04-22 · Sina Gholami, Abdulmoneam Ali, Tania Haghighi, Ahmed Arafa 외 arxiv

Federated learning (FL) enables collaborative model training without sharing raw data; however, the presence of noisy labels across distributed clients can severely degrade the learning performance. In this paper, we pro…

Knowledge Distillation Federated Learning

FNBench: Benchmarking Robust Federated Learning against Noisy Labels

2025-05-10 · Xuefeng Jiang, Jia Li, Nannan Wu, Zhiyuan Wu 외

Robustness to label noise within data is a significant challenge in federated learning (FL). From the data-centric perspective, the data quality of distributed datasets can not be guaranteed since annotations of differen…

Benchmarking Federated Learning text-classification Text Classification

Local K-Similarity Constraint for Federated Learning with Label Noise

2025-11-09 · Sanskar Amgain, Prashant Shrestha, Bidur Khanal, Alina Devkota 외 arxiv

Federated learning on clients with noisy labels is a challenging problem, as such clients can infiltrate the global model, impacting the overall generalizability of the system. Existing methods proposed to handle noisy c…

Medical Image Classification Federated Learning

Towards Federated Learning against Noisy Labels via Local Self-Regularization

2022-08-25 · Xuefeng Jiang, Sheng Sun, Yuwei Wang, Min Liu

Federated learning (FL) aims to learn joint knowledge from a large scale of decentralized devices with labeled data in a privacy-preserving manner. However, since high-quality labeled data require expensive human intelli…

Federated Learning Privacy Preserving