paper-with-me

Papers

SPACE: Single-round Participant Amalgamation for Contribution Evaluation in Federated Learning

2023-09-21 · NeurIPS 2023 11

The evaluation of participant contribution in federated learning (FL) has recently gained significant attention due to its applicability in various domains, such as incentive mechanisms, robustness enhancement, and client selection. Previous approaches have predominantly relied on the widely adopted Shapley value for participant evaluation. However, the computation of the Shapley value is expensive, despite using techniques like gradient-based model reconstruction and truncating unnecessary evaluations. Therefore, we present an efficient approach called Single-round Participants Amalgamation for Contribution Evaluation (SPACE). SPACE incorporates two novel components, namely Federated Knowledge Amalgamation and Prototype-based Model Evaluation to reduce the evaluation effort by eliminating the dependence on the size of the validation set and enabling participant evaluation within a single communication round. Experimental results demonstrate that SPACE outperforms state-of-the-art methods in terms of both running time and Pearson’s Correlation Coefficient (PCC). Furthermore, extensive experiments conducted on applications, client reweighting, and client selection highlight the effectiveness of SPACE. The code is available at https://github.com/culiver/SPACE.Submission Number: 1352

📄 PDF Abstract BibTeX

Code (1)

culiver/space 공식 구현 pytorch

Similar Papers 제목 키워드 기반

Optimizer Amalgamation

2022-03-12 · ICLR 2022 4 · Tianshu Huang, Tianlong Chen, Sijia Liu, Shiyu Chang 외

Selecting an appropriate optimizer for a given problem is of major interest for researchers and practitioners. Many analytical optimizers have been proposed using a variety of theoretical and empirical approaches; howeve…

CoAst: Validation-Free Contribution Assessment for Federated Learning based on Cross-Round Valuation

2024-09-04 · Hao Wu, Likun Zhang, Shucheng Li, Fengyuan Xu 외

In the federated learning (FL) process, since the data held by each participant is different, it is necessary to figure out which participant has a higher contribution to the model performance. Effective contribution ass…

Contribution AssessmentFederated LearningQuantization

Privacy-Preserving in Blockchain-based Federated Learning Systems

2024-01-07 · Sameera K. M., Serena Nicolazzo, Marco Arazzi, Antonino Nocera 외

Federated Learning (FL) has recently arisen as a revolutionary approach to collaborative training Machine Learning models. According to this novel framework, multiple participants train a global model collaboratively, co…

Federated LearningPrivacy Preserving

Federated Selective Aggregation for Knowledge Amalgamation

2022-07-27 · Donglin Xie, Ruonan Yu, Gongfan Fang, Jie Song 외

In this paper, we explore a new knowledge-amalgamation problem, termed Federated Selective Aggregation (FedSA). The goal of FedSA is to train a student model for a new task with the help of several decentralized teachers…

Contrastive Knowledge Amalgamation for Unsupervised Image Classification

2023-07-27 · Shangde Gao, Yichao Fu, Ke Liu, Yuqiang Han

Knowledge amalgamation (KA) aims to learn a compact student model to handle the joint objective from multiple teacher models that are are specialized for their own tasks respectively. Current methods focus on coarsely al…

Classificationimage-classificationImage ClassificationUnsupervised Image Classification