Aequa: Fair Model Rewards in Collaborative Learning via Slimmable Networks
Collaborative learning enables multiple participants to learn a single global model by exchanging focused updates instead of sharing data. One of the core challenges in collaborative learning is ensuring that participants are rewarded fairly for their contributions, which entails two key sub-problems: contribution assessment and reward allocation. This work focuses on fair reward allocation, where the participants are incentivized through model rewards - differentiated final models whose performance is commensurate with the contribution. In this work, we leverage the concept of slimmable neural networks to collaboratively learn a shared global model whose performance degrades gracefully with a reduction in model width. We also propose a post-training fair allocation algorithm that determines the model width for each participant based on their contributions. We theoretically study the convergence of our proposed approach and empirically validate it using extensive experiments on different datasets and architectures. We also extend our approach to enable training-time model reward allocation.
Code (0)
등록된 구현이 없습니다.
Tasks
Contribution AssessmentSimilar Papers 제목 키워드 기반
Gradient Driven Rewards to Guarantee Fairness in Collaborative Machine Learning
Collaborative machine learning provides a promising framework for different agents to pool their resources (e.g., data) for a common learning task. In realistic settings where agents are self-interested and not altruisti…
BIG-bench Machine LearningFairnessFederated LearningFedSAC: Dynamic Submodel Allocation for Collaborative Fairness in Federated Learning
Collaborative fairness stands as an essential element in federated learning to encourage client participation by equitably distributing rewards based on individual contributions. Existing methods primarily focus on adjus…
Collaborative FairnessFairnessFederated LearningIncentivizing Truthfulness and Collaborative Fairness in Bayesian Learning
Collaborative machine learning involves training high-quality models using datasets from a number of sources. To incentivize sources to share data, existing data valuation methods fairly reward each source based on its d…
Dynamic Slimmable Denoising Network
Recently, tremendous human-designed and automatically searched neural networks have been applied to image denoising. However, previous works intend to handle all noisy images in a pre-defined static network architecture,…
DenoisingFairnessImage DenoisingA Ratio-Based Shapley Value for Collaborative Machine Learning - Extended Version
Collaborative machine learning enables multiple data owners to jointly train models for improved predictive performance. However, ensuring incentive compatibility and fair contribution-based rewards remains a critical ch…