Price of Stability in Quality-Aware Federated Learning
Federated Learning (FL) is a distributed machine learning scheme that enables clients to train a shared global model without exchanging local data. The presence of label noise can severely degrade the FL performance, and some existing studies have focused on algorithm design for label denoising. However, they ignored the important issue that clients may not apply costly label denoising strategies due to them being self-interested and having heterogeneous valuations on the FL performance. To fill this gap, we model the clients' interactions as a novel label denoising game and characterize its equilibrium. We also analyze the price of stability, which quantifies the difference in the system performance (e.g., global model accuracy, social welfare) between the equilibrium outcome and the socially optimal solution. We prove that the equilibrium outcome always leads to a lower global model accuracy than the socially optimal solution does. We further design an efficient algorithm to compute the socially optimal solution. Numerical experiments on MNIST dataset show that the price of stability increases as the clients' data become noisier, calling for an effective incentive mechanism.
Code (0)
등록된 구현이 없습니다.
Tasks
DenoisingFederated LearningSimilar Papers 제목 키워드 기반
The Paradox of Noise: An Empirical Study of Noise-Infusion Mechanisms to Improve Generalization, Stability, and Privacy in Federated Learning
In a data-centric era, concerns regarding privacy and ethical data handling grow as machine learning relies more on personal information. This empirical study investigates the privacy, generalization, and stability of de…
Federated LearningPrivacy PreservingPrivacy Preserving Deep LearningOptimality and Stability in Federated Learning: A Game-theoretic Approach
Federated learning is a distributed learning paradigm where multiple agents, each only with access to local data, jointly learn a global model. There has recently been an explosion of research aiming not only to improve …
Federated LearningFusion of Sentiment and Asset Price Predictions for Portfolio Optimization
The fusion of public sentiment data in the form of text with stock price prediction is a topic of increasing interest within the financial community. However, the research literature seldom explores the application of in…
Portfolio OptimizationPredictionStock Price PredictionCartel Stability under Quality Differentiation
This note considers cartel stability when the cartelized products are vertically differentiated. If market shares are maintained at pre-collusive levels, then the firm with the lowest competitive price-cost margin has th…
Bank financial stability, bank valuation and international oil prices: Evidence from listed Russian public banks
Using data on 17 listed public banks from Russia over the period 2008 to 2016, we analyze whether international oil prices affect the bank stability in an oil-dependent country. We posit that a decrease in international …