Distributed Learning with Strategic Users: A Repeated Game Approach
We consider a distributed learning setting where strategic users are incentivized, by a cost-sensitive fusion center, to train a learning model based on local data. The users are not obliged to provide their true gradient updates and the fusion center is not capable of validating the authenticity of reported updates. Thus motivated, we formulate the interactions between the fusion center and the users as repeated games, manifesting an under-explored interplay between machine learning and game theory. We then develop an incentive mechanism for the fusion center based on a joint gradient estimation and user action classification scheme, and study its impact on the convergence performance of distributed learning. Further, we devise an adaptive zero-determinant (ZD) strategy, thereby generalizing the celebrated ZD strategy to the repeated games with time-varying stochastic errors. Theoretical and empirical analysis show that the fusion center can incentivize the strategic users to cooperate and report informative gradient updates, thus ensuring the convergence.
Code (0)
등록된 구현이 없습니다.
Tasks
Action ClassificationSimilar Papers 제목 키워드 기반
How and Why to Manipulate Your Own Agent: On the Incentives of Users of Learning Agents
The usage of automated learning agents is becoming increasingly prevalent in many online economic applications such as online auctions and automated trading. Motivated by such applications, this paper is dedicated to fun…
Do LLMs trust AI regulation? Emerging behaviour of game-theoretic LLM agents
There is general agreement that fostering trust and cooperation within the AI development ecosystem is essential to promote the adoption of trustworthy AI systems. By embedding Large Language Model (LLM) agents within an…
Large Language ModelReputation and Risk in Regimes
How valuable is reputation to a regime seeking to deter uprisings? I show the answer depends almost entirely on players' strategic uncertainty over other players actions. Without higher-order uncertainty, reputational ef…
Testing Models of Strategic Uncertainty: Equilibrium Selection in Repeated Games
In repeated-game applications where both the collusive and non-collusive outcomes can be supported as equilibria, researchers must resolve underlying selection questions if theory will be used to understand counterfactua…
counterfactualA Game-theoretic Understanding of Repeated Explanations in ML Models
This paper formally models the strategic repeated interactions between a system, comprising of a machine learning (ML) model and associated explanation method, and an end-user who is seeking a prediction/label and its ex…