paper-with-me

Papers

Optimal Classification under Performative Distribution Shift

2024-11-04 · Edwige Cyffers, Muni Sreenivas Pydi, Jamal Atif, Olivier Cappé

Performative learning addresses the increasingly pervasive situations in which algorithmic decisions may induce changes in the data distribution as a consequence of their public deployment. We propose a novel view in which these performative effects are modelled as push-forward measures. This general framework encompasses existing models and enables novel performative gradient estimation methods, leading to more efficient and scalable learning strategies. For distribution shifts, unlike previous models which require full specification of the data distribution, we only assume knowledge of the shift operator that represents the performative changes. This approach can also be integrated into various change-of-variablebased models, such as VAEs or normalizing flows. Focusing on classification with a linear-in-parameters performative effect, we prove the convexity of the performative risk under a new set of assumptions. Notably, we do not limit the strength of performative effects but rather their direction, requiring only that classification becomes harder when deploying more accurate models. In this case, we also establish a connection with adversarially robust classification by reformulating the minimization of the performative risk as a min-max variational problem. Finally, we illustrate our approach on synthetic and real datasets.

📄 PDF Abstract BibTeX arXiv:2411.02023

Code (1)

totilas/PerfOpti 공식 구현

Tasks

ClassificationRobust classification

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Performative Policy Gradient: Optimality in Performative Reinforcement Learning

2025-12-23 · Debabrota Basu, Udvas Das, Brahim Driss, Uddalak Mukherjee arxiv

Post-deployment machine learning algorithms often influence the environments they act in, and thus shift the underlying dynamics that the standard reinforcement learning (RL) methods ignore. While designing optimal algor…

Reinforcement Learning

ProFL: Performative Robust Optimal Federated Learning

2024-10-23 · Xue Zheng, Tian Xie, Xuwei Tan, Aylin Yener 외

Performative prediction (PP) is a framework that captures distribution shifts that occur during the training of machine learning models due to their deployment. As the trained model is used, its generated data could caus…

Federated Learning

Outside the Echo Chamber: Optimizing the Performative Risk

2021-02-17 · John Miller, Juan C. Perdomo, Tijana Zrnic

In performative prediction, predictions guide decision-making and hence can influence the distribution of future data. To date, work on performative prediction has focused on finding performatively stable models, which a…

Decision Making

PAC Learnability in the Presence of Performativity

2025-10-09 · Ivan Kirev, Lyuben Baltadzhiev, Nikola Konstantinov arxiv

Following the wide-spread adoption of machine learning models in real-world applications, the phenomenon of performativity, i.e. model-dependent shifts in the test distribution, becomes increasingly prevalent. Unfortunat…

Binary Classification

Performative Federated Learning: A Solution to Model-Dependent and Heterogeneous Distribution Shifts

2023-05-08 · Kun Jin, Tongxin Yin, Zhongzhu Chen, Zeyu Sun 외

We consider a federated learning (FL) system consisting of multiple clients and a server, where the clients aim to collaboratively learn a common decision model from their distributed data. Unlike the conventional FL fra…

Federated Learning