paper-with-me

Papers

Stochastic Saddle Point Problems with Decision-Dependent Distributions

2022-01-07 · Killian Wood, Emiliano Dall'Anese

This paper focuses on stochastic saddle point problems with decision-dependent distributions. These are problems whose objective is the expected value of a stochastic payoff function and whose data distribution drifts in response to decision variables--a phenomenon represented by a distributional map. A common approach to accommodating distributional shift is to retrain optimal decisions once a new distribution is revealed, or repeated retraining. We introduce the notion of equilibrium points, which are the fixed points of this repeated retraining procedure, and provide sufficient conditions for their existence and uniqueness. To find equilibrium points, we develop deterministic and stochastic primal-dual algorithms and demonstrate their convergence with constant step-size in the former and polynomial decay step-size schedule in the latter. By modeling errors emerging from a stochastic gradient estimator as sub-Weibull random variables, we provide error bounds in expectation and in high probability that hold for each iteration. Without additional knowledge of the distributional map, computing saddle points is intractable. Thus we propose a condition on the distributional map--which we call opposing mixture dominance--that ensures that the objective is strongly-convex-strongly-concave. Finally, we demonstrate that derivative-free algorithms with a single function evaluation are capable of approximating saddle points

📄 PDF Abstract BibTeX arXiv:2201.02313

Code (1)

killianrwood/charging-market 공식 구현

Similar Papers 제목 키워드 기반

Escaping Saddle Points with Stochastically Controlled Stochastic Gradient Methods

2021-03-07 · Guannan Liang, Qianqian Tong, Chunjiang Zhu, Jinbo Bi

Stochastically controlled stochastic gradient (SCSG) methods have been proved to converge efficiently to first-order stationary points which, however, can be saddle points in nonconvex optimization. It has been observed …

Role of Externally Provided Randomness in Stochastic Teams and Zero-sum Team Games

2021-10-12 · Rahul Meshram

Stochastic team decision problem is extensively studied in literature and the existence of optimal solution is obtained in recent literature. The value of information in statistical problem and decision theory is classic…

Differentially Private Algorithms for the Stochastic Saddle Point Problem with Optimal Rates for the Strong Gap

2023-02-24 · Raef Bassily, Cristóbal Guzmán, Michael Menart

We show that convex-concave Lipschitz stochastic saddle point problems (also known as stochastic minimax optimization) can be solved under the constraint of $(\epsilon,\delta)$-differential privacy with \emph{strong (pri…

Stochastic Optimization

Online and Bandit Algorithms for Nonstationary Stochastic Saddle-Point Optimization

2019-12-03 · Abhishek Roy, Yifang Chen, Krishnakumar Balasubramanian, Prasant Mohapatra

Saddle-point optimization problems are an important class of optimization problems with applications to game theory, multi-agent reinforcement learning and machine learning. A majority of the rich literature available fo…

Multi-agent Reinforcement LearningReinforcement Learning

A Stochastic Proximal Point Algorithm for Saddle-Point Problems

2019-09-13 · Luo Luo, Cheng Chen, Yu-Jun Li, Guangzeng Xie 외

We consider saddle point problems which objective functions are the average of $n$ strongly convex-concave individual components. Recently, researchers exploit variance reduction methods to solve such problems and achiev…