paper-with-me

Papers

Adaptive Gradient-Based Methods for a Broader Class of Optimization Problems under Performative Prediction

2026-07-29 · Hiroki Hamaguchi, Yuya Hikima, Hiroshi Sawada, Akiko Takeda arxiv

We study optimization under performative prediction, where deploying a model affects the future data distribution. For this setting, several gradient-based approaches have been proposed. However, they typically assume specific data distributions or loss functions, which limit their practical applicability. To overcome these limitations, we propose a gradient-based optimization method with convergence guarantees under substantially weaker assumptions. Our method explicitly estimates the induced distribution shift through finite differences. It enables higher-dimensional optimization across broader classes of loss functions and data distributions. We also propose a practical variant that reduces the number of samples required. Numerical experiments demonstrate that our proposed algorithms converge faster and more consistently than existing ones.

📄 PDF Abstract BibTeX arXiv:2607.26562

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

On the Convergence of A Class of Adam-Type Algorithms for Non-Convex Optimization

2018-08-08 · ICLR 2019 5 · Xiangyi Chen, Sijia Liu, Ruoyu Sun, Mingyi Hong

This paper studies a class of adaptive gradient based momentum algorithms that update the search directions and learning rates simultaneously using past gradients. This class, which we refer to as the "Adam-type", includ…

Open-Ended Question AnsweringStochastic Optimization

The Ball-Proximal (="Broximal") Point Method: a New Algorithm, Convergence Theory, and Applications

2025-02-04 · Kaja Gruntkowska, Hanmin Li, Aadi Rane, Peter Richtárik

Non-smooth and non-convex global optimization poses significant challenges across various applications, where standard gradient-based methods often struggle. We propose the Ball-Proximal Point Method, Broximal Point Meth…

global-optimization

Hybrid Stochastic Gradient Descent Algorithms for Stochastic Nonconvex Optimization

2019-05-15 · Quoc Tran-Dinh, Nhan H. Pham, Dzung T. Phan, Lam M. Nguyen

We introduce a hybrid stochastic estimator to design stochastic gradient algorithms for solving stochastic optimization problems. Such a hybrid estimator is a convex combination of two existing biased and unbiased estima…

Stochastic Optimization

On the Convergence of Adaptive Gradient Methods for Nonconvex Optimization

2018-08-16 · Dongruo Zhou, Jinghui Chen, Yuan Cao, Ziyan Yang 외

Adaptive gradient methods are workhorses in deep learning. However, the convergence guarantees of adaptive gradient methods for nonconvex optimization have not been thoroughly studied. In this paper, we provide a fine-gr…

Adaptive First-and Zeroth-order Methods for Weakly Convex Stochastic Optimization Problems

2020-05-19 · Parvin Nazari, Davoud Ataee Tarzanagh, George Michailidis

In this paper, we design and analyze a new family of adaptive subgradient methods for solving an important class of weakly convex (possibly nonsmooth) stochastic optimization problems. Adaptive methods that use exponenti…

Stochastic Optimization