paper-with-me

Papers

Shuffling Heuristic in Variational Inequalities: Establishing New Convergence Guarantees

2025-09-04 · Daniil Medyakov, Gleb Molodtsov, Grigoriy Evseev, Egor Petrov, Aleksandr Beznosikov arxiv

Variational inequalities have gained significant attention in machine learning and optimization research. While stochastic methods for solving these problems typically assume independent data sampling, we investigate an alternative approach -- the shuffling heuristic. This strategy involves permuting the dataset before sequential processing, ensuring equal consideration of all data points. Despite its practical utility, theoretical guarantees for shuffling in variational inequalities remain unexplored. We address this gap by providing the first theoretical convergence estimates for shuffling methods in this context. Our analysis establishes rigorous bounds and convergence rates, extending the theoretical framework for this important class of algorithms. We validate our findings through extensive experiments on diverse benchmark variational inequality problems, demonstrating faster convergence of shuffling methods compared to independent sampling approaches.

📄 PDF Abstract BibTeX arXiv:2509.04133

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Faster Rates For Federated Variational Inequalities

2026-02-09 · Guanghui Wang, Satyen Kale arxiv

In this paper, we study federated optimization for solving stochastic variational inequalities (VIs), a problem that has attracted growing attention in recent years. Despite substantial progress, a significant gap remain…

Stochastic Extragradient with Random Reshuffling: Improved Convergence for Variational Inequalities

2024-03-11 · Konstantinos Emmanouilidis, René Vidal, Nicolas Loizou

The Stochastic Extragradient (SEG) method is one of the most popular algorithms for solving finite-sum min-max optimization and variational inequality problems (VIPs) appearing in various machine learning tasks. However,…

On the Convergence to a Global Solution of Shuffling-Type Gradient Algorithms

2022-06-13 · NeurIPS 2023 11

Stochastic gradient descent (SGD) algorithm is the method of choice in many machine learning tasks thanks to its scalability and efficiency in dealing with large-scale problems. In this paper, we focus on the shuffling v…

SARAH-based Variance-reduced Algorithm for Stochastic Finite-sum Cocoercive Variational Inequalities

2022-10-12 · Aleksandr Beznosikov, Alexander Gasnikov

Variational inequalities are a broad formalism that encompasses a vast number of applications. Motivated by applications in machine learning and beyond, stochastic methods are of great importance. In this paper we consid…

Optimal Extragradient-Based Algorithms for Stochastic Variational Inequalities with Separable Structure

2023-09-21 · NeurIPS 2023 11

We consider the problem of solving stochastic monotone variational inequalities with a separable structure using a stochastic first-order oracle. Building on standard extragradient for variational inequalities we propose…